You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/10/09 15:47:59 UTC

Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #973

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/973/display/redirect>

Changes:


------------------------------------------
[...truncated 50.32 MB...]
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:33655 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-09T15:42:41.011046148+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:38353 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-09T15:43:14.873058867+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2801: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:36125 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-09T15:44:02.742234091+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:39871 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-09T15:44:30.207049391+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:37483 {created_time:"2022-10-09T15:47:16.088999057+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6658 deselected, 89 warnings, 2 errors in 457.96s (0:07:37) =

> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 34s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wkvcbzp53pby2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python_Examples_Flink #1174

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1174/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1173

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1173/display/redirect?page=changes>

Changes:

[noreply] [Tour Of Beam] persistence_key for Pg::SaveSnippet (#24287)

[noreply] Get postcommits green and unsickbay (#24342)

[noreply] Fix workflow cron syntax (#24376)


------------------------------------------
[...truncated 33.50 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-15
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-17
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Beam Fn Data client connected.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-8
INFO     apache_beam.io.fileio:fileio.py:682 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.temp03e5dc0c-20d3-4773-9e04-8e701fd4314b/787221733659850178_4b7212ab-be44-4034-b24f-51367cd59326 to dir: gs://temp-storage-for-end-to-end-tests/temp-it as 2e360157-a906-4d2e-b905-f621093cd504.result-00000-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp03e5dc0c-20d3-4773-9e04-8e701fd4314b/787221733659850178_4b7212ab-be44-4034-b24f-51367cd59326', shard_index=-1, total_shards=0, window=GlobalWindow, pane=None, destination=None)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-13
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-9
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:36 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 3-10
INFO     apache_beam.io.fileio:fileio.py:682 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.temp03e5dc0c-20d3-4773-9e04-8e701fd4314b/787221733659850178_a3534a91-b5a5-4a12-bbc2-5879c4cf3568 to dir: gs://temp-storage-for-end-to-end-tests/temp-it as 2e360157-a906-4d2e-b905-f621093cd504.result-00001-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp03e5dc0c-20d3-4773-9e04-8e701fd4314b/787221733659850178_a3534a91-b5a5-4a12-bbc2-5879c4cf3568', shard_index=-1, total_shards=0, window=GlobalWindow, pane=None, destination=None)
INFO     apache_beam.io.fileio:fileio.py:682 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.temp03e5dc0c-20d3-4773-9e04-8e701fd4314b/787221733659850178_ba97d140-3a4e-4605-a276-116b9883ba01 to dir: gs://temp-storage-for-end-to-end-tests/temp-it as 2e360157-a906-4d2e-b905-f621093cd504.result-00002-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp03e5dc0c-20d3-4773-9e04-8e701fd4314b/787221733659850178_ba97d140-3a4e-4605-a276-116b9883ba01', shard_index=-1, total_shards=0, window=GlobalWindow, pane=None, destination=None)
INFO     apache_beam.io.fileio:fileio.py:682 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.temp03e5dc0c-20d3-4773-9e04-8e701fd4314b/787221733659850178_ea9b2f69-5db3-47ad-97dc-fc4bb96b520e to dir: gs://temp-storage-for-end-to-end-tests/temp-it as 2e360157-a906-4d2e-b905-f621093cd504.result-00003-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.temp03e5dc0c-20d3-4773-9e04-8e701fd4314b/787221733659850178_ea9b2f69-5db3-47ad-97dc-fc4bb96b520e', shard_index=-1, total_shards=0, window=GlobalWindow, pane=None, destination=None)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:37 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing environment urn: "beam:env:external:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n\021\n\017localhost:35649"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1"
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:264 No more requests from control plane
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:265 SDK Harness waiting for in-flight requests to complete
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
ERROR    apache_beam.runners.worker.data_plane:data_plane.py:661 Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36959 {created_time:"2022-11-28T15:48:37.942153999+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
INFO     apache_beam.runners.worker.data_plane:data_plane.py:805 Closing all cached grpc data channels.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:875 Closing all cached gRPC state handlers.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO     apache_beam.runners.worker.sdk_worker:sdk_worker.py:277 Done consuming work.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v0"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:worker_status:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:combinefn:packed_python:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.44.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 28, 2022 3:48:37 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to DONE
INFO     apache_beam.io.gcp.gcsio:gcsio.py:620 Finished listing 4 files in 0.04181694984436035 seconds.
PASSED                                                                   [100%]

=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=== 18 passed, 6 skipped, 6727 deselected, 35 warnings in 510.79s (0:08:30) ====
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41087 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-28T15:46:01.728021972+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45531 {created_time:"2022-11-28T15:46:43.303892512+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39165 {created_time:"2022-11-28T15:47:19.92999142+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>


FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 139

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 29s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/guzoaa2pjhlm6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1172

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1172/display/redirect>

Changes:


------------------------------------------
[...truncated 59.50 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1128094246-545f3d2b_f1dfbe62-06ce-4536-9468-b96135bc9e04 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33933 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-28T09:49:18.913480199+00:00"}"
>

FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1128094457-2ab61ea4_b3c12572-481b-4e7c-a88e-dfdefd874d7f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1128094851-78409e5_77d23de9-bd0a-41c3-b5fc-dc5bafaa7b05 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1128094927-9e188dea_02f19797-111e-455a-93bc-3f54c9aa87a3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 41 warnings in 652.96s (0:10:52) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 56s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/j2md5s75dy7w6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1171

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1171/display/redirect>

Changes:


------------------------------------------
[...truncated 57.99 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40765 {created_time:"2022-11-28T03:46:20.597124498+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39477 {created_time:"2022-11-28T03:46:40.993626901+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46481 {created_time:"2022-11-28T03:47:40.108723378+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41613 {created_time:"2022-11-28T03:48:21.002484156+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43267 {created_time:"2022-11-28T03:48:41.860391656+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42905 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-28T03:49:00.728708673+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33265 {created_time:"2022-11-28T03:49:34.874351716+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39059 {created_time:"2022-11-28T03:50:43.495188562+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1128034257-bbd913d2_baf053d9-3d1a-493a-b7e5-0abbc6e3b2dc failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1128034909-6dbab726_33536a0a-98b5-44b8-8f8b-a647c6ce97a2 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1128034942-2f10bf1d_186c4395-3451-4e5e-b02c-a4e5a72383ca failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6723 deselected, 692 warnings in 657.50s (0:10:57) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 9s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/js3pkhxal7dyo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1170

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1170/display/redirect>

Changes:


------------------------------------------
[...truncated 58.66 MB...]
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44143 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T21:45:42.509634703+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36595 {created_time:"2022-11-27T21:46:15.067373329+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33855 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T21:47:16.958510531+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43163 {created_time:"2022-11-27T21:47:59.824145532+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44351 {created_time:"2022-11-27T21:48:21.34910438+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41111 {created_time:"2022-11-27T21:48:39.478490126+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44205 {created_time:"2022-11-27T21:49:14.139657596+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38429 {created_time:"2022-11-27T21:50:45.85543659+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1127214242-6d8bdf9b_0cf87801-11fa-4f52-ab74-3d829ee83ab7 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1127214848-103dfb15_7772d74f-002a-4508-ac4d-eb9b5cda83a0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1127214922-8f309717_1ef46255-1519-4c15-a4dd-6a13148ac573 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6723 deselected, 693 warnings in 643.14s (0:10:43) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 44s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lppcnkmgizky2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1169

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1169/display/redirect>

Changes:


------------------------------------------
[...truncated 60.08 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45453 {created_time:"2022-11-27T15:46:57.469918887+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41053 {created_time:"2022-11-27T15:47:40.874188651+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45931 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T15:48:00.919757013+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42479 {created_time:"2022-11-27T15:48:19.32677713+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38775 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T15:48:53.46067577+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41259 {created_time:"2022-11-27T15:49:57.356110825+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1127154241-3b69cf80_a4fb8aea-1973-4e3c-9db3-74de09ce4341 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1127154434-6c7de08e_29431e10-d308-428a-a2a0-a6d2089f9d6c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1127154828-6d3cbf0f_8a97d30d-1475-4539-9b61-7069a365ef51 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1127154900-12e4ec10_991ad70a-d517-4ba2-9568-44539dfece6c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 675 warnings in 616.77s (0:10:16) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

> Task :sdks:python:test-suites:portable:py37:flinkExamples
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40973 {created_time:"2022-11-27T15:50:39.43328557+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46631 {created_time:"2022-11-27T15:50:39.433330266+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 30s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/b6vzupxoh7idg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1168

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1168/display/redirect>

Changes:


------------------------------------------
[...truncated 58.73 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37861 {created_time:"2022-11-27T09:46:29.78700931+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46729 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T09:47:37.56082588+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35279 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T09:48:18.530251001+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44885 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T09:48:39.574917603+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42491 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T09:48:57.882482664+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41937 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T09:49:32.73951323+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33137 {created_time:"2022-11-27T09:50:43.592565339+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41221 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-27T09:51:09.642170398+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1127094250-f7b071c9_ad0d95b9-0091-4d81-9575-351cb5b064b7 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1127094907-44c90106_8fe60576-8439-41af-92e9-1a5805d8abf0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1127094940-45307fdf_296a2591-fb07-4e4c-92dd-c48fb74ada50 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 14 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6723 deselected, 701 warnings in 660.28s (0:11:00) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 5s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jssfeyjwsejhm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1167

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1167/display/redirect>

Changes:


------------------------------------------
[...truncated 58.40 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 27, 2022 3:49:35 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name MapPartition (MapPartition at [2]write short words/Write/WriteImpl/DoOnce/{FlatMap(<lambda at core.py:3507>), Map(decode)}) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 27, 2022 3:49:36 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1127034928-b3d8ded4_afb07e3c-59f2-47f5-9c16-87683d57b979.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1127034249-d95ebb37_8b90b90a-86ab-42af-aa61-3412aa7c2089 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 13 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1127034450-30f11e89_662bcdea-0950-4571-8026-ea120e7575c1 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1127034850-7cd9b3a9_79b3f7ed-a646-4265-9701-8cd00c06468a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1127034928-b3d8ded4_afb07e3c-59f2-47f5-9c16-87683d57b979 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 41 warnings in 657.13s (0:10:57) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 7s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/niwrtoube4246

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1166

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1166/display/redirect>

Changes:


------------------------------------------
[...truncated 58.76 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34157 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T21:45:55.679340404+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38103 {created_time:"2022-11-26T21:46:16.903877725+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35933 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T21:47:19.035122151+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43071 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T21:47:50.972749501+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40379 {created_time:"2022-11-26T21:48:27.999002138+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34323 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T21:48:49.384162222+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40625 {created_time:"2022-11-26T21:49:25.557706372+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43809 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T21:50:38.343187475+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1126214248-c771f9ae_2dc80532-e201-4a2c-9a67-e3bbf5a6b4b0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1126214858-3dcd4c83_1202fb3e-1b05-4e0a-bc0e-c1953e1faa38 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1126214933-836473b_c9902341-d3b8-48b4-a0d7-cedb61a0876b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 11 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6723 deselected, 702 warnings in 660.00s (0:10:59) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 7s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/u54obd55662vm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1165

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1165/display/redirect>

Changes:


------------------------------------------
[...truncated 58.95 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38727 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T15:45:22.606455712+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45345 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T15:45:41.491953093+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41175 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T15:46:39.255101871+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33605 {created_time:"2022-11-26T15:47:08.910883585+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40661 {created_time:"2022-11-26T15:47:39.006314406+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45815 {created_time:"2022-11-26T15:47:56.965674176+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37365 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T15:48:26.161496488+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34285 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-26T15:49:54.514973935+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1126154247-4a8c3bc4_2c8e8d7a-e408-4074-a4de-7e73f42177ab failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1126154430-7130f57b_3ed3fed9-a03b-4865-8fe1-e1cf1298ff92 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1126154804-5a341e9a_43123d33-c97c-4b8d-8377-2b9b233ff475 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1126154832-b866a9aa_385e4a5b-2e27-46db-9c5b-0cdf4a0cc694 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 1, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 673 warnings in 576.54s (0:09:36) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 45s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cz6zg5uz67arm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1164

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1164/display/redirect>

Changes:


------------------------------------------
[...truncated 59.14 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 26, 2022 9:49:48 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1126094942-bd93963c_b63dd8b7-392d-4035-8e3c-f9621fff9e97.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1126094255-7008ba34_5c25812f-319e-417f-abd4-ccc564748d4e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1126094908-64c7b76d_b25538eb-c2a8-4757-9c97-7cf0d7fcd86f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1126094942-bd93963c_b63dd8b7-392d-4035-8e3c-f9621fff9e97 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6723 deselected, 41 warnings in 661.77s (0:11:01) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 7s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gypdzoqylwm2w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1163

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1163/display/redirect?page=changes>

Changes:

[noreply] Update java-multi-language-pipelines.md (#24345)


------------------------------------------
[...truncated 58.40 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 26, 2022 3:50:10 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1126035002-8fc58800_8117b576-d916-486a-bb26-40af393fda82.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1126034258-cf026bb3_2901f3ca-3028-47b6-a91f-1586976a1a47 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1126034500-79cf7f70_8d93e0f5-2c50-4ab3-bca9-f9af0008c811 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1126034926-93902e9_0c92b02d-be1c-4b27-9057-e73d2091c290 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1126035002-8fc58800_8117b576-d916-486a-bb26-40af393fda82 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 41 warnings in 687.66s (0:11:27) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 28s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4mmda7hs7wf4w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1162

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1162/display/redirect>

Changes:


------------------------------------------
[...truncated 59.65 MB...]
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33435 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T21:46:16.34733221+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38849 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T21:47:17.726718155+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39587 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T21:48:00.247105735+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44889 {created_time:"2022-11-25T21:48:19.870495714+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36035 {created_time:"2022-11-25T21:48:38.413603928+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42353 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T21:49:12.336894201+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41909 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T21:50:25.128952809+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41511 {created_time:"2022-11-25T21:50:53.039929235+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1125214250-32108143_7374874e-48ae-43b7-9ea7-d453ec888ee7 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1125214453-979bb8f8_1cc49876-e6cb-4546-a276-661dce62b1be failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1125214846-32181c90_6d0a99b6-f00c-478d-baf9-15b69648d957 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1125214919-a3ef95a_4fea856d-f648-4280-8e71-81e81cd950a5 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 672 warnings in 644.26s (0:10:44) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 48s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/a2kdzrizknjuw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1161

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1161/display/redirect>

Changes:


------------------------------------------
[...truncated 59.76 MB...]
	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:33047: Failed to connect to remote host: Connection refused {grpc_status:14, created_time:"2022-11-25T15:48:52.381074688+00:00"}"
>


INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory lambda$createEnvironmentCaches$3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Expiring environment urn: "beam:env:external:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n\021\n\017localhost:44783"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v0"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:worker_status:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:combinefn:packed_python:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.44.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126  with 41 remaining bundle references. Taking note to clean it up during shutdown if the references are not removed by then.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-31
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-18
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient unref
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing environment urn: "beam:env:external:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n\021\n\017localhost:44783"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v0"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:worker_status:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:combinefn:packed_python:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.44.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-29
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-9
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-30
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-41
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-28
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-33
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-13
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-3
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-26
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 25, 2022 3:48:52 PM org.apache.beam.runners.fnexecution.control.FnApiControlClient closeAndTerminateOutstandingRequests
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1125154226-34a97415_be45536e-afc5-4179-be1b-4401de1cc78d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1125154425-59b73208_0d383bca-1fca-434b-a92d-7763df1bf10d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1125154813-d56a76ed_c7b8449b-7760-4ec6-a842-b8fa7513ecf8 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1125154845-70abf1e1_7189c3c6-5f3b-40e0-90c1-9a189c14648d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 41 warnings in 622.22s (0:10:22) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 10s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4gs733nvepzxi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1160

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1160/display/redirect>

Changes:


------------------------------------------
[...truncated 57.74 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44791 {created_time:"2022-11-25T09:45:41.36894758+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35895 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T09:46:41.482317913+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33435 {created_time:"2022-11-25T09:47:26.199398467+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37025 {created_time:"2022-11-25T09:47:46.871839992+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37197 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T09:48:06.655413392+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45393 {created_time:"2022-11-25T09:48:38.745826568+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40817 {created_time:"2022-11-25T09:49:48.205272989+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41647 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T09:50:10.941829456+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1125094226-8cc729a8_a4985641-e14e-4a9f-befe-5bcc6569828a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1125094425-df094f83_62c56941-0f19-4817-a94a-93f5ff6cbf7b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1125094814-df7c5556_2554868a-f8d0-4d92-bc53-f8fe1b4f894c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1125094845-86f6dbf9_12281fd1-208d-474c-8718-c5f240c5d4ce failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 14 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 671 warnings in 625.00s (0:10:24) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 12s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/flhbt4mu5ozda

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1159

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1159/display/redirect>

Changes:


------------------------------------------
[...truncated 58.49 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45851 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T03:50:15.887323288+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41855 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-25T03:50:42.422307419+00:00"}"
>

FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1125034241-58719a8_07e9f50b-5f41-451a-9741-f5d8d6655ca3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1125034443-5096b596_c4320a44-e596-414a-b6fe-257652e6f8b0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1125034834-a114644f_e653220b-d92e-496d-bc51-d5a22b126599 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1125034910-b9c5228e_9aa3bb9b-728b-4252-8be1-4edb833251c6 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 41 warnings in 644.43s (0:10:44) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 44s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/j5l32ai4hgdz6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1158

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1158/display/redirect>

Changes:


------------------------------------------
[...truncated 57.80 MB...]
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38803 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-24T21:48:30.834953585+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36443 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-24T21:48:50.442367323+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42631 {created_time:"2022-11-24T21:49:09.530104511+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42227 {created_time:"2022-11-24T21:49:46.625339309+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38953 {created_time:"2022-11-24T21:50:55.446774837+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44537 {created_time:"2022-11-24T21:51:22.389734164+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1124214252-281569a9_ffdbeb61-4101-4d80-b22f-db0ec9e571cc failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1124214918-8b47268e_e9c7db6a-011e-4d8e-b630-1d39e0c278f3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1124214954-b1605776_3b94debc-5ef5-491d-bfd9-2cecf884a75f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6723 deselected, 704 warnings in 674.33s (0:11:14) =
Exception in thread run_worker_1-1:
Traceback (most recent call last):
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39753 {created_time:"2022-11-24T21:51:39.802814314+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 946, in run
    self.run()
    self._target(*self._args, **self._kwargs)
  File "/usr/lib/python3.10/threading.py", line 946, in run
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39753 {created_time:"2022-11-24T21:51:39.802814314+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41277 {created_time:"2022-11-24T21:51:39.802814193+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 31s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/t3tmouggcr62k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1157

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1157/display/redirect>

Changes:


------------------------------------------
[...truncated 58.73 MB...]
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []


Exception in thread read_grpc_client_inputs:
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

    target=lambda: self._read_inputs(elements_iterator),
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46231 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-24T15:48:39.937243207+00:00"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39215 {created_time:"2022-11-24T15:49:16.301904396+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 809, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46751 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-24T15:49:16.338427718+00:00"}"
>
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::
test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1124154239-ba1b84df_58658345-493b-4344-8d86-d3368d1db820 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1124154443-fcd1bcf4_3a3045f3-0c58-4683-8a89-1d881605676b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1124154848-6780b895_60f9b37d-c708-497a-a524-192292254c6e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1124154923-d2a3732a_b1d7ac16-6366-4923-87a0-9c148ebf5743 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6723 deselected, 41 warnings in 663.59s (0:11:03) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 58s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/psnefpgvrik7e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1156

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1156/display/redirect?page=changes>

Changes:

[noreply] Enable streaming runner v2 tests that were forgotten to be enabled.

[noreply] A schema transform implementation for SpannerIO.Write (#24278)


------------------------------------------
[...truncated 57.59 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42607 {created_time:"2022-11-24T09:49:47.405286208+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46063 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-24T09:50:50.306632607+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33039 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-24T09:51:33.169524566+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33715 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-24T09:51:53.768027182+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34955 {created_time:"2022-11-24T09:52:18.041869129+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43809 {created_time:"2022-11-24T09:52:55.803692724+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46677 {created_time:"2022-11-24T09:54:12.688895641+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37969 {created_time:"2022-11-24T09:54:38.785967268+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1124094606-a1b7f13d_36c21d01-25c3-4e7f-a05d-d67bf76312a8 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1124095227-73820a22_990ab60e-e357-4bdd-8a3a-7b922cf57ece failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1124095308-1dc8e72d_997b6b7a-eb11-4a99-b93b-1e8471929e09 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6723 deselected, 693 warnings in 685.73s (0:11:25) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 38s
133 actionable tasks: 90 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lbrimn5cpkiqo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1155

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1155/display/redirect?page=changes>

Changes:

[noreply] Updates ExpansionService to support dynamically discovering and


------------------------------------------
[...truncated 58.22 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44601 {created_time:"2022-11-24T04:01:53.213178406+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1124035038-e9474f21_cf81bd13-0aa2-4747-8111-1912ebcba9c0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1124040105-54b864c3_6ef500b0-7360-42d5-93b0-8b7d576d2d2f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1124040208-dade7977_81752d3c-bd53-4ad6-936c-ccbc4849b800 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6723 deselected, 41 warnings in 1070.70s (0:17:50) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 26m 22s
133 actionable tasks: 99 executed, 32 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4cj444thendfa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1154

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1154/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] update table text content overflow #23460

[Moritz Mack] [Spark dataset runner] Fix translation to run in the evaluation thread

[Moritz Mack] [Metrics] Add 'performance tests' tag to JMH dashboard (related to

[noreply] Bump github.com/aws/aws-sdk-go-v2/credentials in /sdks (#24318)

[noreply] Update apache beam installation in notebook (#24336)

[noreply] Adds GCP core dependency to the test expansion service (#24308)

[noreply] Update dataflow containers to coincide with objsize 0.6.1 update

[noreply] Add test configurations for deterministic outputs on Dataflow (#24325)


------------------------------------------
[...truncated 58.79 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported


Traceback (most recent call last):
    temp_location = pcoll.pipeline.options.view_as(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44303 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-23T21:51:01.779234525+00:00"}"
>

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1123214240-8017f456_e1317121-87fd-42b2-9be6-d680a0c34c86 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1123214844-c55d9549_750acc36-077e-4e1a-9c32-8abfc9360451 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 1, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1123214921-1896cf_85379d63-d685-45e3-b19a-98edd6072fef failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6722 deselected, 41 warnings in 666.43s (0:11:06) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 56s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uwx3nf553whsu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1153

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1153/display/redirect>

Changes:


------------------------------------------
[...truncated 59.75 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42741 {created_time:"2022-11-23T15:44:46.009508639+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37595 {created_time:"2022-11-23T15:45:16.394808857+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39041 {created_time:"2022-11-23T15:46:14.486961416+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40463 {created_time:"2022-11-23T15:46:41.692671609+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42345 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-23T15:47:55.793652004+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread run_worker_3-1
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
      for work_request in self._control_stub.Control(get_responses()):
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Runner closed connection"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42679 {grpc_message:"Runner closed connection", grpc_status:1, created_time:"2022-11-23T15:48:45.114525924+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38889 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-23T15:49:39.327554952+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46275 {created_time:"2022-11-23T15:50:17.393671257+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1123154216-2af556af_3df5afdf-ea4d-49ad-b80d-4e79642c4cbf failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 11 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1123154404-e4aeef8b_3706fba7-4d11-4f7f-9622-f48f43f347a6 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1123154822-cfc56b35_59a3e70d-1f7a-4a39-84b8-ff1679eda0ea failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1123154852-acf71c_689bcc51-c7d6-4f88-a31e-fdb9e4602e22 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6722 deselected, 670 warnings in 614.65s (0:10:14) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 13s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7w4hqbewmoug4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1152

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1152/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Add a portable runner that renders pipelines as a dot graph.

[Robert Bradshaw] Add basic tests for render runner.

[Robert Bradshaw] Add the ability to pass a pipeline proto directly.

[Robert Bradshaw] lint

[Valentyn Tymofieiev] Fix typo.

[Valentyn Tymofieiev] Serve the graph when output file is not specified.

[Valentyn Tymofieiev] Serve the graph when output file is not specified.

[Valentyn Tymofieiev] Fix parsing of standalone protos.

[Valentyn Tymofieiev] Support reading from GCS.

[Valentyn Tymofieiev] Add text logging.

[Valentyn Tymofieiev] fix typo.

[Valentyn Tymofieiev] Some lint and yapf.

[Robert Bradshaw] Fix dot detection logic.

[Robert Bradshaw] fix error detected by lint

[Robert Bradshaw] Make gcs an optional dependency.

[Robert Bradshaw] return rather than sys.exit

[Robert Bradshaw] lint

[noreply] Apply suggestions from code review

[Robert Bradshaw] More cleanup, mypy.

[noreply] Dask runner tests action (#24324)

[Robert Bradshaw] lint


------------------------------------------
[...truncated 58.94 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1123094310-b2d71abf_5fc5602f-ea10-49ed-ac32-308e17806d17 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1123095020-cfeda670_8161f197-b8d1-475f-b8b6-137a1cf42e1b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 14 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1123095049-ba45dfee_6b1d3b56-b9c5-4707-8908-9ab5230184e5 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6722 deselected, 41 warnings in 701.02s (0:11:41) =
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38783 {created_time:"2022-11-23T09:52:11.005472943+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 59s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/x45hgweqmy44g

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1151

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1151/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] change share-your-story link, add text to ADD_CASE_STUDY.md,

[mr.malarg] pg_23865 fix selected example at list

[leha] Expand all categories that contain a selected example (#23865)

[noreply] fixed typo

[noreply] [#24266] Update release candidate script to use -PisRelease (#24269)

[noreply] Golang SpannerIO Implementation (#23285)

[noreply] Add rootCaCertificate option to SplunkIO (#24229)

[noreply] [Playground] Remove example bucket (#24198)

[noreply] Extract Go and Python Beam symbols for Playground (#23378)


------------------------------------------
[...truncated 58.50 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 23, 2022 4:08:56 AM org.apache.flink.runtime.io.network.buffer.NetworkBufferPool maybeLogUsageWarning
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Memory usage [107%] is too high to satisfy all of the requests. This can severely impact network throughput. Please consider increasing available network memory, or decreasing configured size of network buffer pools. (totalMemory=64.000mb (67108864 bytes), requestedMemory=68.750mb (72089600 bytes), missingMemory=4.750mb (4980736 bytes))
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 23, 2022 4:08:58 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1123040818-3543aec4_f82c0dd0-ab54-4118-9d6b-48e3247fc10e.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1123034841-7341ff74_a8ede1e9-f0ce-493a-ae92-3b9a7a51cd51 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1123040624-cbb38592_ba42c9ea-4673-4c38-b677-abd1058fa820 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1123040818-3543aec4_f82c0dd0-ab54-4118-9d6b-48e3247fc10e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6718 deselected, 41 warnings in 1719.78s (0:28:39) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 31m 5s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/r4gnyju6qeraa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1150

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1150/display/redirect?page=changes>

Changes:

[kn1kn1] Fix mvn command to refer the GCP_REGION variable

[noreply] Copy editing the machine learning pages (#24301)

[noreply] TensorRT Custom Inference Function Implementation (#24039)

[noreply] Teach Azure Filesystem to authenticate using DefaultAzureCredential in

[noreply] Add retry to test connections (#23757)


------------------------------------------
[...truncated 58.87 MB...]
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36515 {created_time:"2022-11-22T21:53:04.228369155+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43893 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T21:55:12.290820213+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35805 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T21:56:53.13774696+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34643 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T21:57:26.254980734+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37231 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T21:59:02.435546546+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34509 {created_time:"2022-11-22T21:59:22.33760792+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 45 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45481 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T22:00:24.83462482+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38047 {created_time:"2022-11-22T22:00:56.365553632+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1122214627-5b9971ec_c7801c4f-3bf9-486b-a9a1-86576426d954 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1122215815-5bc3dc2f_efd91437-cb32-4568-97ea-59af57254f03 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 1, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1122215911-73dbb51d_16cbd436-426c-4b34-98dd-b4b994f7296b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6718 deselected, 698 warnings in 1172.38s (0:19:32) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 23m 4s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/yzqjepa73cp7c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1149

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1149/display/redirect?page=changes>

Changes:

[noreply] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#24280)


------------------------------------------
[...truncated 59.34 MB...]
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46571 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T15:44:15.242221167+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46739 {created_time:"2022-11-22T15:45:33.81008903+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44775 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T15:45:59.057591475+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44759 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T15:46:24.948931471+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39497 {created_time:"2022-11-22T15:46:40.771590019+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33743 {created_time:"2022-11-22T15:47:07.106779053+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39361 {created_time:"2022-11-22T15:48:29.236577085+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1122154158-49db787c_824a7a1f-4137-4bc8-a69b-2e9c033288f0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1122154339-70300c4f_ece7e26b-411f-4810-b010-68f7f27be59d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1122154646-30a54f85_e007c5fa-be56-4660-9c0a-d44ceb50fef6 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1122154712-fe6cbd7c_8e3e3d6e-943d-4922-9419-52a779322bd9 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6718 deselected, 672 warnings in 518.97s (0:08:38) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 37s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/33ygw6f2sgpji

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1148

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1148/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] add lazy loading attr to images #24250


------------------------------------------
[...truncated 58.63 MB...]
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34393 {created_time:"2022-11-22T13:48:27.824038131+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46239 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-22T13:48:55.715047924+00:00"}"
>

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35587 {created_time:"2022-11-22T13:49:44.513872946+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1122134412-f3ce303c_725b3f2e-f7a3-42be-b777-0b70fc4dda54 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1122134612-5bf94416_465e0b5b-7b9d-4400-991b-135d90e0697b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 16 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1122134952-1f6a4bb4_799e982a-440c-43d6-948c-6cfaf7fbd5c7 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1122135023-5d9ee807_46692b77-76fe-441d-9a87-a71ef3b85d2c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6718 deselected, 41 warnings in 618.58s (0:10:18) =
Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44039 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-22T13:52:00.722242327+00:00"}"
>

ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34341 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-22T13:52:00.722793304+00:00"}"
>
Exception in thread read_state:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1006, in pull_responses
    for response in responses:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46151 {created_time:"2022-11-22T13:52:00.722367052+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34341 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-22T13:52:00.722793304+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 18s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wade5nqxag46c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1147

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1147/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Work around coders bug on Dataflow.

[Robert Bradshaw] Add a test runner for running multiple pipelines in parallel.

[Robert Bradshaw] Run tests as single Dataflow pipeline.

[Robert Bradshaw] Github hook for dataflow pipelines.

[Robert Bradshaw] Guard dataflow run against GCP credentials.

[Robert Bradshaw] Guard running of precommit against having variables set.


------------------------------------------
[...truncated 59.15 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35603 {created_time:"2022-11-22T03:47:22.51386194+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44319 {created_time:"2022-11-22T03:48:13.059876331+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34287 {grpc_message:"Runner closed connection", grpc_status:1, created_time:"2022-11-22T03:48:46.939478172+00:00"}"
>


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1122034247-94ca64ea_54a21f67-a4a4-443b-b83e-5c39c2f62247 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1122034443-ed6f6599_216fff2c-05d7-4023-b3d2-09a32148d82d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1122034821-5cbf6bd5_2df87449-84ad-47d1-8b7b-fc7e4e30c6f1 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1122034854-d2071589_5a8b1f9a-18fe-4ecd-a536-1d56d3e3cc50 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6718 deselected, 41 warnings in 618.80s (0:10:18) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 19s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/m5gecuqo6yxdk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1146

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1146/display/redirect?page=changes>

Changes:

[noreply] Fix dashboard links

[noreply] Bump github.com/aws/aws-sdk-go-v2/config from 1.18.1 to 1.18.2 in /sdks

[noreply] Add warning about google-cloud-platform-core dependency change in #24235

[noreply] Add GetSize implementation for DetectNewPartitions SDF (#23997)

[noreply] Add ZstdCoder to wrap coders with Zstandard compression (#24093)

[noreply] [#24261] Update to objsize 0.6.1 (#24262)

[noreply] Create template for failing tests. (#21728)

[noreply] Add record_metrics argument to utils.BatchElements (#23701)

[noreply] Performance test parameters followup fix (#24291)


------------------------------------------
[...truncated 59.69 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 21, 2022 9:54:32 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1121215424-3ef3f738_fca2f4ee-50de-490d-b619-c288a1fe543d.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1121214739-99d5cb6e_7d00e6d7-0c11-41e8-8589-c64cb41d20bf failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1121214952-b5bd915a_4474b0c7-b2dd-4be0-99c9-166caa75a625 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1121215350-281279c2_22914085-9a81-4732-88e1-a906b74a9b3d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1121215424-3ef3f738_fca2f4ee-50de-490d-b619-c288a1fe543d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6718 deselected, 41 warnings in 672.49s (0:11:12) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 17m 46s
133 actionable tasks: 101 executed, 30 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nzy36pfsfjpzg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1145

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1145/display/redirect?page=changes>

Changes:

[noreply] [Playground] Use current Go SDK by default (#24256)


------------------------------------------
[...truncated 58.61 MB...]

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36991 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-21T15:55:00.81405259+00:00"}"
>

    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1121154746-13887cfa_bf97f080-eb2d-4d55-8b66-b38e9c32ab88 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1121155710-f291e6de_eb991ff1-719e-4081-8003-74a472d26898 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1121155746-c9ec1f04_9cff3f65-d3f6-4714-831a-abaa0ef748f9 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 41 warnings in 1064.87s (0:17:44) =
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46805 {created_time:"2022-11-21T15:55:02.647274928+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43361 {created_time:"2022-11-21T15:55:52.712832804+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38199 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-21T15:55:56.087798046+00:00"}"
>


> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36969 {created_time:"2022-11-21T15:59:26.864530111+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self.run()
    self.run()
  File "/usr/lib/python3.10/threading.py", line 946, in run
  File "/usr/lib/python3.10/threading.py", line 946, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45823 {created_time:"2022-11-21T15:59:26.864476921+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36969 {created_time:"2022-11-21T15:59:26.864530111+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 21m 20s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pzedr6vctnpyc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1144

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1144/display/redirect>

Changes:


------------------------------------------
[...truncated 58.48 MB...]
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34781 {created_time:"2022-11-21T09:45:50.235229966+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46539 {created_time:"2022-11-21T09:46:22.40784259+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46231 {created_time:"2022-11-21T09:47:21.103677174+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45751 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-21T09:47:47.865416196+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34611 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-21T09:48:19.013610712+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40147 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-21T09:48:37.508060087+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34699 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-21T09:49:11.439687393+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46069 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-21T09:50:20.194775745+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1121094245-3c4ea561_13754369-f897-466c-ad6f-a36959c40b8c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1121094846-10cb7477_687a4300-8272-4560-af42-caffb6da5f21 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1121094918-4af886a7_573e008f-f66b-490e-9513-453e3667e464 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 693 warnings in 641.89s (0:10:41) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 46s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/k2brmpwkp7po2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1143

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1143/display/redirect>

Changes:


------------------------------------------
[...truncated 59.01 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 13 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 13 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1121034241-6a037f56_a71d7387-f038-4092-bb44-42a1aff50a9f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 11 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1121034442-a032508_2e1c2673-0f94-4eda-94d4-c98c6ed37081 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1121034831-9a3d51aa_81e68dcc-58ea-4fbe-9a52-5726b052ff82 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1121034904-2853bdbb_765636c0-877e-4347-a6d1-abff9f7414b6 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 13 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6717 deselected, 41 warnings in 636.86s (0:10:36) =
Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42191 {created_time:"2022-11-21T03:50:44.980661964+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>

ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46877 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-21T03:50:44.980795146+00:00"}"
>
Exception in thread read_state:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1006, in pull_responses
    for response in responses:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44455 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-21T03:50:44.980744787+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46877 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-21T03:50:44.980795146+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 38s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dvla5bsd54xnc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1142

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1142/display/redirect>

Changes:


------------------------------------------
[...truncated 59.53 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39713 {created_time:"2022-11-20T21:48:16.898716153+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41199 {grpc_message:"Runner closed connection", grpc_status:1, created_time:"2022-11-20T21:49:09.242244342+00:00"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1120214255-fac8f03e_5847ab93-0e39-486a-9749-675f0045b419 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1120214459-97c59ddc_4e50f4f7-cffe-4b58-852e-eeab5836907b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1120214844-78f7bc12_04a059d9-d474-41db-859b-2c139f1b620c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1120214917-aff7b1bd_8736aa9f-3644-41cf-830b-86566f2c2324 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6717 deselected, 41 warnings in 643.67s (0:10:43) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 49s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jv2hijpwvjm4y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1141

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1141/display/redirect>

Changes:


------------------------------------------
[...truncated 57.65 MB...]
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42835 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T15:48:20.42756397+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43589 {created_time:"2022-11-20T15:48:41.797532657+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40793 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T15:49:17.198031239+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40007 {created_time:"2022-11-20T15:50:29.227900555+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40401 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T15:51:02.088994026+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1120154242-1bf792e9_16987a36-2bcc-4a18-a393-40e807a18bc4 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1120154850-49abaa24_fb5789bd-e0f2-43c6-a01a-bc861245d866 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1120154924-9b6bfa1c_fb9e6d70-9be6-46c3-b255-72db84f6ff00 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 698 warnings in 660.17s (0:11:00) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

> Task :sdks:python:test-suites:portable:py37:flinkExamples
Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45825 {created_time:"2022-11-20T15:51:07.295453945+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40623 {created_time:"2022-11-20T15:51:07.295701714+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>

Exception in thread read_state:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1006, in pull_responses
    for response in responses:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34961 {created_time:"2022-11-20T15:51:07.295731524+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 2s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/crspjdwnzxsd2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1140

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1140/display/redirect?page=changes>

Changes:

[samuelw] Fix OrderedListState for Dataflow Streaming pipelines on SE.


------------------------------------------
[...truncated 58.61 MB...]
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37125 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T09:46:05.437327437+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35405 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T09:46:25.782102127+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33057 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T09:47:23.927067972+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42925 {created_time:"2022-11-20T09:48:03.883965059+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41163 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T09:48:44.320277474+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39065 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T09:49:19.415146632+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37215 {created_time:"2022-11-20T09:50:30.411009497+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40945 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T09:50:57.744039569+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1120094248-c49573b3_3b24dc7f-15d8-4c89-80a0-3dae117c11f6 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1120094853-c07b6eb5_9fb2a007-40d5-4e3c-ba4b-34443f9a301d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1120094927-b0fad5dd_e5a32d76-11fd-4919-8e5a-ab13c78e1207 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 697 warnings in 653.50s (0:10:53) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 53s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jkd7rgy3j2dlq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1139

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1139/display/redirect>

Changes:


------------------------------------------
[...truncated 59.61 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44239 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T03:46:32.915900714+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44865 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T03:47:32.67961718+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46639 {created_time:"2022-11-20T03:48:14.762558074+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42333 {created_time:"2022-11-20T03:48:36.004093772+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread run_worker_2-1
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
      for work_request in self._control_stub.Control(get_responses()):
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Runner closed connection"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41835 {created_time:"2022-11-20T03:48:51.298155506+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33055 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T03:49:25.990297797+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 37 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35655 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-20T03:50:37.384670457+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42025 {created_time:"2022-11-20T03:51:04.51309616+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1120034256-d0a38d66_0ffc05a5-4f9c-40d5-bb1c-5294a523e727 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1120034900-c694c70_5c5fa220-a7a5-4943-a2e3-2ee3f158007b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1120034934-e0199869_b60f97ea-d5a3-4018-abf4-eb516d47be17 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 697 warnings in 662.75s (0:11:02) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 4s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3zlbl7jp22se6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1138

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1138/display/redirect>

Changes:


------------------------------------------
[...truncated 57.97 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42135 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-19T21:48:15.630914703+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38119 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-19T21:49:06.419646506+00:00"}"
>

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.



apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1119214251-63a9d223_961a5240-66ab-4158-9671-bfeb68542408 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1119215125-1ccd0431_b14fa222-f5dc-4d1a-b6a9-86a956abeb80 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1119215223-74816ac7_792b41ac-e61b-4147-941e-a07a51ac15f3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 41 warnings in 887.48s (0:14:47) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 51s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vo7womarmervc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1137

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1137/display/redirect>

Changes:


------------------------------------------
[...truncated 58.55 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35857 {created_time:"2022-11-19T15:54:28.412819363+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1119154528-3d69235e_c5887963-db4c-42b6-9021-7bbcd8cafac1 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1119154840-18de37c5_bd6af8ed-a477-4839-80ad-ab6d6defdbd0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1119155227-a8fd445_62e03fd4-9464-4c0e-b7a6-8c932db288c8 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1119155302-665d6042_0f2695c6-2cd2-47f5-8445-54374120ce44 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6717 deselected, 41 warnings in 700.86s (0:11:40) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 39s
133 actionable tasks: 90 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/p6jzpfzb6mwzw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1136

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1136/display/redirect>

Changes:


------------------------------------------
[...truncated 59.64 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
Exception in thread run_worker_2-1:
Traceback (most recent call last):
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41087 {created_time:"2022-11-19T09:48:40.566316537+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
=========================== short test summary info ============================
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38079 {created_time:"2022-11-19T09:48:40.661410668+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread run_worker_2-1:
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1119094255-780e6a69_dcce038e-f805-41fe-b08f-e62a3efe4b16 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1119094452-a27b6689_5c83aff8-62f7-4c56-b942-a9e09be88db3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1119094848-d9e2e5c8_cc9c8e9d-541f-4d54-8212-4ec73dd86204 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1119094924-235cdc41_a9464f6c-b71f-42ab-8405-a54e0427d699 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6717 deselected, 41 warnings in 644.41s (0:10:44) =
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33231 {grpc_message:"Runner closed connection", grpc_status:1, created_time:"2022-11-19T09:49:15.496592726+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46089 {created_time:"2022-11-19T09:50:54.810355632+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 47s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/z3b7j64dmonao

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1135

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1135/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Remove overly broad CanIgnoreReturnValue

[Kenneth Knowles] Add @RunWith annotation to pubsublite test

[noreply] Issue#21430 Updated dataframe io to avoid pruning

[chamikaramj] Update Java Multi-lang quickstart after the Beam 2.43.0 release


------------------------------------------
[...truncated 59.86 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37763 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-19T03:58:43.775078198+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1119034441-6500fd2d_a5d59004-8131-43a2-b464-cea77bfcecda failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/juliaset/juliaset/juliaset_test.py::JuliaSetTest::test_output_file_format - Failed: Timeout >600.0s [while running 'WriteToText/Write/WriteImpl/PreFinalize']
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1119035634-fc848e00_bb0deaa0-65fa-4671-aed8-25bc09c6da08 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 11 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33169 {created_time:"2022-11-19T03:59:42.687213037+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1119040012-d344777f_27e57393-80d4-4a81-9233-6198eb0f263a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38877 {created_time:"2022-11-19T04:00:38.850743631+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>

FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1119040046-2907bb6b_0199a640-05b6-4049-b12b-47e9a9de02c3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 5 failed, 17 passed, 6 skipped, 6717 deselected, 41 warnings in 1219.48s (0:20:19) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 24m 9s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xe3arwrrmuc24

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1134

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1134/display/redirect?page=changes>

Changes:

[noreply] Remove section from troubleshooting about fixed dictionary issue

[noreply] Fix flink XVR tests (#24228)

[noreply] Adding the list of example notebooks to the ML readme file. (#24255)

[noreply] Updating timezone for Beam 2.43.0 release (#24258)

[Kenneth Knowles] Only skip checkerframework if explicitly requested

[noreply] SingleStoreIO (#23535)


------------------------------------------
[...truncated 58.24 MB...]

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

Exception in thread run_worker_4-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41015 {grpc_message:"Runner closed connection", grpc_status:1, created_time:"2022-11-18T21:56:05.641725341+00:00"}"
>

Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1118214839-9cb4cb0b_6ec094af-587f-4269-b8de-180e4ea38d6f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1118215535-5ce26fcb_fe586f4a-7aae-4739-aa7c-f700fcb15e2d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1118215613-279b9ac_fbcf5ee4-5e6f-4985-911a-e10fd5cf8994 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 41 warnings in 754.00s (0:12:34) =
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37925 {created_time:"2022-11-18T21:56:22.860407597+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40549 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T21:57:56.01685968+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

> Task :sdks:python:test-suites:portable:py310:flinkExamples
Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 946, in run
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41079 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-18T21:58:23.735958564+00:00"}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    self.run()
    for work_request in self._control_stub.Control(get_responses()):
  File "/usr/lib/python3.10/threading.py", line 946, in run
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32955 {created_time:"2022-11-18T21:58:23.736064749+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41079 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-18T21:58:23.735958564+00:00"}"
>

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 19m 29s
133 actionable tasks: 93 executed, 38 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jkuk4gbdr3rwu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1133

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1133/display/redirect?page=changes>

Changes:

[noreply] Move dashboard links to dedicated section

[noreply] [Spark dataset runner] Cache datasets if used multiple times  (#24009)


------------------------------------------
[...truncated 60.15 MB...]
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40485 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T16:05:13.238426065+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44251 {created_time:"2022-11-18T16:06:03.093213032+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36033 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T16:06:45.765617825+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35451 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T16:08:26.36927365+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39359 {created_time:"2022-11-18T16:09:12.553710875+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34941 {created_time:"2022-11-18T16:12:15.832689839+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1118155401-e3ece509_47209749-3dab-44b1-ae1b-62c968f587c6 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 14 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1118155859-a97d9ee0_7458a176-e829-4604-914f-219a4fbfc989 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1118160712-80fd5534_2e289ae7-f5e7-4c15-8b7f-12e4d1a75955 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 1, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1118160849-c02d62ac_f187d7d5-8fdb-40fc-b4fb-2ae2eb15890e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6717 deselected, 683 warnings in 1578.22s (0:26:18) =
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36187 {created_time:"2022-11-18T16:12:44.342480014+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 946, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33991 {created_time:"2022-11-18T16:12:44.344570942+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>
    self.run()
  File "/usr/lib/python3.10/threading.py", line 946, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36187 {created_time:"2022-11-18T16:12:44.342480014+00:00", grpc_status:14, grpc_message:"Socket closed"}"
>

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 33m 46s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rhmnnzkdbirls

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1132

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1132/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Fix checkArgument format string in ByteKeyRange

[chamikaramj] Fix release date

[chamikaramj] Few more fixes to the Website


------------------------------------------
[...truncated 58.33 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
    p.options.view_as(GoogleCloudOptions).temp_location or

grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37581 {created_time:"2022-11-18T09:50:11.021109927+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>

FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1118094431-a470b5c6_2247212c-d365-4f8b-8574-e49c9e15bf14 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
Exception in thread run_worker_2-1:
Traceback (most recent call last):
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1118095017-a27c3702_ca588307-0332-4a0f-a4f4-1df1723ad30c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1118095050-51dfa74_fbef961a-cbe6-4ef4-b643-2e932ca8e26d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 41 warnings in 615.59s (0:10:15) =
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39881 {grpc_message:"Runner closed connection", grpc_status:1, created_time:"2022-11-18T09:50:42.595975957+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 809, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46637 {created_time:"2022-11-18T09:50:42.866933821+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36279 {created_time:"2022-11-18T09:52:15.119072272+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 8s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/d2jmqsim6m4r4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1131

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1131/display/redirect?page=changes>

Changes:

[noreply] Issue#24161 Updated docstring for Clusters class

[Kenneth Knowles] Fix checkArgument format string in BigQueryQueryHelper

[Kenneth Knowles] Fix checkArgument calls in BQ dynamic destinations

[noreply] Removed trailing whitespaces.

[noreply] Clarify that SDF authors need to make the restriction sizing method

[noreply] Remove google-cloud-platform-core dependency from harness (#24235)

[noreply] Document our benchmarks (#24216)

[noreply] Website updates for Beam 2.43.0 release (#24044)

[Kenneth Knowles] Add @RunWith annotation to BQ test class


------------------------------------------
[...truncated 57.81 MB...]
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44097 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T03:54:36.412261036+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44819 {created_time:"2022-11-18T03:55:25.253227745+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45323 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T03:56:05.815794966+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36247 {created_time:"2022-11-18T03:56:23.032676981+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37691 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T03:56:39.300181923+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45549 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T03:57:09.818003133+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43283 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T03:58:11.175740417+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42345 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-18T03:58:31.752606063+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1118034241-e63f2734_f9241a96-1970-4857-ba1e-f8797c1b6ea5 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1118035647-6ef9ab9c_dc9a5ea5-5b9a-4c3b-a733-5b077df3a5a3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1118035714-a9aae4eb_25bf3824-6f78-40a5-a441-9f9aa1c3e04c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6717 deselected, 693 warnings in 1105.36s (0:18:25) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 20m 30s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dvxgu5tg2ycmm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1130

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1130/display/redirect?page=changes>

Changes:

[Moritz Mack] [Metrics] Add new performance dashboard for Java JMH benchmarks (closes

[Yi Hu] Unify test parameters for certain IOs based on test row and grafana

[noreply] [Playground] Examples CI restore (#24155)

[noreply] Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks (#24220)

[noreply] Force discarding mode in with_fanout without rewindowing. (#23828)


------------------------------------------
[...truncated 59.59 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1117214243-43bf05b6_b3b922f7-c5b6-4c88-bbe5-724b3551a48d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 628, in process_bundle
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1117215219-ed911d65_6040acad-a413-4341-b23e-2db9caaa8d5d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
    instruction_id, request.process_bundle_descriptor_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 460, in get
    self.fns[bundle_descriptor_id],
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1360, in __missing__
    self[key] = self.default_factory(key)  # type: ignore # pylint: disable=E1137
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 204, in default_factory
    process_bundle_descriptor_id=id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_interceptor.py",> line 221, in __call__
    compression=compression)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_interceptor.py",> line 257, in _with_call
    return call.result(), call
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 343, in result
    raise self
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_interceptor.py",> line 247, in continuation
    compression=new_compression)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 957, in with_call
    return _end_unary_response_blocking(state, call, True, None)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:43207: Failed to connect to remote host: Connection refused"
	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:43207: Failed to connect to remote host: Connection refused {grpc_status:14, created_time:"2022-11-17T21:56:25.770841394+00:00"}"
>

FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1117215559-3cac5b1f_f9551e22-ea62-4579-a23e-a825545d12fa failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 809, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33865 {created_time:"2022-11-17T21:56:25.899865735+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1117215633-c9d5e897_f7d64a5a-f59f-4ed7-8bb6-de634d6d8499 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6717 deselected, 41 warnings in 1073.98s (0:17:53) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 19m 55s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/oerqrcpdinjlu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1129

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1129/display/redirect?page=changes>

Changes:

[noreply] Bump github.com/aws/aws-sdk-go-v2/config from 1.18.0 to 1.18.1 in /sdks

[noreply] Add enableGzipHttpCompression option to SplunkIO (#24197)


------------------------------------------
[...truncated 59.52 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.

Exception in thread run_worker_3-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
    sink=lambda _: _WriteToPandasFileSink(

	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40911 {created_time:"2022-11-17T15:48:44.353665451+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41765 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-17T15:49:40.192093487+00:00"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1117154237-b3b7cf81_19324551-c8ed-46d5-87b1-73696465002f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it - RuntimeError: Pipeline BeamApp-jenkins-1117154437-540aa7d_9bef3123-25fc-468d-b0c4-8a8a30498037 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1117154819-f7bc1f6b_e9e01f48-5531-44fd-a07f-eb866127d084 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1117154851-787bd31c_d6f58bf5-e00a-4b27-9d1e-5b1b0c5382a5 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6715 deselected, 41 warnings in 627.19s (0:10:27) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 23s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ub6bbjs4vqwxa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1128

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1128/display/redirect?page=changes>

Changes:

[egalpin] Uses _all to follow alias/datastreams when estimating index size

[Chamikara Madhusanka Jayalath] Temporary update Python RC validation job

[egalpin] Adds test for following aliases when estimating index size

[Chamikara Madhusanka Jayalath] updates

[Chamikara Madhusanka Jayalath] updates


------------------------------------------
[...truncated 58.41 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 17, 2022 9:49:29 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1117094923-39f3031f_7c6d3809-7492-490c-b8f7-2bd1299d555d.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.BufferWritingResultPartition.setup(BufferWritingResultPartition.java:97)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1117094242-c3f0fab5_5a1afc62-5206-4346-b657-2ab26953d218 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1117094851-80f47423_abce6f66-1288-419c-872b-a1fa909e1a32 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1117094923-39f3031f_7c6d3809-7492-490c-b8f7-2bd1299d555d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6715 deselected, 41 warnings in 644.99s (0:10:44) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 44s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4li5a7n32b77a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1127

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1127/display/redirect?page=changes>

Changes:

[noreply] Fix PythonLint (#24219)

[noreply] Bump loader-utils from 1.4.1 to 1.4.2 in


------------------------------------------
[...truncated 58.80 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

Exception in thread run_worker_3-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44689 {created_time:"2022-11-17T03:49:15.560642167+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39259 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-17T03:50:42.887373555+00:00"}"
>


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1117034233-fcd92c05_79cc0392-74f5-4ef9-b2f3-e68c360a5a16 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1117034851-644de723_3adec3b8-d30e-4a63-a892-133ee92240bf failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1117034924-b9b74eb4_950c0f91-c4ea-4036-b434-ffd5fb13b25c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6715 deselected, 41 warnings in 648.59s (0:10:48) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 44s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/oambkzco3guwu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1126

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1126/display/redirect?page=changes>

Changes:

[chamikaramj] Add a reference to Java RunInference example

[lakshmanansathya] refs: issue-24196, fix broken hyperlink

[noreply] Use only ValueProviders in SpannerConfig (#24156)

[noreply] [Tour of Beam] [Frontend] Content tree URLs (#23776)

[noreply] Python TextIO Performance Test (#23951)


------------------------------------------
[...truncated 58.92 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:334)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:193)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:182)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:213)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:374)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:533)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 10:02:17 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1116220210-a3a8fb2f_a07ca1ce-4050-498e-8026-b000d5b58248.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported

    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1116214518-b5aa1f3f_15d5be99-7a42-428e-9878-03b065d77926 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/juliaset/juliaset/juliaset_test.py::JuliaSetTest::test_output_file_format - Failed: Timeout >600.0s [while running 'WriteToText/Write/WriteImpl/PreFinalize']
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1116220136-fb0d13c9_ae16c37d-ac3c-4680-a0ac-1366d5e3a704 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1116220210-a3a8fb2f_a07ca1ce-4050-498e-8026-b000d5b58248 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 4 failed, 18 passed, 6 skipped, 6715 deselected, 41 warnings in 1268.18s (0:21:08) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 24m 50s
133 actionable tasks: 88 executed, 43 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/f6ydmyawhofs2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1125

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1125/display/redirect?page=changes>

Changes:

[Jozef Vilcek] Re-use serializable pipeline options when already available (#24192)

[noreply] Fix Python PostCommit Example CustomPTransformIT on portable (#24159)

[noreply] revert upgrade to go 1.19 for action unit tests (#24189)


------------------------------------------
[...truncated 57.48 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-15
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-36
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-27
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-31
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-40
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-21
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-34
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Beam Fn Data client connected.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-23
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer$InboundObserver onCompleted
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Hanged up for unknown endpoint.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Error cleaning up servers urn: "beam:env:external:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 payload: "\n\021\n\017localhost:43721"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bytes:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:string_utf8:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:kv:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:bool:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:varint:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:double:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:timer:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:interval_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:length_prefix:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:global_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:param_windowed_value:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:state_backed_iterable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:custom_window:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:row:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:sharded_key:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:coder:nullable:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:progress_reporting:v0"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:protocol:worker_status:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:combinefn:packed_python:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.44.0.dev"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 capabilities: "beam:transform:to_string:v1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.InterruptedException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Object.wait(Native Method)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Object.wait(Object.java:460)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.TimeUnit.timedWait(TimeUnit.java:348)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl.awaitTermination(ServerImpl.java:310)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.sdk.fn.server.GrpcFnServer.close(GrpcFnServer.java:157)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:642)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:642)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:658)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$400(DefaultJobBundleFactory.java:589)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:334)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:193)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:182)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:136)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:213)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:269)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:374)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:41)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:533)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:357)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:927)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:51:13 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1116155105-db33fe70_53e96bbb-76fc-4975-9f40-a66f2b835afe.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.minicluster.MiniClusterJobClient.lambda$getJobExecutionResult$3(MiniClusterJobClient.java:141)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:616)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:591)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaInvocationHandler.lambda$invokeRpc$1(AkkaInvocationHandler.java:259)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.util.concurrent.FutureUtils.doForward(FutureUtils.java:1389)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$null$1(ClassLoadingUtils.java:93)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68)
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$guardCompletionWithContextClassLoader$2(ClassLoadingUtils.java:92)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
--------------------------- Captured stdout teardown ---------------------------
FAILED                                                                   [ 91%]
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1116154428-70a6ef2a_128bf9c9-0416-44f6-bd7f-ed123548c893 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts - RuntimeError: Pipeline BeamApp-jenkins-1116155034-b7d8d646_f384d22a-c4fb-467c-97dd-a49c48a11419 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 17, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1116155105-db33fe70_53e96bbb-76fc-4975-9f40-a66f2b835afe failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6715 deselected, 41 warnings in 630.39s (0:10:30) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 245

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 30s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jcx6ay7zja4s4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1124

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1124/display/redirect>

Changes:


------------------------------------------
[...truncated 181.13 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-ed85f4f7-a1df-49cf-9b0d-d69c11704df5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Disconnect job manager b143f24dda37170fe462e112d32847b2@akka://flink/user/rpc/jobmanager_3 for job ca248c85f022263e5877d1e43b0a1a8f from the resource manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-8aada286-f661-464e-9b1a-63652bea6de7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-148ad057-7c4f-4270-b4a1-c9cd826295da
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:33451
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 9:49:39 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46267 {created_time:"2022-11-16T09:51:02.014567324+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1116094251-8f2f55f2_1a96f977-c109-4c5a-bd2f-873673341574 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1116094932-a1e62b2_42aab07b-1b79-4312-b0b2-7f6bba0ea561 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6715 deselected, 41 warnings in 663.32s (0:11:03) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4e7itvxq7ywoa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1123

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1123/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Fix arguments to checkState in BatchViewOverrides

[noreply] Updated README of Interactive Beam

[noreply] Minor update

[noreply] Add custom inference function support to the PyTorch model handler

[noreply] Strip FGAC database role from changestreams metadata requests (#24177)


------------------------------------------
[...truncated 181.51 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:50:43 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:50:43 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:50:43 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:50:43 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:50:43 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 16, 2022 3:50:43 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35093 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-16T03:52:03.412194272+00:00"}"
>

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1116034415-80a69742_1f4c8f55-6c36-4993-b690-1f46b1cc4960 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1116035034-74652dae_71115bd2-ea7d-4a35-a7eb-daaa6782b18b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6715 deselected, 41 warnings in 620.81s (0:10:20) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7nnxbgxgnbbjg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1122

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1122/display/redirect?page=changes>

Changes:

[noreply] Configure flutter_code_editor options with Hugo shortcode (#23926)

[noreply] Eliminate CalciteUtil.CharType logical type (#24013)

[noreply] [Playground] Move Playground in GKE and Infrastructure change (#23928)

[noreply] Fix broken notebook (#24179)

[noreply] Add error reporting for BatchConverter match failure (#24022)

[noreply] Update automation to use Go 1.19 (#24175)

[noreply] Fix broken json for notebook (#24183)

[noreply] Using Teardown context instead of deprecated finalize (#24180)

[noreply] [Python]Support pipe operator as Union (PEP -604) (#24106)


------------------------------------------
[...truncated 182.68 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33403 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-15T21:51:15.142131912+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36673 {created_time:"2022-11-15T21:51:35.235686257+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40791 {created_time:"2022-11-15T21:51:55.149996402+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44443 {created_time:"2022-11-15T21:52:37.99999324+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35461 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-15T21:52:56.277168422+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40149 {created_time:"2022-11-15T21:53:53.636183401+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35263 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-15T21:54:18.045177069+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1115214631-2836704c_33e22d8b-c68c-4584-8499-18c730b4201e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1115215247-16457c40_c165dec8-2403-4a44-b669-ecb3303ccdb9 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6715 deselected, 693 warnings in 636.70s (0:10:36) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

> Task :sdks:python:test-suites:portable:py37:flinkExamples
Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35567 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-15T21:54:33.8535053+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 25s
133 actionable tasks: 93 executed, 38 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4v2yci5zudveq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1121

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1121/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] update pre tag copy link styles #23064

[noreply] [Dockerized Jenkins] Update README how to use local repo (#24055)

[noreply] [Dockerized Jenkins] Fix build of dockerized jenkins (fixes #24053)

[noreply] Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#24131)

[noreply] Editorial review of the ML notebooks. (#24125)


------------------------------------------
[...truncated 182.52 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-67e6c62b-7a33-49b6-8cd1-990f1e7f83b7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-1987b310-4c5c-4133-b30e-7e61e2db3d32
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-b60e50cf-8c2e-42f5-8873-133e2c78aa17
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 19. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 31. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down BLOB cache
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down BLOB cache
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:48:58 PM org.apache.flink.runtime.blob.BlobServer close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:35033
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project


apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38263 {created_time:"2022-11-15T15:50:16.594417557+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1115154243-7c6bb4f0_523a0cce-ea52-4c27-b4e5-ca0f5d0bfd8c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1115154850-28d870e9_e93a8147-b389-4bff-998b-b20406604787 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 610.56s (0:10:10) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 10s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wycwck5xa77vc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1120

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1120/display/redirect>

Changes:


------------------------------------------
[...truncated 181.42 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 9:49:24 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 9:49:24 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-fd84e917-eb1b-4cb3-8300-121f140f1b47
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 9:49:24 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 9:49:24 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 9:49:24 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 9:49:24 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-6546cc34-b610-406e-89d0-c9940d7a6f39
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 9:49:24 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 9:49:24 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 19. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 22. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1115094244-a93c8e2f_bed82e29-70c6-4290-afc0-25428ffe5e3e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1115094913-43c98b4b_d59c3eee-d5dd-4100-b2dc-610e74882cbb failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 652.56s (0:10:52) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 49s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vqh3momznl2gy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1119

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1119/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Rename the test_splits flag to direct_test_splits.

[noreply] More dataset templates to clean up (#24162)

[noreply] Implement embedded WebAssembly example (#24081)


------------------------------------------
[...truncated 181.45 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:02 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:02 AM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:02 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:02 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:02 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:02 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:02 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:02 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:03 AM org.apache.flink.runtime.blob.BlobServer close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:41757
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 15, 2022 3:52:03 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(


Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1115034334-4c892f48_e8e172b0-77c4-499d-8bb1-f3f6fec31294 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1115035153-8acb9d04_e10d2f56-bd83-456f-9d2f-d5310b9727ed failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 784.43s (0:13:04) =
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34183 {created_time:"2022-11-15T03:51:44.547007297+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35159 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-15T03:52:46.368814824+00:00"}"
>


> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 18s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/onqcqegstckaa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1118

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1118/display/redirect?page=changes>

Changes:

[noreply] Bump loader-utils

[chamikaramj] Updates Multi-lang Java quickstart

[Kenneth Knowles] Fix checkArgument format string in AvroIO

[Kenneth Knowles] Fix checkArgument format in GcsPath

[Kenneth Knowles] Remove extraneous jetbrains annotation

[noreply] Test Dataproc 2.1 with Flink load tests (#24129)

[noreply] Change DataflowBatchWorkerHarness doWork error level to INFO (#24135)

[noreply] Bump github.com/aws/aws-sdk-go-v2/config from 1.17.10 to 1.18.0 in /sdks

[noreply] [Tour Of Beam] verify that unit exists when saving progress (#24118)

[noreply] Cleanup stale BQ datasets (#24158)

[noreply] Support SqlTypes Date and Timestamp (MicrosInstant) in AvroUtils

[noreply] Add more tests for S3 filesystem (#24138)

[noreply] Merge pull request #23333: Track time on Cloud Dataflow streaming data

[noreply] Adding a quickstart to README for the TS SDK (#23509)


------------------------------------------
[...truncated 181.35 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Removing cache directory /tmp/flink-web-ui
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down complete.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-91dee3e0-f979-46c6-835b-16342e4ba78f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-ccf6fe0c-2d72-4a87-9341-ae87abc8bcb4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:48:09 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1114214208-3b2faa8f_dada90b4-56bf-4ebe-832f-8c4f80839a7e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 14 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1114214758-3ab2c3c7_24feb0f9-ce41-4aa1-a195-d7ad5dcb3329 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 592.61s (0:09:52) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 33s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cnjd5frsfc5cm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1117

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1117/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] change headers size from h4,h3 to h2 #24082

[bulat.safiullin] [Website] update go-dependencies.md java-dependencies.md

[noreply] Bump golang.org/x/net from 0.1.0 to 0.2.0 in /sdks (#24153)

[noreply] Make MonotonicWatermarkEstimator work like its Java SDK equivalent


------------------------------------------
[...truncated 181.77 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-87aacb4a-4d86-4b88-81f6-1ff3bb0618e6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-c0d0c116-6767-4997-9088-0eb484088502
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down BLOB cache
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down BLOB cache
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 3:50:20 PM org.apache.flink.runtime.blob.BlobServer close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:35753
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44301 {created_time:"2022-11-14T15:49:59.818001408+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43471 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-14T15:50:01.089286355+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__


    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45177 {created_time:"2022-11-14T15:50:01.336444058+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38505 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-14T15:51:47.423138865+00:00"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1114154318-a7635b59_c7b01f13-89f0-4238-9e89-43dee3fbb5a2 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1114155011-6cd5bc45_a5d71d9a-878c-42c0-aa49-fbd1e542d5e5 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 690.69s (0:11:30) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 37s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qmeqmdqsfxec4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1116

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1116/display/redirect>

Changes:


------------------------------------------
[...truncated 182.21 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-b4a5ad2d-6509-417b-b491-872b3027caea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-c5ec830e-eed7-49b0-94a5-30877c406683
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-065e2305-4a5c-45c6-922f-ba65e1c6d3bf
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down BLOB cache
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.blob.BlobServer close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:36805
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 14, 2022 9:50:22 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45271 {created_time:"2022-11-14T09:49:58.082957924+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32791 {created_time:"2022-11-14T09:51:09.846171222+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1114094301-2a9c253a_64c5f0f2-267e-429d-97ec-6ab555f4161a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1114095015-830a339d_0044d6e3-4eda-4c40-b3de-b78ac14d6fe7 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 700.58s (0:11:40) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 41s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ffm34rfgdezxi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1115

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1115/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Fix checkArgument format string in ExecutionStateTracker


------------------------------------------
[...truncated 183.18 MB...]
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46551 {created_time:"2022-11-14T03:48:28.367073667+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43829 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-14T03:48:48.395623229+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46133 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-14T03:49:30.634139042+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37655 {created_time:"2022-11-14T03:49:50.114217991+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35859 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-14T03:50:09.261995039+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36847 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-14T03:50:50.786964869+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45551 {created_time:"2022-11-14T03:52:04.311969477+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32837 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-14T03:52:30.026344665+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1114034447-193fe8f4_6e6b1bed-291c-4895-9f0e-793c715cebfe failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1114035059-ba3331de_c0b250e1-a92f-4a92-bf03-00c2463390e3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 695 warnings in 624.08s (0:10:24) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 36s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/k7aqdgj2lwk6g

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1114

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1114/display/redirect>

Changes:


------------------------------------------
[...truncated 181.74 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down TaskExecutorLocalStateStoresManager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-e7ada683-d6d3-42f6-a5ca-a32edffa841a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-b0962bce-4813-462b-8bcd-eb27f1d2f479
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-b755b788-2aa2-4bea-9468-923efcaddf48
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 9:49:07 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1113214240-a04bd162_ddeb8165-91eb-4240-9cf4-cf59463421ed failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1113214859-33face8d_85a483a9-d1da-441e-936c-7ccd432c71a2 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 629.92s (0:10:29) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 23s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pxnd6bvuftxfy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1113

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1113/display/redirect>

Changes:


------------------------------------------
[...truncated 181.38 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down complete.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Disconnect job manager bbfe0827f28bf21152bfebcd3bbe4418@akka://flink/user/rpc/jobmanager_3 for job 4c7bc62aaf8a6e47c8b96293f1b4ed4b from the resource manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-18c36ace-0d06-4860-9e69-a06310e71345
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-64d2f074-b6fc-487c-91b1-c63db5a104a0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-386da284-a467-4cb1-8d8a-ef3cb6ef4330
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:48:58 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 32. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42303 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-13T15:50:19.099275211+00:00"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1113154229-2453f206_9e8c18c8-d838-44e4-b598-7062b8df24d6 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38553 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-13T15:50:21.318256567+00:00"}"
>

FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1113154849-534f4b1a_ed1a3b72-7da0-42f1-8f84-2c8e488a05d2 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 625.37s (0:10:25) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 18s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bx7rdeadwa7w4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1112

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1112/display/redirect>

Changes:


------------------------------------------
[...truncated 181.41 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 9. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37943 {created_time:"2022-11-13T09:49:10.548580556+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1113094244-b7c990f0_55947ac3-2300-4463-a832-bdec75425b73 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1113094901-e6893d12_ffa4d05c-768a-4980-a0a1-34c28835978a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 633.12s (0:10:33) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 26s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4lwmgzjmrzmhm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1111

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1111/display/redirect>

Changes:


------------------------------------------
[...truncated 182.36 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl jobManagerLostLeadership
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobManager for job 761c0f34379910fc369af50dc531158f with leader id a4dbddc6e6665c041a3581b21fa34da5 lost leadership.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down TaskExecutorLocalStateStoresManager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-97f44d9d-ab87-4095-99d4-d8cada556cd4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-65ec725b-57ba-4ca9-a36c-ac2aed2ba156
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-12854fea-eb6c-4c3f-8746-9bf3d6f7e757
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 13, 2022 3:49:02 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1113034243-8dce00c2_0128e6a7-c87d-4bdd-8b90-26be9e18ecc4 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1113034853-b2f87f69_661e5933-c5f7-47d5-85e4-44eb7ffb0551 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 616.62s (0:10:16) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 14s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ws2hychl2hbsk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1110

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1110/display/redirect>

Changes:


------------------------------------------
[...truncated 181.86 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$1.onComplete(AkkaFutureUtils.java:47)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:300)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.OnComplete.internal(Future.scala:297)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:224)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.japi$CallbackBridge.apply(Future.scala:221)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.AkkaFutureUtils$DirectExecutionContext.execute(AkkaFutureUtils.java:65)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Close ResourceManager connection 3501d76f7606a150594256b75f38a6c8: Stopping JobMaster for job 'BeamApp-jenkins-1112214914-5866d5e3' (8afe38cee5d63eeba6f96aa5ba3f38b7).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-579bdbc6-d62f-4341-b17f-3493d0354f82
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-b770335d-44dd-4720-b75e-1fd3556bd58b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Disconnect job manager abd91148af6f33d13e7bc607cb1e4f79@akka://flink/user/rpc/jobmanager_3 for job 8afe38cee5d63eeba6f96aa5ba3f38b7 from the resource manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:49:21 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1112214258-1b4ce3b9_92cc0467-dfd0-4bb2-8029-0a54f8804032 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1112214914-5866d5e3_5bb211f9-cd27-46c7-9649-02ef6bc1c6ff failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 630.32s (0:10:30) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 28s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ykoocdtijqgf4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1109

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1109/display/redirect>

Changes:


------------------------------------------
[...truncated 181.51 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-440e8b0b-aad4-47fb-9573-7cb87a1c2f36
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-5e135862-fa62-4331-8460-e249f432b150
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-232b3cef-bd7c-4ccc-936c-3f0a704281ef
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 3:49:58 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1112154254-30368c1e_64370c2f-37e8-4b86-8dbd-0fd72123e83b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34633 {created_time:"2022-11-12T15:50:59.053843474+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1112154951-1dc1753b_be258e82-cb56-4427-9e57-ef83a5a01773 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 679.19s (0:11:19) =
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33981 {created_time:"2022-11-12T15:51:28.27526691+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 21s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gxbh6lzb3ibse

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1108

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1108/display/redirect?page=changes>

Changes:

[noreply] Fix checkArgument format string in TestStream (#24134)


------------------------------------------
[...truncated 181.37 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 12, 2022 9:51:56 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or


Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1112094527-55a1603d_d862197b-ff5d-4bfc-9fe6-942794b62539 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1112095148-80daa2c6_bcd2ed15-217f-4fa9-9bc2-1b0243850823 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 41 warnings in 652.81s (0:10:52) =
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45549 {created_time:"2022-11-12T09:51:39.52196494+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44399 {created_time:"2022-11-12T09:53:22.813596274+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 20s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lqlagniyujlx4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1107

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1107/display/redirect?page=changes>

Changes:

[noreply] Add a ValidatesContainer integration test for use_sibling_sdk_workers


------------------------------------------
[...truncated 181.74 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37387 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-12T03:47:41.275941425+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40721 {created_time:"2022-11-12T03:48:22.777512634+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43415 {created_time:"2022-11-12T03:48:41.394081471+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35927 {created_time:"2022-11-12T03:49:00.497256135+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39393 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-12T03:49:40.220434759+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45383 {created_time:"2022-11-12T03:49:52.896269992+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43079 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-12T03:50:50.92133738+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42009 {created_time:"2022-11-12T03:51:14.309369614+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1112034348-c4072844_bad7f9df-5ee9-44a1-87fb-0206ce325e4b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1112034946-7af6a2ea_eed43b06-e442-4db7-860f-10f2ff2bfaaf failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6706 deselected, 692 warnings in 608.74s (0:10:08) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 10s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mosi7uyxstsre

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1106

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1106/display/redirect?page=changes>

Changes:

[noreply] disable (#24121)

[noreply] Implement PubsubRowToMessage transform (#23897)

[noreply] upgrade testcontainer dependency (#24123)

[noreply] More cleanup containers (#24105)

[noreply] Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks (#24112)

[noreply] Bump google.golang.org/api from 0.102.0 to 0.103.0 in /sdks (#24049)

[noreply] Update staging of Python wheels (#24114)


------------------------------------------
[...truncated 181.95 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38723 {created_time:"2022-11-11T21:50:01.174869337+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35161 {created_time:"2022-11-11T21:50:46.663810705+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39305 {created_time:"2022-11-11T21:51:08.554450146+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33917 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T21:51:27.671777124+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32887 {created_time:"2022-11-11T21:52:08.616521304+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36171 {created_time:"2022-11-11T21:52:24.564517448+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38885 {created_time:"2022-11-11T21:53:20.649084768+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41207 {created_time:"2022-11-11T21:53:49.155287346+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1111214603-adbddd35_ecd489f1-b685-4a02-a73b-bc2d1d3e1888 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1111215216-44eabfd7_3ae9257f-f406-4db9-87a7-67ce6398f5ce failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6705 deselected, 683 warnings in 615.97s (0:10:15) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 53s
133 actionable tasks: 90 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6gcxamxqjikec

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1105

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1105/display/redirect?page=changes>

Changes:

[noreply] Add TFX support in pydoc (#23960)

[noreply] Bump cloud.google.com/go/bigtable from 1.17.0 to 1.18.0 in /sdks


------------------------------------------
[...truncated 182.03 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44963 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T15:47:22.400674555+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39623 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T15:47:40.910464635+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35383 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T15:48:21.982857721+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40363 {created_time:"2022-11-11T15:48:39.709250251+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43575 {created_time:"2022-11-11T15:48:57.158500996+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42795 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T15:49:37.10685416+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37673 {created_time:"2022-11-11T15:50:43.233909951+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41427 {created_time:"2022-11-11T15:51:06.794449991+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1111154347-89701848_eff0ac6f-957f-4b46-a753-b997986a188a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1111154943-5e03ec01_4406c886-26f5-4299-93eb-102befd690f8 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6705 deselected, 693 warnings in 597.75s (0:09:57) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 4s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/spgnfpq6v2wkq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1104

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1104/display/redirect>

Changes:


------------------------------------------
[...truncated 181.74 MB...]
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45137 {created_time:"2022-11-11T09:47:57.950010836+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43505 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T09:48:43.011017624+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45753 {created_time:"2022-11-11T09:49:04.732644167+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46011 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T09:49:24.73333469+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35247 {created_time:"2022-11-11T09:50:11.206495496+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34653 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T09:51:26.971652321+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33777 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-11T09:51:48.55431416+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1111094400-3d73ad33_4e13e02e-ed4e-4971-b0a6-48800871b73a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1111095019-50b8dfd8_ad63b84e-f56b-47cf-ba9f-40301da97861 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6705 deselected, 693 warnings in 645.61s (0:10:45) =
Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.10/threading.py", line 946, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46481 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-11T09:51:54.336180911+00:00"}"
>

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 48s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ovgvge5q57tqi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1103

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1103/display/redirect?page=changes>

Changes:

[noreply] Add blog post on new ML resources (#24071)

[noreply] fixing linter error (#24104)

[noreply] Support using BigQueryIO Storage Read API with SchemaTransforms (#23827)

[noreply] Wire SamzaPipelineOptions to Exeption listener interface (#24109)

[noreply] Remove TheNeuralBit from the pool of Python reviewers (#24108)


------------------------------------------
[...truncated 181.23 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor29.invoke(Unknown Source)
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Removing cache directory /tmp/flink-web-ui
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down complete.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Disconnect job manager 9ad672d70a2e2bf794b7e39696124576@akka://flink/user/rpc/jobmanager_3 for job 5ff72d4891bf7fa13cb8ef285effe72d from the resource manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-7d5c721e-4cdc-44be-9710-7c1774efc6fd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-727a44b7-f7c1-4a94-ab04-6fd654c2ab17
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-7ef576d4-a7c7-4541-b510-fd5a5ea536bd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 11, 2022 3:57:02 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1111034256-a7cb6bc7_1deb2a8f-c4d5-46d5-9089-a60577876d65 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1111035653-742e9157_3825170d-345f-4bee-8582-66f18231ed77 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6705 deselected, 41 warnings in 1079.10s (0:17:59) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 20m 23s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ekrl4wix2zpxk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1102

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1102/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Compute element counts for all PCollections.

[Robert Bradshaw] Add the ability to schedule splits on the ULR via a pipeline option.

[Robert Bradshaw] Add the a Reshuffle operation and use it in Create.

[Robert Bradshaw] Add dynamic splitting support to the worker.

[noreply] Update style

[Robert Bradshaw] Clarifying comments.

[Robert Bradshaw] Make mypy happy.

[Robert Bradshaw] Reduce flakiness of time-based split manager test.

[noreply] Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks (#24077)

[noreply] [BEAM-12792] Install pipline dependencies to temporary venv (#16658)

[noreply] [Python]Set pickle library at the Pipeline creation stage (#24069)

[noreply] Improving stale container cleanup script (#24040)

[noreply] Add random string at the end of BigQuery query job name to make it

[noreply] [Playground] update snippet by persistence_key (#24056)

[noreply] [Tour Of Beam] handle CORS pre-flight requests (#24083)

[noreply] Num failed inferences (#23830)

[noreply] Bump github.com/aws/aws-sdk-go-v2/config from 1.5.0 to 1.17.10 in /sdks


------------------------------------------
[...truncated 181.80 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-237fbda7-4939-4d4e-aa2b-c09e2c859d50
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-fbe19e7e-ac29-4efc-b557-2cbcf2f98620
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down BLOB cache
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down BLOB cache
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 9:52:07 PM org.apache.flink.runtime.blob.BlobServer close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:42565
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1110214517-34ba8408_ffbce9eb-71d0-43a1-b874-8b49fa475bbb failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1110215200-e315bef3_c373cd27-c8eb-4ba5-be17-0ece2ca2bde0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6705 deselected, 41 warnings in 668.14s (0:11:08) =
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46849 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-10T21:53:25.774780486+00:00"}"
>

Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39103 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-10T21:53:29.404990375+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 21s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/g75h6cm2kzfka

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1101

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1101/display/redirect?page=changes>

Changes:

[noreply] Fix FhirIO javadoc format broken (#24072)


------------------------------------------
[...truncated 182.14 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-bb0b0ae4-2a79-40ec-b1c3-653780265c32
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
--------------------------- Captured stdout teardown ---------------------------
FAILED                                                                   [ 91%]
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:54:13 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down BLOB cache
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project


apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35721 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-10T15:53:51.596824005+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37713 {created_time:"2022-11-10T15:53:56.471566177+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44767 {created_time:"2022-11-10T15:53:57.531021747+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44145 {created_time:"2022-11-10T15:55:30.826318812+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1110154800-b3cc57e_c9727bcb-23cb-4110-bf09-4509ebd608ea failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1110155407-fd5dc170_78029e40-d1d3-472b-a9d1-169434a78e48 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 625.22s (0:10:25) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 17m 25s
133 actionable tasks: 90 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jftt7lkznghm4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1100

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1100/display/redirect>

Changes:


------------------------------------------
[...truncated 181.89 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40995 {created_time:"2022-11-10T09:47:32.337410065+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37939 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-10T09:48:01.626085314+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42903 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-10T09:48:33.482816424+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33143 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-10T09:48:52.925224584+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40587 {created_time:"2022-11-10T09:49:31.326641903+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41989 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-10T09:49:47.711924031+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36671 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-10T09:50:30.218936192+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41909 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-10T09:51:09.598049942+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1110094353-4f278a97_768fad34-5c35-49e1-8300-d08094afbc6f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1110094940-4e0e2b53_8dac19b7-bc29-4a27-a87b-1b595111950e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 695 warnings in 598.03s (0:09:58) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 4s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wzqrowvcfyjxq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1099

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1099/display/redirect?page=changes>

Changes:

[noreply] test: add more tests to throughput estimator (#23915)

[noreply] Remove a duplicate label (#24043)

[noreply] Update datastore_wordcount.py (#23724)


------------------------------------------
[...truncated 181.98 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:68)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.$anonfun$tryComplete$1$adapted(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:284)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:621)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.pattern.PipeToSupport$PipeableFuture$$anonfun$pipeTo$1.applyOrElse(PipeToSupport.scala:23)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.Future.$anonfun$andThen$1(Future.scala:532)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.liftedTree1$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.Promise.$anonfun$transform$1(Promise.scala:29)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:60)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:63)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.$anonfun$run$1(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.concurrent.BlockContext$.withBlockContext(BlockContext.scala:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.BatchingExecutor$BlockableBatch.run(BatchingExecutor.scala:100)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: org.apache.flink.runtime.JobException: Recovery is suppressed by NoRestartBackoffTimeStrategy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:301)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:291)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:282)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:739)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:443)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.GeneratedMethodAccessor30.invoke(Unknown Source)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.reflect.Method.invoke(Method.java:498)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:304)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:302)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-17685088-0716-424a-b128-6d7f5a529d38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-bc53ccc7-2025-4ff6-b50f-b9b7b6d5358e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 10, 2022 3:53:09 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1110034309-f1ad8e4a_686aa620-87e8-46ec-b118-9337cf51aa5c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1110035302-67f2c86c_b7f2e4a7-0ce2-452d-b063-f5b58de02bda failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 842.25s (0:14:02) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 28s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/k27hsdsz7sta2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1098

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1098/display/redirect?page=changes>

Changes:

[noreply] added comments for tensorflow notebook (#23726)

[noreply] Convert initialisms to all caps (#24061)

[noreply] skip output coder field in exp request (#24066)


------------------------------------------
[...truncated 181.43 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:37951
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 9:50:45 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44539 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-09T21:50:20.845846865+00:00"}"
>


apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run


    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43747 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-09T21:50:22.72225254+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36213 {created_time:"2022-11-09T21:50:29.848004625+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42393 {created_time:"2022-11-09T21:51:29.006308096+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1109214416-6666de69_ff7d217c-d980-4afd-930e-739c9eba740b failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35647 {created_time:"2022-11-09T21:51:41.501059157+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1109215038-3fdba0ec_ad6fe8fc-a777-47e0-89c9-162e715bbbe4 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 656.95s (0:10:56) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 2s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mafruntwwqw7m

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1097

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1097/display/redirect?page=changes>

Changes:

[Moritz Mack] [Spark Dataset runner] Enable projection pushdown for Spark dataset

[noreply] Fix dependency mismatch in Playground Java runner  (#24059)


------------------------------------------
[...truncated 182.48 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive(Actor.scala:537)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.Actor.aroundReceive$(Actor.scala:535)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-d34be362-3c7e-42b2-b559-7803d85da474
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down complete.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-d14f373a-f966-4fbe-bc4a-46fbb408dd29
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-a6f4c560-e6ed-482e-96e7-ff54a37cc2be
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:49:48 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)


Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33413 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-09T15:50:35.175357699+00:00"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1109154308-6a5aa068_85f881cf-3910-4625-b255-f52a6bbd9e4e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1109154939-f7695014_e80d7f21-865a-4bee-a5f3-3875710fbdf4 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 648.40s (0:10:48) =
Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43419 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-09T15:51:21.064574181+00:00"}"
>


> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 27s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/pvdt5cndjkbcm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1096

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1096/display/redirect?page=changes>

Changes:

[noreply] [Go SDK] S3 implementation of the Beam filesystem (#23992)


------------------------------------------
[...truncated 181.86 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42597 {created_time:"2022-11-09T09:47:04.03297588+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39943 {created_time:"2022-11-09T09:47:23.746653456+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43377 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-09T09:48:06.230540994+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42913 {created_time:"2022-11-09T09:48:27.871412517+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35049 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-09T09:48:49.217947206+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35757 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-09T09:49:32.415540715+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44859 {created_time:"2022-11-09T09:50:46.321104717+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40509 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-09T09:51:09.726802919+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1109094341-f2327b6a_389dd544-ec35-4520-999c-2b45d7f27e12 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1109094941-ae7fef63_6eac532a-b7ac-4f45-9c4e-9e022275375d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 692 warnings in 601.43s (0:10:01) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 6s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tqhidmbfs4zqa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1095

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1095/display/redirect?page=changes>

Changes:

[noreply] [Go] Add pipeline resource hints to CHANGES.md (#24036)

[noreply] Handle Avro schema generation for logical data types in


------------------------------------------
[...truncated 181.53 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:52:59 AM org.apache.flink.runtime.blob.BlobServer close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:35431
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 09, 2022 3:52:59 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40121 {created_time:"2022-11-09T03:52:33.993360704+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35473 {created_time:"2022-11-09T03:52:35.466463363+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1109034625-ee2c48ec_8852d2e7-4455-47a3-bfad-489110f4e0c4 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1109035251-e4f215c3_29f1e028-2997-41a2-933f-154352c4464f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 648.04s (0:10:48) =
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39577 {created_time:"2022-11-09T03:52:42.313552466+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34335 {created_time:"2022-11-09T03:53:43.25766938+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44361 {created_time:"2022-11-09T03:54:20.911573749+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 15s
133 actionable tasks: 90 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gaaffxkbp7qvw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1094

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1094/display/redirect?page=changes>

Changes:

[noreply] Update release notes. (#23986)

[noreply] [Go] Pipeline Resource Hints (#23990)

[noreply] [#21250] Trivial removal of loop over something that always has one

[noreply] Bump cloud.google.com/go/bigtable from 1.16.0 to 1.17.0 in /sdks

[noreply] Editorial review of the ML base API descriptions (#24026)

[noreply] Update my Twitter handle (#23653)

[noreply] Retroactively announce Batched DoFn support in 2.42.0 Blog (#24011)

[noreply] Bump cloud.google.com/go/storage from 1.27.0 to 1.28.0 in /sdks (#24028)


------------------------------------------
[...truncated 181.07 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.actor.ActorCell.invoke(ActorCell.scala:548)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.run(Mailbox.scala:231)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	... 4 more
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Caused by: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.internalCreateBufferPool(NetworkBufferPool.java:483)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.buffer.NetworkBufferPool.createBufferPool(NetworkBufferPool.java:461)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.lambda$createBufferPoolFactory$0(ResultPartitionFactory.java:279)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.ResultPartition.setup(ResultPartition.java:160)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.io.network.partition.SortMergeResultPartition.setup(SortMergeResultPartition.java:190)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.setupPartitionsAndGates(Task.java:959)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Close ResourceManager connection a7eee25054d578ae6df1a9960c37b54e: Stopping JobMaster for job 'BeamApp-jenkins-1108215207-be1d338b' (293709d4f49dd3d142d9a33d8fec6f17).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down TaskExecutorLocalStateStoresManager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Disconnect job manager aaa19753b9626033cb0f1aa75f174b05@akka://flink/user/rpc/jobmanager_3 for job 293709d4f49dd3d142d9a33d8fec6f17 from the resource manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint lambda$shutDownInternal$5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Removing cache directory /tmp/flink-web-ui
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.rest.RestServerEndpoint lambda$closeAsync$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down complete.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-0ee4cb31-6055-4b41-b761-607ec9548043
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-f409aa0a-41b5-42d1-842e-ca05317375a5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-47114b51-c474-4ebd-b399-5c77014f82dd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 08, 2022 9:52:16 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1108214536-cab6136f_5ab1d460-20d0-457a-8588-684412033516 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1108215207-be1d338b_c68fabe2-0019-4abc-93c8-cdf47272ab95 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 661.46s (0:11:01) =
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42345 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T21:51:57.65228488+00:00"}"
>

Exception in thread run_worker_1-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33291 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-11-08T21:53:41.470811642+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 28s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/sgyf5xiuk2lbg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1093

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1093/display/redirect>

Changes:


------------------------------------------
[...truncated 181.58 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46673 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T15:47:34.625181437+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46063 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T15:47:54.919831487+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33361 {created_time:"2022-11-08T15:48:28.963888708+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40299 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T15:49:02.059265569+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46875 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T15:50:07.510378505+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45345 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T15:50:24.546520486+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40095 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T15:51:19.726133448+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41145 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T15:51:43.912296198+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1108154349-f92a1623_14a4f62f-9069-4b41-8e5d-2f84192f946d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1108155016-605c684e_94eb5701-d997-4928-b787-f24742fb46af failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 694 warnings in 633.47s (0:10:33) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 40s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qxjxmou4ew7cq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1092

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1092/display/redirect>

Changes:


------------------------------------------
[...truncated 181.99 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46725 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T09:47:20.154342763+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42869 {created_time:"2022-11-08T09:47:41.562717395+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46711 {created_time:"2022-11-08T09:48:23.817180334+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42515 {created_time:"2022-11-08T09:48:42.777968882+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34977 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T09:49:02.253885257+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34709 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T09:49:42.100745026+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45863 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T09:50:52.517027367+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44653 {created_time:"2022-11-08T09:51:13.184209814+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1108094348-8257ae90_c482a4fb-c8aa-4e17-a3a6-ad33db40972f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1108094950-8f3da905_dce9fccf-1685-4063-84e0-0a40fb72cd9d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 696 warnings in 609.14s (0:10:09) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 9s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vcg4iqzlaiovo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1091

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1091/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Better surfacing of Scala support via Scio.


------------------------------------------
[...truncated 181.71 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35475 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T03:47:39.642870357+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41915 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T03:48:08.885060802+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36445 {created_time:"2022-11-08T03:48:39.243988935+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40777 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T03:48:58.840893495+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43647 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T03:49:39.101694983+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43957 {created_time:"2022-11-08T03:49:54.46933126+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44247 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-08T03:50:47.125504583+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43065 {created_time:"2022-11-08T03:51:10.494992656+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1108034345-4a9f7d58_f3e6862b-9b6f-45ba-9cd5-e61f44191240 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1108034947-fc8d691a_105615ee-6803-4e3b-9a48-b8c2349e5432 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 694 warnings in 604.76s (0:10:04) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 8s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5hcsf7jarrgqc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1090

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1090/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] change case-study-card width on mobile

[noreply] feat: implement bigtable io connector with write capabilities (#23411)

[noreply] Bump google.golang.org/api from 0.101.0 to 0.102.0 in /sdks (#23957)

[noreply] Enforce splitting invariants by ensuring split state is reset in the

[noreply] Add files then check cached diff to get untracked files

[noreply] Switch && for || to fix bug in #23889 resolution (#24017)


------------------------------------------
[...truncated 181.74 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43719 {created_time:"2022-11-07T21:50:42.555257734+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44723 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T21:51:00.016962394+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41969 {created_time:"2022-11-07T21:51:42.842415881+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42185 {created_time:"2022-11-07T21:52:00.489926752+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46169 {created_time:"2022-11-07T21:52:18.989238344+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35765 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T21:52:54.436198363+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34323 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T21:53:57.976354538+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37635 {created_time:"2022-11-07T21:54:30.496389792+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1107214714-4003a78a_3013b459-1f72-4b3c-9d25-b89c93036ca0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1107215303-214033e2_fd8277fc-c300-4b49-919f-7b85d7b38c5c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 693 warnings in 655.32s (0:10:55) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 57s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/y2xup3bnasrye

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1089

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1089/display/redirect?page=changes>

Changes:

[vitaly.terentyev] Add sparkreceiver:2 module.

[vitaly.terentyev] Fix sparkreceiver dependencies

[noreply] Print diff and scope to state path

[noreply] Correctly print diff and swallow empty commits for the moment

[noreply] Remove quiet flag on debug

[noreply] Use git diff instead of git diff-index to avoid file timestamp changes

[noreply] Make `documentation/io/connectors/` canonical (#23877)

[noreply] [Tour of Beam] Learning content for "Introduction" module (#23085)


------------------------------------------
[...truncated 181.33 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down complete.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-io-2d35c2ec-e64f-48a9-9ebd-c4ae5dfe16ad
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shut down cluster because application is in CANCELED, diagnostics DispatcherResourceManagerComponent has been closed..
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent closeAsyncInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess closeInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-f8eebf1b-b243-4355-bf71-94f49f2ad9ce
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
ERROR    root:portable_runner.py:577 java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-29d4623b-d5b5-4297-b727-51255f1bb9f1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:47 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:48 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 07, 2022 3:51:48 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1107154334-9c79686c_faa9342f-8a65-481c-ab63-91e5344dc0c0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40595 {created_time:"2022-11-07T15:52:30.565182812+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45875 {created_time:"2022-11-07T15:53:08.194471441+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1107155138-94c09cc2_9debc2b0-7639-42ae-8009-58ce14b690d5 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 740.57s (0:12:20) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 17s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gdqnyyfmzdf7q

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1088

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1088/display/redirect>

Changes:


------------------------------------------
[...truncated 182.12 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38713 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T09:47:37.314171023+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40031 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T09:48:20.424850046+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33155 {created_time:"2022-11-07T09:48:42.323361766+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32925 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T09:49:06.852439774+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37479 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T09:49:50.21435605+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39691 {created_time:"2022-11-07T09:50:06.142117241+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 46 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39587 {created_time:"2022-11-07T09:50:47.637454001+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34447 {created_time:"2022-11-07T09:51:23.680521104+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1107094351-58dcaa9d_3dd074e8-5c2f-4e78-a067-fb1906b17e93 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1107094958-9c9b8986_8ed083d9-92e0-457e-9719-6909c54f1b32 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 694 warnings in 613.44s (0:10:13) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 17s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/yo4love4xhur6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1087

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1087/display/redirect>

Changes:


------------------------------------------
[...truncated 182.03 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40707 {created_time:"2022-11-07T03:48:47.224425069+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45523 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T03:49:10.462181746+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36403 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T03:49:59.762631657+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37031 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T03:50:21.454912661+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43085 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T03:50:45.389939652+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38225 {created_time:"2022-11-07T03:51:38.196662651+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36541 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T03:52:54.68093999+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35827 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-07T03:53:23.857092592+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1107034448-71c7524e_ef9b8ca7-9aaf-4056-8cd1-62313776d0c3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1107035147-1b975b7_c4e44e0c-2674-44af-bd49-99eca174e03e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 693 warnings in 710.48s (0:11:50) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 16s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dwjru3qlvutn2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1086

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1086/display/redirect?page=changes>

Changes:

[noreply] Fix diff to stop repeated bot runs

[noreply] Fix pr bot - exec doesn't allow command chaining

[noreply] PR Bot - Dont throw error on return code 1


------------------------------------------
[...truncated 181.79 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37123 {created_time:"2022-11-06T21:46:49.406795333+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35693 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T21:47:10.005462897+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44477 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T21:47:30.903178929+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34803 {created_time:"2022-11-06T21:48:11.576163041+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42531 {created_time:"2022-11-06T21:48:34.093657087+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38495 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T21:49:34.388485566+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36433 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T21:50:32.631776626+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46529 {created_time:"2022-11-06T21:51:08.706231373+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1106214336-5dfb2e73_1a68c584-005e-4a90-950c-4d86870c3333 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1106214944-c0cbab5a_c2099221-c72f-4385-8dfb-98dba12d857c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 677 warnings in 606.39s (0:10:06) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 8s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fiuw6ekpmr422

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1085

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1085/display/redirect>

Changes:


------------------------------------------
[...truncated 181.75 MB...]
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43551 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T15:47:17.408206973+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37733 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T15:47:38.977674059+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38557 {created_time:"2022-11-06T15:48:22.940351445+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41871 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T15:48:44.323808468+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33921 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T15:49:04.325401997+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41245 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T15:49:47.542920621+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33563 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T15:50:58.150160916+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37387 {created_time:"2022-11-06T15:51:24.787510764+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1106154350-54d3a0d1_2f94e716-5e9f-4844-86e4-8bc8fb7b458a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1106154955-f625d9c5_95b7f0c6-1dda-4cd6-a27f-c948295d8066 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 679 warnings in 609.49s (0:10:09) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 20s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/wdpso5cozm53a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1084

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1084/display/redirect>

Changes:


------------------------------------------
[...truncated 181.70 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41319 {created_time:"2022-11-06T09:47:32.642296689+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36697 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T09:47:52.787523612+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45327 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T09:48:36.663391401+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44437 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T09:48:58.280070023+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43509 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T09:49:18.212202788+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36995 {created_time:"2022-11-06T09:50:02.176253585+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41567 {created_time:"2022-11-06T09:51:14.673389718+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43251 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T09:51:40.119666043+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1106094359-9e63874c_f31410c5-5538-40ac-ae61-0a448cfdddca failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1106095010-ac68dd06_3fba16c1-46f6-4214-a56f-eb3b966d5513 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 693 warnings in 627.69s (0:10:27) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 37s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nvvjk5c55vmfe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1083

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1083/display/redirect>

Changes:


------------------------------------------
[...truncated 181.63 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33535 {created_time:"2022-11-06T03:47:08.986391479+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35509 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T03:47:29.444325985+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36101 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T03:48:11.552746142+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44645 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T03:48:32.511972308+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35505 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T03:48:52.339842769+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45067 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-06T03:49:35.56247807+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46545 {created_time:"2022-11-06T03:50:46.761083142+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39013 {created_time:"2022-11-06T03:51:10.430352212+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1106034340-353f62e4_e95fe3d0-da81-4688-9e46-6f4c946b4b65 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1106034945-8cd287aa_6867dccb-4e2a-48ba-ab33-e59ffef5b447 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 8 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 693 warnings in 601.87s (0:10:01) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 4s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3nvythyynm6mm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1082

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1082/display/redirect>

Changes:


------------------------------------------
[...truncated 181.60 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32933 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T21:47:55.132257842+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46119 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T21:48:39.778926517+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42283 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T21:49:03.255280384+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39693 {created_time:"2022-11-05T21:49:23.597503893+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37097 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T21:50:04.329643285+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33703 {created_time:"2022-11-05T21:50:20.620726537+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40147 {created_time:"2022-11-05T21:51:15.770156475+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37159 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T21:51:39.289978253+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1105214356-e7bb1430_2e70c1ae-4f29-49a6-af52-a9ba6b354f88 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1105215013-9cfb5a6d_010dee58-154d-463a-9395-0129db89cbca failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 694 warnings in 624.83s (0:10:24) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 31s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6cn7woobnidw6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1081

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1081/display/redirect>

Changes:


------------------------------------------
[...truncated 148.28 MB...]
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:40229
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 05, 2022 3:49:27 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38627 {created_time:"2022-11-05T15:49:08.802414948+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45581 {created_time:"2022-11-05T15:49:09.771814814+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
    return airline_df[at_top_airports].mean()

	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37549 {created_time:"2022-11-05T15:49:09.881765057+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35577 {created_time:"2022-11-05T15:50:07.974767074+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1105154304-e20a1510_397ed504-95b6-4923-9f07-f499943d722e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1105154919-65e2bfae_da43b74e-58f4-4add-98b8-77e0b5def700 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 41 warnings in 621.27s (0:10:21) =
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39599 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T15:50:21.061864403+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 139

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 45s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vi2oqtam3cvoq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1080

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1080/display/redirect>

Changes:


------------------------------------------
[...truncated 181.58 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46413 {created_time:"2022-11-05T09:47:19.271217597+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38559 {created_time:"2022-11-05T09:47:49.959217164+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38251 {created_time:"2022-11-05T09:48:10.765819554+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33123 {created_time:"2022-11-05T09:48:55.845944866+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44085 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T09:49:18.644353131+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38403 {created_time:"2022-11-05T09:50:22.079966496+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40169 {created_time:"2022-11-05T09:51:34.349801771+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33821 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T09:51:58.870714579+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1105094411-299c1751_f3d0312e-81c9-49b3-a3d6-fb96ea90c7c2 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 2, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1105095031-e4af993d_c6b2fc8d-e49a-4f97-9690-917c440675f3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 694 warnings in 642.96s (0:10:42) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 52s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ketkdurap6ckm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1079

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1079/display/redirect?page=changes>

Changes:

[noreply] Website add and update logos (#23899)


------------------------------------------
[...truncated 181.17 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40441 {created_time:"2022-11-05T03:47:42.900881863+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42449 {created_time:"2022-11-05T03:48:04.355316584+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38473 {created_time:"2022-11-05T03:48:48.188149326+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35265 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T03:49:09.034674735+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42653 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T03:49:29.605134637+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38515 {created_time:"2022-11-05T03:50:13.142959687+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 38 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44379 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T03:51:24.914850355+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46727 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-05T03:51:51.113301144+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1105034409-96e20b66_df0298e6-fc98-4764-a8ab-c664a103a010 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1105035021-bb831ea3_fa5c3519-91d9-4030-865c-33855290df0c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 10 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 691 warnings in 632.29s (0:10:32) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 42s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/naamo3idk2lks

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1078

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1078/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Move logging to its own module.

[Robert Bradshaw] Cleanup worker logging.

[Robert Bradshaw] Add basic counter setting and getting to the typescript SDK.

[Robert Bradshaw] Support metrics over the portability API.

[Robert Bradshaw] Add distribution metric type.

[Robert Bradshaw] old prettier change

[noreply] Bump cloud.google.com/go/datastore from 1.8.0 to 1.9.0 in /sdks (#23916)

[Robert Bradshaw] Remove obsolete TODO.

[Robert Bradshaw] Only report counters that were actually used.

[noreply] Add custom inference fn suport to the sklearn model handlers (#23642)

[noreply] removed trailing whitespace (#23987)

[noreply] Beam starter projects blog post (#23964)

[noreply] Enable more portable-runner requiring tests. (#23970)


------------------------------------------
[...truncated 182.45 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37811 {created_time:"2022-11-04T21:47:02.386047883+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33941 {created_time:"2022-11-04T21:47:24.198438224+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41571 {created_time:"2022-11-04T21:47:45.225506832+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46439 {created_time:"2022-11-04T21:48:16.59695055+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41117 {created_time:"2022-11-04T21:48:49.759303082+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44713 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T21:49:53.535446944+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40693 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T21:51:04.938490597+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45531 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T21:51:27.976944768+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1104214351-90d20e21_6d2bf213-e914-4f88-9bf9-cb66feeb33ab failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1104215001-c6ab30f2_1a41439c-7e14-4afd-ba0b-fa90de68acbd failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6702 deselected, 692 warnings in 615.79s (0:10:15) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 26s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/x6hz2mp6dkhyw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1077

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1077/display/redirect?page=changes>

Changes:

[noreply] Improve Iterator error message (#23972)

[noreply] Update watermark during periodic sequence/impulse (#23507)

[noreply] TFX image classification example (#23456)

[noreply] Immediately truncate full restriction on drain of periodic impulse

[noreply] [Task]: PR Bot will push commits only if they are non-empty (#23937)


------------------------------------------
[...truncated 182.33 MB...]
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41671 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T15:47:21.466353922+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34405 {created_time:"2022-11-04T15:48:15.30244244+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34281 {created_time:"2022-11-04T15:48:42.666301224+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36097 {created_time:"2022-11-04T15:49:27.90201018+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38311 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T15:49:49.610428379+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38023 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T15:50:54.505544868+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39495 {created_time:"2022-11-04T15:52:06.499903766+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39137 {created_time:"2022-11-04T15:52:30.490492045+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1104154356-37a63dbf_9ae561b9-a7bd-4bfe-9c0c-d50a62ed0a59 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1104155102-71b9247e_a3e37054-b0d6-4584-9839-e871ee24ccf3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 7 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6700 deselected, 690 warnings in 676.97s (0:11:16) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 24s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bm6kyflbfvmy4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1076

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1076/display/redirect>

Changes:


------------------------------------------
[...truncated 181.43 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Disconnect job manager 847217631dcfca07b170309f63484edc@akka://flink/user/rpc/jobmanager_3 for job 6fc5b92d4b9d8f2440b5291e009b5cd0 from the resource manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FileChannelManager removed spill file directory /tmp/flink-netty-shuffle-8ed4ce38-b942-4f0b-9708-6e5874275210
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.taskexecutor.KvStateService shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Shutting down the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stop job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-3c80fa5e-2629-494f-a366-07dc6f872d08
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 04, 2022 9:50:15 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 1. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 33. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:41249
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1149: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1151: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

Traceback (most recent call last):

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1104094324-2f0ed559_599d77ab-4665-4c3f-a725-8ff34d9b5929 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1104095005-d370f990_8c92a692-6ba7-43da-8f0c-666d8db52483 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 12 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6698 deselected, 41 warnings in 671.79s (0:11:11) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 46s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4qzvlmewqe3zq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1075

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1075/display/redirect?page=changes>

Changes:

[noreply] Disable flaky fn_api_runner tests (#23971)

[noreply] Make BatchConverter inference errors more helpful (#23965)


------------------------------------------
[...truncated 181.69 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33095 {created_time:"2022-11-04T03:47:12.58882001+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45293 {created_time:"2022-11-04T03:47:33.562914034+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38649 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T03:47:55.447678854+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39837 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T03:48:39.610256761+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35261 {created_time:"2022-11-04T03:48:59.585387156+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37169 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T03:50:10.65262291+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 36 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43797 {created_time:"2022-11-04T03:51:24.473587139+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41003 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-04T03:51:49.040054038+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1104034359-18ff9b56_1e0de9a0-7a9a-498e-8bcc-2db7f064547d failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1104035019-b593b79f_7847867d-337a-4c01-8989-b70e727283dc failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 9 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6698 deselected, 687 warnings in 631.42s (0:10:31) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 42s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ikdpgb552phza

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1074

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1074/display/redirect?page=changes>

Changes:

[ahmedabualsaud] emit load job IDs as soon as they come up

[ahmedabualsaud] style fix

[noreply] Initial draft of Batched DoFn user guide (#23909)

[noreply] WIP: Dataframe API ML preprocessing notebook (#22587)

[noreply] [Python] Added none check while accessing active_process_bundle (#23947)

[noreply] [Tour Of Beam] saving user code (#23938)


------------------------------------------
[...truncated 182.60 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38231 {created_time:"2022-11-03T21:47:48.823427361+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33773 {created_time:"2022-11-03T21:48:18.854697622+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42959 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T21:48:50.111242717+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33853 {created_time:"2022-11-03T21:49:08.93552786+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35519 {created_time:"2022-11-03T21:49:49.76912475+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43223 {created_time:"2022-11-03T21:50:03.088496317+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33143 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T21:51:02.45322742+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43057 {created_time:"2022-11-03T21:51:25.517791111+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1103214353-52667653_ebf83945-1e8a-4714-bd35-796d3225852a failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 1, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1103214956-df81c926_71a0f50b-6301-4cf8-a050-21a64fed26df failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
= 3 failed, 19 passed, 6 skipped, 6696 deselected, 694 warnings in 616.19s (0:10:16) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 19s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ivrjqefvhigji

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1073

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1073/display/redirect?page=changes>

Changes:

[Moritz Mack] [Spark dataset runner] Add direct translation of Combine.GroupedValues

[noreply] Concept guide on orchestrating Beam preprocessing (#23094)


------------------------------------------
[...truncated 156.56 MB...]
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41845 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T15:46:26.317044844+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40661 {created_time:"2022-11-03T15:46:58.448918183+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37003 {created_time:"2022-11-03T15:48:22.160600827+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41065 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T15:49:23.709710312+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40203 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T15:50:41.681473637+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41067 {created_time:"2022-11-03T15:51:03.249256214+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44469 {created_time:"2022-11-03T15:53:21.536942829+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1103154406-4bf3987b_b32dd9ea-3a2c-4bf9-93c6-87909781a87e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1103154448-6825e7e7_16c10ef9-f331-47de-a024-91bde2d35ae7 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1103154601-1b2eaeeb_7ffe3372-f5d2-4ef4-ab98-01b0c435d844 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1103154714-2c267691_a588b97b-3b13-4c12-a310-7e4d48389928 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1103155052-4ac54679_e073bb17-3065-477e-a8c7-d9e5bdba5855 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667490354730
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667490420669
= 6 failed, 16 passed, 6 skipped, 6696 deselected, 627 warnings, 2 errors in 724.18s (0:12:04) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 16s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/o2vweh4ipwqe6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1072

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1072/display/redirect>

Changes:


------------------------------------------
[...truncated 140.75 MB...]
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45143 {created_time:"2022-11-03T09:45:54.170775352+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46607 {created_time:"2022-11-03T09:46:14.677251537+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45587 {created_time:"2022-11-03T09:46:43.125967991+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42379 {created_time:"2022-11-03T09:46:59.56099115+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42293 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T09:47:45.456941849+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46763 {created_time:"2022-11-03T09:48:58.248386332+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34539 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T09:49:20.874997567+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1103094338-dab607e_9497397e-2a64-4a9d-995b-3e26bbefae80 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 1, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1103094419-4c0ed12b_e094ea22-0951-49f5-a90f-abba19b2aa5a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1103094533-38e90d49_8d98ae7d-2713-43d6-bf09-f11246725afa failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1103094622-1d87ab78_04bd9056-283a-44a8-b294-1eff3bdb7fbf failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1103094753-4f6ef6b8_1eeb7786-c173-4c04-814b-14735e02a0ef failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 11 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667468727123
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667468775169
= 6 failed, 16 passed, 6 skipped, 6696 deselected, 617 warnings, 2 errors in 494.58s (0:08:14) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 17s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cqwtnkqtlprte

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1071

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1071/display/redirect?page=changes>

Changes:

[noreply] Unify PerformanceTest metric dashboard naming and series (#23914)

[noreply] Update REVIEWERS.yaml (#23955)


------------------------------------------
[...truncated 140.72 MB...]
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37511 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T03:46:13.532296206+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45229 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T03:46:33.66815935+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40009 {created_time:"2022-11-03T03:47:01.649018165+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37747 {created_time:"2022-11-03T03:47:22.337156978+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45887 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T03:48:07.212075261+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33659 {created_time:"2022-11-03T03:48:22.136118303+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38237 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-03T03:49:43.944160521+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1103034350-4146d902_1ae0c5f6-6a8a-4b9a-b536-ea75c9fc4c0f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 1 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1103034435-3791a905_83bf775a-2ec3-4632-a59e-c929bb84bade failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1103034553-45b4a044_0c6dbe9e-1939-423e-b8cd-7d6d4d79f318 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1103034640-811aea33_8f029d95-2604-4919-953a-ba4adca604ea failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1103034815-b8bad4ec_af5da912-1227-4648-a6f0-1652b25e97f7 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667447147707
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667447194270
= 6 failed, 16 passed, 6 skipped, 6696 deselected, 626 warnings, 2 errors in 519.16s (0:08:39) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 41s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ysivo4mhmn4em

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1070

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1070/display/redirect?page=changes>

Changes:

[noreply] [CdapIO] Add integration tests for SparkReceiverIO (#23305)

[noreply] [Go] Ensure iterated and emitted types are registered. (#23890)

[chamikaramj] Updates Multi-language Java examples documentation

[noreply] [Python SDK] Re-enable PipelineOptionsTest.test_display_data (#23787)


------------------------------------------
[...truncated 140.70 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 9:49:58 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: removed file cache directory /tmp/flink-dist-cache-ee5d6421-c2fe-428f-bf37-f8704b4143d1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 9:49:58 PM org.apache.flink.runtime.taskexecutor.TaskExecutor handleOnStopException
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 9:49:58 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1102214521-d83c1b36_c29b912a-a327-4c53-a2d3-d7a9d66e7fa3 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 3 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1102214607-9ae97996_3a8e2d2b-8f6a-438a-b99c-b5429705a9ce failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1102214725-43481_89e45216-b8dd-43ac-829c-f4590241ab06 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1102214815-c78d2446_8d2af49c-4727-4d10-a162-9e811c455f7e failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1102214951-de15717_24e166ae-d563-466a-a237-ccf32bfe8dc7 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667425639315
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667425689104
= 6 failed, 16 passed, 6 skipped, 6696 deselected, 41 warnings, 2 errors in 522.96s (0:08:42) =
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45017 {created_time:"2022-11-02T21:49:36.079271361+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43305 {created_time:"2022-11-02T21:49:37.672843083+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45259 {created_time:"2022-11-02T21:49:38.538700569+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34361 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T21:51:22.001872658+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 17s
133 actionable tasks: 91 executed, 40 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/muaajvqmijvsc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1069

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1069/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] add shuffle to logos

[Moritz Mack] Fix Spark 3 job-server jar path for Python test suites (closes #23935,

[noreply] Bump actions/setup-java from 3.5.1 to 3.6.0 (#23797)


------------------------------------------
[...truncated 141.21 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:652)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 3:47:58 PM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 3:47:58 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl closeAsync
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 3:47:58 PM org.apache.flink.runtime.dispatcher.Dispatcher terminateRunningJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping all currently running jobs of dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 3:47:58 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Closing the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 3:47:58 PM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager suspend
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Suspending the slot manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 3:47:58 PM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$1
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 3:47:58 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopping Akka RPC service.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
---------------------------- Captured log teardown -----------------------------
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Nov 02, 2022 3:47:59 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43997 {created_time:"2022-11-02T15:47:40.171601651+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38087 {created_time:"2022-11-02T15:47:40.426778887+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
_queue.Empty

FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1102154300-c1d56fb4_5cb9a502-9666-48db-8b68-1be391a7c2f0 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1102154346-3d4d32a7_28de4037-7aaa-4cd9-87a0-1a91617e1778 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1102154501-88c4c060_946cbab0-be21-4e78-a885-7128b838198c failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1102154550-715d6151_fd346b2f-a3f9-4632-a2ad-d7e4453cd8dc failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1102154750-4367232a_246bb586-88b8-43cb-bda9-7a0566d5fb2c failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 5 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667403895157
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667403943968
= 6 failed, 16 passed, 6 skipped, 6696 deselected, 41 warnings, 2 errors in 528.01s (0:08:48) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 23s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/baptmfgzgzujq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1068

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1068/display/redirect>

Changes:


------------------------------------------
[...truncated 141.41 MB...]
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34213 {created_time:"2022-11-02T09:45:54.43193282+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41557 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T09:46:19.799633179+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46403 {created_time:"2022-11-02T09:46:49.295116473+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 809, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36533 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T09:47:08.567780946+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36103 {created_time:"2022-11-02T09:47:49.227630147+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41015 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T09:48:59.895217593+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46289 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T09:49:22.066394205+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1102094337-36ae613b_1638f44c-6b00-451d-b73f-9051224f1a1f failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 15 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1102094419-10e1a503_4a5c91d2-1b49-4c4a-9194-98f528eb1c3c failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1102094532-c140a9a7_74cc5ecb-57f0-4ed8-a2d5-78291c63e745 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1102094627-f621cba5_3fd2b2aa-570d-4f75-ab06-1e27dd1e32f6 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1102094757-109d705a_8e9d4b2d-996c-4c10-bbde-f94cf034042e failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 4 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667382326991
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667382381059
= 6 failed, 16 passed, 6 skipped, 6696 deselected, 626 warnings, 2 errors in 498.18s (0:08:18) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 19s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vzm7sxursm7cy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1067

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1067/display/redirect?page=changes>

Changes:

[noreply] Add support for converting to/from pyarrow Arrays (#23894)


------------------------------------------
[...truncated 139.92 MB...]
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45721 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T03:46:07.365793213+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33039 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T03:46:27.621378382+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39545 {created_time:"2022-11-02T03:46:56.036818157+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37591 {created_time:"2022-11-02T03:47:11.548173915+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35891 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T03:47:56.955728191+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42349 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-02T03:49:08.450673053+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36485 {created_time:"2022-11-02T03:49:30.03917925+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1102034347-c76b9845_619ba007-f366-4e60-b432-cf96183c21ff failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 6 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1102034428-7c5deb7_88533572-cf1d-4985-a777-31d3a817528a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1102034546-b333736b_ac0be7a7-2804-47aa-9a95-740fa37251f7 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1102034634-a67abbdd_53ef4f1b-46eb-415b-8181-5772e64514ca failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1102034806-5b1fbd66_4ce66e25-b2ab-4679-bce3-f995a32027ea failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667360739354
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667360788161
= 6 failed, 16 passed, 6 skipped, 6696 deselected, 614 warnings, 2 errors in 501.74s (0:08:21) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 25s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6a5oqdpei5pvg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1066

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1066/display/redirect?page=changes>

Changes:

[noreply] Add jupyter notebook for using RunInference with sklearn, pytorch and

[noreply] Add WriteParquetBatched  (#23030)

[noreply] Validate if user exists for author (#23761)

[noreply] Add notebook for doing remote inference in Beam (#23887)

[noreply] Fix python examples tests not running in Dataflow (#23546)


------------------------------------------
[...truncated 140.43 MB...]
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36355 {created_time:"2022-11-01T21:45:58.5785826+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38933 {created_time:"2022-11-01T21:46:18.776518761+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_with_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43507 {created_time:"2022-11-01T21:46:46.509509217+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/group_with_coder_test.py::GroupWithCoderTest::test_basics_without_type_check
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36549 {created_time:"2022-11-01T21:47:05.574963251+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/mergecontacts_test.py::MergeContactsTest::test_mergecontacts
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45789 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-01T21:47:46.134834431+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39519 {created_time:"2022-11-01T21:48:52.776822085+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33865 {created_time:"2022-11-01T21:49:15.122125942+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/tfidf_it_test.py::TfIdfIT::test_basics - RuntimeError: Pipeline BeamApp-jenkins-1101214341-29538c9e_a3ac2587-e230-454a-acd0-712206f350b8 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 0 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1101214424-ab81e266_078f1c28-309a-411e-97cc-f8f42ee127af failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1101214537-3a1c2904_a03c0a9e-92bb-40c3-b2f8-d853eb09b5ce failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/custom_ptransform_it_test.py::CustomPTransformIT::test_custom_ptransform_output_files_on_small_input - ValueError: Pipeline has validations errors: 
Option environment_config is not compatible with environment type LOOPBACK.
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1101214626-fdfd961f_b71c9884-c2fb-46f0-adb8-8aae34c95aaf failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/multiple_output_pardo_test.py::MultipleOutputParDo::test_multiple_output_pardo - RuntimeError: Pipeline BeamApp-jenkins-1101214754-a6217e5d_ec966f72-8f4f-414b-8597-cbc77ec92738 failed in state FAILED: java.io.IOException: Insufficient number of network buffers: required 16, but only 2 available. The total number of network buffers is currently set to 2048 of 32768 bytes each. You can increase this number by setting the configuration keys 'taskmanager.memory.network.fraction', 'taskmanager.memory.network.min', and 'taskmanager.memory.network.max'.
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667339131690
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667339179546
= 6 failed, 16 passed, 6 skipped, 6670 deselected, 628 warnings, 2 errors in 499.91s (0:08:19) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 13s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fva47i7hzdhuc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1065

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1065/display/redirect?page=changes>

Changes:

[noreply] Remove Dataflow Portability test suite from mass_comment.py


------------------------------------------
[...truncated 49.86 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/top_wikipedia_sessions_it_test.py::ComputeTopSessionsIT::test_top_wikipedia_sessions_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44893 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-01T15:42:35.925846539+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44217 {created_time:"2022-11-01T15:43:08.805075965+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36297 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-01T15:43:53.936674096+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46237 {created_time:"2022-11-01T15:44:21.537854932+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1101154244-e78f43f5_aa53c159-0bc6-42fc-a350-a58aa82eeffe failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1101154401-ac1dc5_c96fa023-8a7a-41e9-a65b-39f5d12f1641 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1101154429-e57ed4b0_39df4721-dc97-46f4-89e9-0b389133a0e6 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667317435115
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667317463369
= 3 failed, 19 passed, 6 skipped, 6668 deselected, 364 warnings, 2 errors in 282.36s (0:04:42) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 27s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tgkvi3hpvm4sa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1064

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1064/display/redirect>

Changes:


------------------------------------------
[...truncated 49.87 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40821 {created_time:"2022-11-01T09:42:55.377466662+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42979 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-01T09:43:35.554204+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38981 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-01T09:44:00.595666885+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 44 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36983 {created_time:"2022-11-01T09:45:12.984002538+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1101094230-9d0366f9_bcefcb3e-b9bd-470e-ad68-32b9d383fc17 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1101094342-423e31f_7074dcec-17a3-4842-bb51-108c0deeb4ff failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1101094410-8199c1a_cb06fb26-1eeb-4ee7-b1d1-10281ad25dfd failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667295816327
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667295843468
= 3 failed, 19 passed, 6 skipped, 6668 deselected, 367 warnings, 2 errors in 270.02s (0:04:30) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 4s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/yjgt5ldtjvcqu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1063

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1063/display/redirect?page=changes>

Changes:

[noreply] Clean-up DatastoreV1.java (#23892)

[noreply] Add LogElements as a Beam PTransform (#23879)

[noreply] Fix incorrect object size calculation in StateCache (#23000) (#23886)


------------------------------------------
[...truncated 49.97 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41789 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-11-01T03:42:47.473244164+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37075 {created_time:"2022-11-01T03:43:23.344445739+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43007 {created_time:"2022-11-01T03:43:47.646509898+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 37 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39633 {created_time:"2022-11-01T03:45:01.456364314+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1101034227-76a9cdaf_d6acabb2-dd8b-4298-ae72-2b1885553bcf failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1101034328-f5813031_960d153a-ef2e-48c8-a3f4-5068fc5689e7 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1101034356-44c695d_7bfd15eb-83c8-492e-b138-587a738d0add failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667274204857
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667274229520
= 3 failed, 19 passed, 6 skipped, 6668 deselected, 360 warnings, 2 errors in 253.77s (0:04:13) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 52s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/p5ghas7woocym

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1062

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1062/display/redirect?page=changes>

Changes:

[yathu] Fix Beam Sql does not support CHAR, VARCHAR, BINARY, VARBINARY

[yathu] Remove debug leftover

[noreply] Disable `optimizeOuterThis` when building with JDK > 8 (#23902)

[noreply] [Playground] [Backend] Update playground cache component to increase

[noreply] Upgrade Akvelon editor (#23415) (#23900)

[noreply] [Website] update additional case studies layout and scss (#23555)

[noreply] [Website] add shuffle to logos (#23847)


------------------------------------------
[...truncated 49.95 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37777 {created_time:"2022-10-31T21:45:40.149706887+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46749 {created_time:"2022-10-31T21:46:51.071974379+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1667252837696.
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42339 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-31T21:48:17.783678782+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40277 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-31T21:48:28.152009612+00:00"}"
>

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1031214547-3bbfd9e3_3a27c1d9-6017-4ac4-972a-062e794bccca failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1031214656-3de12783_ff84360e-7876-470d-a511-8a09420780a0 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1031214724-28621e63_7b0bbae5-96a4-4112-89fe-d14f9449df25 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667252812898
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667252837696
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 41 warnings, 2 errors in 261.28s (0:04:21) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 22s
133 actionable tasks: 100 executed, 31 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6y3c2ms4f3mwk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1061

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1061/display/redirect?page=changes>

Changes:

[noreply] Add brief descriptions about end-to-end ML Pipelines (#23880)


------------------------------------------
[...truncated 50.03 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37031 {created_time:"2022-10-31T15:42:58.597368794+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40681 {created_time:"2022-10-31T15:43:37.257365574+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42519 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-31T15:44:01.318197651+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42463 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-31T15:45:17.001039857+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1031154233-2b9da03c_a7691a89-7450-487f-bc97-6ca6ae2e2d86 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1031154342-cf7ed375_ee0fe228-bb3a-44c5-92ca-f222adac3042 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1031154412-af0b4390_d1881909-675c-47b5-99e4-5becb04186fb failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667231018826
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667231045354
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 362 warnings, 2 errors in 267.06s (0:04:27) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 8s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/2cyypuna3fhqi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1060

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1060/display/redirect>

Changes:


------------------------------------------
[...truncated 49.94 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41467 {created_time:"2022-10-31T09:43:06.651664559+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43659 {created_time:"2022-10-31T09:43:46.321467023+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36651 {created_time:"2022-10-31T09:44:13.055280385+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 37 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45443 {created_time:"2022-10-31T09:45:24.337502488+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1031094242-d324e131_15498ea2-8a2b-4a71-b4c3-7d98c4b789e9 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1031094353-937b4e78_3d94ee92-1b44-4dbe-b538-6c5cc23cddcc failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1031094420-2741293_a45f4bc4-013a-434f-a7fe-2d39f4b0da42 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667209427071
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667209454853
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 360 warnings, 2 errors in 267.12s (0:04:27) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 13s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6kpicyeszulyg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1059

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1059/display/redirect?page=changes>

Changes:

[noreply] Fixing branch verification for Run RC Validation and Verify Release

[noreply] Fix link in `basics` (#23399)


------------------------------------------
[...truncated 49.90 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38015 {created_time:"2022-10-31T03:43:05.458349548+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33449 {created_time:"2022-10-31T03:43:46.601265549+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40569 {created_time:"2022-10-31T03:44:12.733318297+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 44 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44243 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-31T03:45:26.365171508+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1031034239-dccc026d_9d7cdb72-693d-430b-ae29-59a39ab6e3f1 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1031034353-fe04188a_ce7df6c0-1a7f-48d5-b1fc-b4bdded71baa failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1031034421-dd557e3a_b6999d86-f83b-4153-bf8d-89f2e8fcb196 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667187827375
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667187855376
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 367 warnings, 2 errors in 272.01s (0:04:32) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 17s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uozsrs5s64pmy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1058

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1058/display/redirect>

Changes:


------------------------------------------
[...truncated 49.97 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36549 {created_time:"2022-10-30T21:42:47.245155681+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44543 {created_time:"2022-10-30T21:43:26.793985674+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45465 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-30T21:43:51.478483912+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34705 {created_time:"2022-10-30T21:44:58.425201627+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1030214223-cde6f509_ef50a73a-789f-49a7-8f9f-a1a4d719e7dd failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1030214333-5f3ad715_f9e04b4b-a9c9-4096-8953-f2f28751fc94 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1030214358-3bf68cbb_09705e8a-6615-49d5-97c7-fff803877a69 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667166207623
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667166234121
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 364 warnings, 2 errors in 255.02s (0:04:15) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 52s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5u6bvu67x2iik

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1057

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1057/display/redirect>

Changes:


------------------------------------------
[...truncated 49.97 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43003 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-30T15:42:51.604091918+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34589 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-30T15:43:28.335589934+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38573 {created_time:"2022-10-30T15:43:52.264163722+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35939 {created_time:"2022-10-30T15:45:01.566006911+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1030154226-2568427a_f556d285-9342-44b5-aaac-9b0759d5d7de failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1030154336-8b67699b_54b6d647-d1f6-4ee9-b520-d28dde6cc322 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1030154400-23208a84_9b6e4e16-574b-4058-877c-2a931679173a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667144609948
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667144633961
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 366 warnings, 2 errors in 254.66s (0:04:14) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 52s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/2zm3jyod5vhgi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1056

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1056/display/redirect>

Changes:


------------------------------------------
[...truncated 49.88 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37619 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-30T09:42:50.110128045+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40959 {created_time:"2022-10-30T09:43:28.396340786+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45047 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-30T09:43:53.997553257+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32799 {created_time:"2022-10-30T09:45:05.131010976+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1030094228-e241d1b0_770b6fe4-c03b-4e85-8e18-593a01a06674 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1030094335-12f54d71_f4d7a571-e472-4a9d-8e01-02f6c3d022fc failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1030094402-fd30daa7_8f9d3ad8-5934-48c6-a663-ba8de511f145 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667123009911
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667123036956
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 364 warnings, 2 errors in 257.51s (0:04:17) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 52s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/sbde4nwucbv7s

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1055

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1055/display/redirect>

Changes:


------------------------------------------
[...truncated 49.98 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44045 {created_time:"2022-10-30T03:42:51.613863426+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46535 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-30T03:43:31.010085263+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36203 {created_time:"2022-10-30T03:43:57.330958437+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 44 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38653 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-30T03:45:12.21412506+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1030034229-36b352a3_099935a2-59f5-4dee-a26d-7a835b7eda4a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1030034338-87ff0b36_6fd4d481-4f2d-4665-81cb-a35024e0f9e9 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1030034405-d83d7892_bf425192-645d-4a75-bc08-e469a8cc9f08 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667101411735
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667101439075
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 367 warnings, 2 errors in 267.59s (0:04:27) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zsnjfrzg4mvgq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1054

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1054/display/redirect>

Changes:


------------------------------------------
[...truncated 49.97 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44859 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T21:42:47.762120074+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37527 {created_time:"2022-10-29T21:43:29.571260347+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41171 {created_time:"2022-10-29T21:43:57.827499776+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39715 {created_time:"2022-10-29T21:45:16.104131124+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1029214223-985ed4a2_381c0dbf-100e-4783-b424-ed0277082387 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1029214337-210a1346_f3bd20d3-2ffe-4cf9-9ca0-c8f589f569dd failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1029214407-2a8d08d8_294fead1-498b-44cf-a2d3-9ca26a5115e1 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667079810660
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667079839952
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 364 warnings, 2 errors in 275.70s (0:04:35) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 9s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dgp7pdhc5fqoi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1053

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1053/display/redirect>

Changes:


------------------------------------------
[...truncated 50.02 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34221 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T15:43:02.804155251+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45757 {created_time:"2022-10-29T15:43:40.653164611+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44339 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T15:44:07.229742995+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38027 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T15:45:24.778910963+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1029154241-ba17825d_9f2676d7-fdd5-4630-966d-824d5a25d6a7 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1029154346-74cfdf11_7915f4ff-cf59-4d1a-af1b-fc5582d8a7e9 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1029154415-9204e0c1_27150d6d-1f83-4655-8a36-f3fd201daaf2 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667058222200
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667058249145
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 362 warnings, 2 errors in 272.80s (0:04:32) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 15s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cdsnrcumrogey

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1052

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1052/display/redirect>

Changes:


------------------------------------------
[...truncated 49.96 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37357 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T09:42:45.554139388+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41563 {created_time:"2022-10-29T09:43:26.528558398+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44369 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T09:43:45.213115193+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44037 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T09:44:55.962129339+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1029094223-81b2e03c_57b0083e-37f5-448b-9c0b-81bff138bbee failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1029094331-37534973_5cb488ed-b8ae-4ba1-8fc8-0dd6e0139f9d failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1029094352-6879178d_d39c708f-b7e9-497d-bc4d-888863600d93 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667036607246
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667036627937
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 364 warnings, 2 errors in 251.52s (0:04:11) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 48s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uoxeppsalcgzk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1051

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1051/display/redirect>

Changes:


------------------------------------------
[...truncated 49.92 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43957 {created_time:"2022-10-29T03:42:40.421227595+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39605 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T03:43:16.775908511+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35995 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T03:43:37.323108653+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 38 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34315 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-29T03:44:52.850691391+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1029034221-63620576_dfb6db78-100a-4dfb-82f4-0ff5d12f2d64 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1029034322-4dc1525e_801c42b1-1628-43ed-9fa0-ac2bb99bc250 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1029034345-7a70e6df_71fde954-84c2-485b-a85a-38d3596170c0 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667014998697
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1667015018915
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 361 warnings, 2 errors in 247.73s (0:04:07) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 43s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4wnvaniinrt3s

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1050

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1050/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] update calendar section mobile classes #22694

[Robert Bradshaw] More bigquery native sink cleanup.

[noreply] adding examples in schema transforms section of programming guide for


------------------------------------------
[...truncated 49.94 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37883 {created_time:"2022-10-28T21:43:32.505832576+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45121 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-28T21:44:14.272015051+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39749 {created_time:"2022-10-28T21:44:43.367042278+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37239 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-28T21:46:01.087554317+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1028214306-1bab9f23_95419ec8-4add-4951-9a3a-76a63d88d12d failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1028214421-aca392f4_4570c72f-77fb-4e08-9b4a-587fb993916c failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1028214451-aa4bbb73_61853af1-9dda-4f70-bab6-7d66f7152907 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666993455157
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666993485491
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 365 warnings, 2 errors in 293.21s (0:04:53) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 49s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xjum73g2mijvw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1049

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1049/display/redirect?page=changes>

Changes:

[noreply] Fix BigQueryIO Performance Test Streaming (#23857)


------------------------------------------
[...truncated 50.03 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45231 {created_time:"2022-10-28T15:44:19.124230793+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34097 {created_time:"2022-10-28T15:44:59.388283852+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40573 {created_time:"2022-10-28T15:45:25.988388093+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45455 {created_time:"2022-10-28T15:46:38.328055443+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1028154354-ca93109c_6fb6bafe-a51c-4149-8442-796d88b35ec1 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1028154506-dc7825b7_bd4fdad0-da32-44f9-be17-1389c4b0f9c4 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1028154533-f29cb201_f45264b1-2a60-46a3-b2ed-0b8cd89a6658 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666971900145
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666971927738
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 366 warnings, 2 errors in 278.05s (0:04:38) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 26s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jzauv33xw3vgu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1048

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1048/display/redirect?page=changes>

Changes:

[Alexey Romanenko] [23832] Update CHANGES.md


------------------------------------------
[...truncated 49.92 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41903 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-28T09:42:56.193170589+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45033 {created_time:"2022-10-28T09:43:36.759326705+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44751 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-28T09:44:03.396560056+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43309 {created_time:"2022-10-28T09:45:17.457351737+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1028094233-3290ccb4_6edd86ab-9280-4644-816b-94dbbcbb88e2 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1028094344-238534ce_e9727bfc-2d75-4eb2-8a58-dbcd8c895889 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1028094411-dc085d02_7ac9b987-d618-4b88-99eb-d8ecd5f8aef1 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666950217562
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666950245711
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 362 warnings, 2 errors in 264.30s (0:04:24) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 5s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cyefnj26nanvo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1047

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1047/display/redirect?page=changes>

Changes:

[noreply] Migrate BINARY, VARBINARY, CHAR, VARCHAR jdbc logical types to portable

[noreply] [BEAM-12164] Feat: Added SpannerChangeStreamIT to Cloud Spanner Change

[noreply] Use --release 8 for builds targeting Java 8 (#23771)


------------------------------------------
[...truncated 49.97 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 28, 2022 3:47:40 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 28, 2022 3:47:40 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1028034740-382cd996_d4094a11-3349-4224-963f-3503c2aac385.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:126)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:99)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1666928856149.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeli
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
ne>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32885 {created_time:"2022-10-28T03:47:32.742893449+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39027 {created_time:"2022-10-28T03:47:34.100141293+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44459 {created_time:"2022-10-28T03:48:49.268910841+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

>

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1028034603-af00d681_c3bc9d0f-8386-46d2-acbe-9ebb6089ddb7 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1028034714-ec12da46_738e0432-5103-4104-8a32-39a1947f0ea0 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1028034740-382cd996_d4094a11-3349-4224-963f-3503c2aac385 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666928830196
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666928856149
= 3 failed, 19 passed, 6 skipped, 6664 deselected, 41 warnings, 2 errors in 270.95s (0:04:30) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 41s
133 actionable tasks: 94 executed, 37 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mbotuli7ozcie

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1046

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1046/display/redirect?page=changes>

Changes:

[Heejong Lee] [BEAM-23836] Updating documentation for cross-language Java pipelines

[Heejong Lee] update

[Heejong Lee] update

[Heejong Lee] update

[noreply] Add `arrow_type_compatibility` with `pyarrow.Table` to Beam Row

[noreply] Reduce log spam of Py37PostCommit (#23829)

[noreply] Actually use the DatsetService that will be auto-closed (#23873)


------------------------------------------
[...truncated 49.98 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34117 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T21:44:15.077572741+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34499 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T21:44:57.458916347+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41471 {created_time:"2022-10-27T21:45:24.056261386+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 44 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34875 {created_time:"2022-10-27T21:46:36.656595563+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1027214350-27234cd6_d5f036cf-261e-4980-85ec-94d5df81b7b8 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1027214504-722e2c04_92e32d56-5912-454d-b415-f6aab31206e0 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1027214532-d84d9a0e_889e35b9-8327-4e20-b1c8-ac0b5e875585 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666907098370
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666907126855
= 3 failed, 19 passed, 6 skipped, 6666 deselected, 367 warnings, 2 errors in 269.54s (0:04:29) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 30s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5mbsvzymirnj6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1045

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1045/display/redirect?page=changes>

Changes:

[noreply] [Tour Of Beam] User authorization part 1 (#23782)

[noreply] [BEAM-23815] Fix Neo4j tests. (#23862)


------------------------------------------
[...truncated 49.97 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38493 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T15:43:19.630559401+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45731 {created_time:"2022-10-27T15:43:59.036813525+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36157 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T15:44:24.153196292+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35301 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T15:45:23.491608583+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1027154257-af850c71_834868cb-a4ab-4b6f-84b0-ce75c5cd1684 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1027154406-6c5bda36_97131bd5-c68a-4292-911e-d13344713b0b failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1027154431-f1050192_daf94c02-31ca-45cd-ba74-b1c491aab29e failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666885439934
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666885465923
= 3 failed, 19 passed, 6 skipped, 6635 deselected, 365 warnings, 2 errors in 257.95s (0:04:17) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 17s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/um5k6l6cuybsu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1044

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1044/display/redirect>

Changes:


------------------------------------------
[...truncated 50.08 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36547 {created_time:"2022-10-27T09:43:14.866096587+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35073 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T09:43:55.080303227+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35643 {created_time:"2022-10-27T09:44:23.399346307+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39393 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T09:45:34.990388162+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1027094248-d054cf21_f43f0a24-a097-400e-bdc6-a5638bb0d609 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1027094402-1855f0eb_ed9378fb-7bc5-4ec2-a025-f1138725fcab failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1027094432-a3968b26_60cc2d48-ed92-444f-8635-24614a156622 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666863836047
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666863865517
= 3 failed, 19 passed, 6 skipped, 6635 deselected, 364 warnings, 2 errors in 266.92s (0:04:26) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 21s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/uejp5qzbuedfu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1043

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1043/display/redirect?page=changes>

Changes:

[noreply] Deactivate Dask Runner code coverage tests as workaround (#23841)

[noreply] Use Akvelon editor (#23415) (#23825)


------------------------------------------
[...truncated 49.90 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42025 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T03:43:09.938301404+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43197 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T03:43:51.23513003+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38057 {created_time:"2022-10-27T03:44:16.874943146+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45261 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-27T03:45:29.767564852+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1027034244-86c96252_bc96a82d-d098-43b0-8c47-16c38c2b3d52 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1027034358-e2cdfbef_5793814a-ed0f-4bec-9c08-aefa5605e938 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1027034426-a27593fd_0211d01f-305a-4bed-a2a1-47188d70ae19 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666842232040
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666842260067
= 3 failed, 19 passed, 6 skipped, 6635 deselected, 364 warnings, 2 errors in 270.10s (0:04:30) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 21s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/hm4ddj37jj3x6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1042

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1042/display/redirect?page=changes>

Changes:

[Moritz Mack] Bump dropwizard metrics-core for Spark 3 runner to match the version

[noreply] [23832] Remove ParquetIO.withSplit (closes #23832) (#23833)

[noreply] Bump github.com/spf13/cobra from 1.6.0 to 1.6.1 in /sdks (#23822)

[noreply] [Go SDK] Add tests to the metrics package (#23769)

[noreply] Bump cloud.google.com/go/pubsub from 1.25.1 to 1.26.0 in /sdks (#23823)

[noreply] Updated documentation to point to notebooks instead of having samples

[noreply] Post 2.42.0 Updates to release guide (#23672)

[noreply] Add Go usage instructions to download page. (#23698)


------------------------------------------
[...truncated 50.01 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39347 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-26T21:42:47.825454849+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39437 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-26T21:43:26.095309306+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45603 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-26T21:43:47.37274928+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40457 {created_time:"2022-10-26T21:44:54.15699643+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1026214227-dabd0309_c9dc3b3e-930c-46e6-b739-9d8c55ce5f40 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1026214330-fbfc33dd_553309a2-9023-447f-aad7-f455fa5b8624 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1026214353-5b457d1_b6611ec1-68d9-4d11-a1e5-f70d4565234f failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666820606848
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666820629175
= 3 failed, 19 passed, 6 skipped, 6635 deselected, 366 warnings, 2 errors in 244.22s (0:04:04) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 44s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/i562jlhlbrxfm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1041

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1041/display/redirect?page=changes>

Changes:

[Moritz Mack] Remove obsolete code from Spark 3 runner.

[noreply] Fixing Get Started header link (#23490)

[noreply] Bump cloud.google.com/go/bigquery from 1.42.0 to 1.43.0 in /sdks

[noreply] Bump google.golang.org/api from 0.100.0 to 0.101.0 in /sdks (#23842)

[noreply] Update ReadDataFromKinesis URN to registered URN (fixes #23693) (#23849)


------------------------------------------
[...truncated 49.85 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44407 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-26T15:42:56.345791166+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44175 {created_time:"2022-10-26T15:43:32.109991664+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45245 {created_time:"2022-10-26T15:43:59.826676288+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:32945 {created_time:"2022-10-26T15:45:12.309696161+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1026154232-9049b756_1d6a07da-18f1-4f1a-993a-a9d88fd7edb0 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1026154339-a0bbcc9e_3c03cdd8-10f8-43e9-b806-184fd88ed430 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1026154408-19d2809_0a8922f8-528e-4237-8b12-095a28bfe4c0 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666799012896
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666799042740
= 3 failed, 19 passed, 6 skipped, 6635 deselected, 365 warnings, 2 errors in 259.35s (0:04:19) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 1s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jjfe54vgll4rs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1040

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1040/display/redirect>

Changes:


------------------------------------------
[...truncated 49.87 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41055 {created_time:"2022-10-26T09:42:49.090089388+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40507 {created_time:"2022-10-26T09:43:27.360308987+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34077 {created_time:"2022-10-26T09:43:54.853146356+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45265 {created_time:"2022-10-26T09:45:02.621883181+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1026094224-bb80b307_50cf89a5-f842-45e9-9320-92b907ea4c26 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1026094334-74e690ad_b7dfd5ed-b59f-4dd4-ab21-0ac2b550004c failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1026094402-b99aec1d_5124721b-652f-49dc-ad74-42f28003447f failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666777408884
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666777436676
= 3 failed, 19 passed, 6 skipped, 6635 deselected, 366 warnings, 2 errors in 257.44s (0:04:17) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 55s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/y2m7xmnkideea

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1039

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1039/display/redirect?page=changes>

Changes:

[chamikaramj] Adds a dependency to Python Multi-language library to the GCP Bom

[noreply] Support keyed executors in Samza Runner to process bundles for stateful


------------------------------------------
[...truncated 49.95 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43935 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-26T03:42:58.632531697+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41721 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-26T03:43:36.266268947+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42219 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-26T03:44:02.783844505+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37121 {created_time:"2022-10-26T03:45:11.501001851+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1026034233-bed4592b_881362cb-5941-4788-bdf3-c87a38988bd5 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1026034343-f68349ee_44d4a06d-7baf-448f-bd60-ef0f413ca8d6 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1026034411-aa9f3bfd_08969441-ab48-4530-bfe2-a2bbfdbe0b57 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666755817907
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666755845430
= 3 failed, 19 passed, 6 skipped, 6635 deselected, 363 warnings, 2 errors in 259.03s (0:04:19) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 1s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rif4yzyovumew

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1038

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1038/display/redirect?page=changes>

Changes:

[Kenneth Knowles] Enable checkerframework by default

[noreply] granting ruslan shamunov triage rights (#23806)

[noreply] Bump google.golang.org/api from 0.99.0 to 0.100.0 in /sdks (#23718)

[noreply] Initial DaskRunner for Beam (#22421)

[noreply] [Website] update PULL_REQUEST_TEMPLATE.md (#23576)

[noreply] [Website] change width of the additional case studies cards (#23824)


------------------------------------------
[...truncated 49.95 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46411 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-25T21:42:51.754745633+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42211 {created_time:"2022-10-25T21:43:30.820684306+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35371 {created_time:"2022-10-25T21:43:56.04916402+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37027 {created_time:"2022-10-25T21:45:05.276379386+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1025214227-638ac201_ef3482e9-5859-428d-b72e-9a7830caf0cb failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1025214337-acce955a_c642ce9c-ceb1-463f-b8df-bfd3ec397a80 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1025214406-441a75df_4e260f8f-50af-48c5-93ac-e20c28cfd6c0 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666734211647
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666734239078
= 3 failed, 19 passed, 6 skipped, 6635 deselected, 362 warnings, 2 errors in 250.97s (0:04:10) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 55s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ytfwfn26qdxge

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1037

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1037/display/redirect>

Changes:


------------------------------------------
[...truncated 50.04 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40047 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-25T15:43:08.665819393+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35231 {created_time:"2022-10-25T15:43:51.951063482+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33345 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-25T15:44:14.805804149+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45219 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-25T15:45:09.093769205+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1025154246-fe2a5bbb_393a81c7-2a36-4240-9766-4ecfcaf6dfd8 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1025154356-137ed031_9815da4a-b0bf-48c0-b81f-803e6939789a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1025154420-c1e6e374_4f1dba0b-2da0-468f-9e38-33ad51339f17 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666712632958
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666712656492
= 3 failed, 19 passed, 5 skipped, 6635 deselected, 366 warnings, 2 errors in 254.07s (0:04:14) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 8s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/c2icidsoevnro

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1036

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1036/display/redirect>

Changes:


------------------------------------------
[...truncated 49.97 MB...]
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37443 {created_time:"2022-10-25T09:46:44.968562022+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40831 {created_time:"2022-10-25T09:47:19.912620045+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35683 {created_time:"2022-10-25T09:47:45.500839371+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40127 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-25T09:48:51.732321798+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input - RuntimeError: Pipeline BeamApp-jenkins-1025094624-94059d20_799f149e-1cdd-40f4-aee2-af0e422b456a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_48, PCollection=unique_name: "90WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_6"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - RuntimeError: Pipeline BeamApp-jenkins-1025094725-c55667c5_e90445c5-44ab-46ab-9894-8b0fe4876a02 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - RuntimeError: Pipeline BeamApp-jenkins-1025094753-fdfda6ac_e1538e2d-d5ec-4d7a-a4f4-0d284c52e813 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1666691241438
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher - apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not exist: apache-beam-testing.FiltersTestIT.cold_days_1666691267209
= 3 failed, 19 passed, 5 skipped, 6635 deselected, 366 warnings, 2 errors in 237.78s (0:03:57) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zgk7b4ni6dwrc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1035

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1035/display/redirect?page=changes>

Changes:

[noreply] Bump Dataflow python containers to 20221021 (#23807)

[noreply] Allow MoreFutures.allAsList/allAsListWithExceptions to have the passed


------------------------------------------
[...truncated 49.91 MB...]
              _LOGGER.info(
                  "Job state changed to %s",
                  self.runner_api_state_to_pipeline_state(current_state))
              previous_state = current_state
          self._messages.append(message)
    
      message_thread = threading.Thread(
          target=read_messages, name='wait_until_finish_read')
      message_thread.daemon = True
      message_thread.start()
    
      if duration:
        state_thread = threading.Thread(
            target=functools.partial(self._observe_state, message_thread),
            name='wait_until_finish_state_observer')
        state_thread.daemon = True
        state_thread.start()
        start_time = time.time()
        duration_secs = duration / 1000
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1025034534-a9ed353c_971c41b9-b7a4-4a70-910f-435b51b2d2c5 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:39219
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.44.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fe9d7793b00> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fe9d7793b90> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fe9d7797320> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.44.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempog0_uwpd/artifacts9yg57uqn' '--job-port' '39763' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:31 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:31 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:41525
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:40047
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:39763
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:39763.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:34 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_f7cf5ad3-2c98-4f02-b01b-4f637ffe878c.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:34 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_f7cf5ad3-2c98-4f02-b01b-4f637ffe878c.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:34 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_f7cf5ad3-2c98-4f02-b01b-4f637ffe878c.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:34 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_f7cf5ad3-2c98-4f02-b01b-4f637ffe878c.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:34 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1025034534-a9ed353c_971c41b9-b7a4-4a70-910f-435b51b2d2c5 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@f3257c2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:34 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1025034534-a9ed353c_971c41b9-b7a4-4a70-910f-435b51b2d2c5
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:34 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 25, 2022 3:45:35 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1025034534-a9ed353c_971c41b9-b7a4-4a70-910f-435b51b2d2c5.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:126)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:99)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1666669527888.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source


apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6635 deselected, 41 warnings, 2 errors in 265.71s (0:04:25) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 22s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/6hnxrk5huavye

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1034

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1034/display/redirect?page=changes>

Changes:

[Andrew Pilloud] Publish Python nexmark metrics to influxdb

[Andrew Pilloud] Exclude nexmark from codecov, it has no tests

[noreply] Updated ipywidgets

[yathu] Bump dataflow java fn container version to  beam-master-20221022

[noreply] Benchmarking RunInference Example (#23554)

[Kiley Sok] Increate timeout for test pipelines


------------------------------------------
[...truncated 49.96 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.44.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempi8y5nlxl/artifactsbvyox4jf' '--job-port' '33431' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:57 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:58 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:34733
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:58 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:37381
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:58 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:33431
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:58 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:33431.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:48:00 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_d7addc63-a07c-4006-944d-8b4ec94c6b75.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:48:00 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_d7addc63-a07c-4006-944d-8b4ec94c6b75.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:48:00 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_d7addc63-a07c-4006-944d-8b4ec94c6b75.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:48:00 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_d7addc63-a07c-4006-944d-8b4ec94c6b75.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:48:00 PM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1024214800-7ae9724_fbd576bd-ec8d-44af-a0d7-fe0c7d9804ba with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@5197d374
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:48:01 PM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1024214800-7ae9724_fbd576bd-ec8d-44af-a0d7-fe0c7d9804ba
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:48:01 PM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:48:01 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1024214800-7ae9724_fbd576bd-ec8d-44af-a0d7-fe0c7d9804ba.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:126)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:99)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1666648073767.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38061 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-24T21:47:21.430530368+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
    for elements in elements_iterator:
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
apache_beam/examples/cookbook/filters_test.p  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
y::FiltersTest::test_filters_output_bigquery_matcher
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37155 {created_time:"2022-10-24T21:47:50.711670086+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6635 deselected, 41 warnings, 2 errors in 263.58s (0:04:23) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 50s
133 actionable tasks: 99 executed, 32 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mficng6l2ariw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1033

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1033/display/redirect?page=changes>

Changes:

[Moritz Mack] Update remaining pointers to Spark runner to Spark 3 module (addresses

[noreply] Ignoring BigQuery partitions with empty files (#23710)


------------------------------------------
[...truncated 49.92 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43505 {created_time:"2022-10-24T15:42:18.493220067+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35935 {created_time:"2022-10-24T15:42:52.056247881+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45397 {created_time:"2022-10-24T15:43:29.802382997+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39291 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-24T15:43:57.75301877+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35181 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-24T15:45:06.291206339+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6635 deselected, 364 warnings, 2 errors in 254.13s (0:04:14) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 56s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ihfdpcp72tsbc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1032

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1032/display/redirect?page=changes>

Changes:

[noreply] Remove unnecessary dependencies from jpms test (#23775)

[noreply] Use Spark 3 job-server as default Spark job-server for PortableRunner

[noreply] Support usage of custom profileName with AWS ProfileCredentialsProvider

[noreply] Migrate examples and maven-archetypes (including Java Quickstart) to


------------------------------------------
[...truncated 49.85 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.44.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-templsss3n7f/artifactsdu65ce_2' '--job-port' '48915' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:32 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:45085
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:38263
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:48915
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:48915.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:34 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_b7504bb9-30a3-4b0c-b625-cba6f8681aad.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:34 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_b7504bb9-30a3-4b0c-b625-cba6f8681aad.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:34 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_b7504bb9-30a3-4b0c-b625-cba6f8681aad.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:34 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_b7504bb9-30a3-4b0c-b625-cba6f8681aad.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:35 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1024094735-b184e15c_ca9c2c56-08b2-44c4-bf9c-48d007690b50 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@4db7fd51
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:35 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1024094735-b184e15c_ca9c2c56-08b2-44c4-bf9c-48d007690b50
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:35 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 24, 2022 9:47:36 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1024094735-b184e15c_ca9c2c56-08b2-44c4-bf9c-48d007690b50.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:126)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:99)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1666604848568.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38873 {created_time:"2022-10-24T09:46:58.375750116+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37259 {created_time:"2022-10-24T09:47:25.20254788+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 41 warnings, 2 errors in 263.94s (0:04:23) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 26s
133 actionable tasks: 93 executed, 38 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ebqoidimbxigo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1031

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1031/display/redirect>

Changes:


------------------------------------------
[...truncated 49.97 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40745 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-24T03:42:16.721718258+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33775 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-24T03:42:49.234867757+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35639 {created_time:"2022-10-24T03:43:28.841263475+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42413 {created_time:"2022-10-24T03:43:55.271033815+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36045 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-24T03:44:52.101518333+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 366 warnings, 2 errors in 253.86s (0:04:13) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 51s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/syrgheqiuviw6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1030

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1030/display/redirect>

Changes:


------------------------------------------
[...truncated 50.01 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38829 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T21:42:20.227861698+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34555 {created_time:"2022-10-23T21:42:51.090308644+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38477 {created_time:"2022-10-23T21:43:30.307614645+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35959 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T21:43:56.331314932+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39993 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T21:45:03.578696809+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 366 warnings, 2 errors in 253.51s (0:04:13) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 54s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/lmw3k5wqfbh4y

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1029

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1029/display/redirect>

Changes:


------------------------------------------
[...truncated 50.01 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42439 {created_time:"2022-10-23T15:42:17.426350287+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38227 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T15:42:49.493155321+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40035 {created_time:"2022-10-23T15:43:28.26408968+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39561 {created_time:"2022-10-23T15:43:53.928634296+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44655 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T15:45:00.835243896+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 364 warnings, 2 errors in 251.99s (0:04:11) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 50s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5k3x7rcktrky2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1028

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1028/display/redirect>

Changes:


------------------------------------------
[...truncated 50.02 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42049 {created_time:"2022-10-23T09:42:14.36642645+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43255 {created_time:"2022-10-23T09:42:43.606906361+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34751 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T09:43:20.919915486+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35813 {created_time:"2022-10-23T09:43:48.098088254+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45203 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T09:44:55.061098825+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 365 warnings, 2 errors in 247.20s (0:04:07) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 45s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/yzkc2alayae7c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1027

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1027/display/redirect>

Changes:


------------------------------------------
[...truncated 49.95 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35245 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T03:42:13.6204084+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45443 {created_time:"2022-10-23T03:42:43.828792038+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33737 {created_time:"2022-10-23T03:43:23.143838347+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39411 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-23T03:43:49.419811424+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38427 {created_time:"2022-10-23T03:44:54.686759783+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 365 warnings, 2 errors in 251.18s (0:04:11) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 42s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/joxn55s2bfsn6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1026

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1026/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #23556: Forward failed storage-api row inserts to the


------------------------------------------
[...truncated 50.14 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43469 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T21:42:10.663182398+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46351 {created_time:"2022-10-22T21:42:40.835879285+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36451 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T21:43:20.761913203+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35073 {created_time:"2022-10-22T21:43:47.327164953+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46347 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T21:44:53.533442279+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 363 warnings, 2 errors in 249.01s (0:04:09) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 47s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/n3vumymhugoz4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1025

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1025/display/redirect>

Changes:


------------------------------------------
[...truncated 49.93 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40365 {created_time:"2022-10-22T15:42:15.128142082+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36129 {created_time:"2022-10-22T15:42:45.591962814+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44235 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T15:43:24.843730273+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34811 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T15:43:50.52570743+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39905 {created_time:"2022-10-22T15:44:57.469590771+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 362 warnings, 2 errors in 251.12s (0:04:11) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 47s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/oqw4qejnoxcme

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1024

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1024/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #23795: Revert 23234: issue #23794


------------------------------------------
[...truncated 49.93 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41105 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T09:43:28.624383912+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36819 {created_time:"2022-10-22T09:44:00.870046325+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37185 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T09:44:39.981739103+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44703 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T09:45:05.777221982+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 42 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46709 {created_time:"2022-10-22T09:46:10.75235483+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 365 warnings, 2 errors in 244.72s (0:04:04) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 8m 5s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/m4qjzduhpue24

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1023

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1023/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Unskip test_generated_class_pickle for cloudpickle.

[noreply] Allow local packages in requirements.txt dependency list. (#23684)

[noreply] Revert "Update BQIO to a single scheduled executor service reduce

[noreply] Updates Python test expansion service to use Cloud Pickle (#23786)


------------------------------------------
[...truncated 50.07 MB...]
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38225 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T03:49:50.247533849+00:00"}"
>

  windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35879 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-22T03:49:50.418917623+00:00"}"
>

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:38201
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.44.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7ff5cd3bc9e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7ff5cd3bca70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7ff5cd3ba200> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.44.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempn9cngfqd/artifactsszb1v3c_' '--job-port' '57725' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:55 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:56 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:41535
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:56 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:45171
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:56 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:57725
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:56 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:56 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_9a295c0a-cbdb-472b-8e17-7f18cc5e763b.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:56 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_9a295c0a-cbdb-472b-8e17-7f18cc5e763b.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:56 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_9a295c0a-cbdb-472b-8e17-7f18cc5e763b.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:56 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_9a295c0a-cbdb-472b-8e17-7f18cc5e763b.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:57 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1022034957-111f5aeb_66df2ce5-c131-4f5a-a61b-e67da3ac07de with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@7f65449a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:57 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1022034957-111f5aeb_66df2ce5-c131-4f5a-a61b-e67da3ac07de
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:57 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 22, 2022 3:49:57 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1022034957-111f5aeb_66df2ce5-c131-4f5a-a61b-e67da3ac07de.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:126)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:99)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1666410593097.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6634 deselected, 41 warnings, 2 errors in 249.25s (0:04:09) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 45s
133 actionable tasks: 95 executed, 36 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xy535xcko6t3i

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1022

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1022/display/redirect?page=changes>

Changes:

[Moritz Mack] Remove obsolete sparkRunner task from hadoop-format: not triggered, no

[noreply] Use Flink 1.13 for load tests (#23767)

[Kenneth Knowles] Re-enable PubsubTableProviderIT.testSQLSelectsArrayAttributes

[noreply] Remove obsolete native text io translation. (#23549)

[noreply] Eliminate nullness errors from GenerateSequence (#23744)

[noreply] Add logos to case-studies "Also Used By" (#23781)

[noreply] Avoid pickling unstable reference to moved proto classes. (#23739)


------------------------------------------
[...truncated 49.93 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:126)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:99)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1666388871202.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []


Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35943 {created_time:"2022-10-21T21:47:21.134382839+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35073 {created_time:"2022-10-21T21:47:47.098840813+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41601 {created_time:"2022-10-21T21:47:48.069646758+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2518: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45707 {created_time:"2022-10-21T21:48:43.696710243+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6633 deselected, 41 warnings, 2 errors in 254.86s (0:04:14) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 42s
133 actionable tasks: 95 executed, 36 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/r2ivkudykht5w

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1021

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1021/display/redirect?page=changes>

Changes:

[noreply] bugfix/wrong-notebook-linl (#23777)

[noreply] [CdapIO] Integration CdapIO with SparkReceiverIO (#22584)

[noreply] Avoid Circular imports related to bigquery_schema_tools (#23731)


------------------------------------------
[...truncated 50.03 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33867 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T15:42:52.882167523+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:35405 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T15:43:22.526097551+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39393 {created_time:"2022-10-21T15:44:01.794287352+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46773 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T15:44:27.549692202+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 44 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40887 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T15:45:31.128599317+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6633 deselected, 367 warnings, 2 errors in 251.49s (0:04:11) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 20s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/l66jbbqtyydey

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1020

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1020/display/redirect?page=changes>

Changes:

[noreply] Adds instructions for running the Multi-language Java quickstart from

[noreply] Remove Spark2 from Java testing projects (addresses #23728) (#23749)


------------------------------------------
[...truncated 49.92 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:44309 {created_time:"2022-10-21T09:42:35.79338219+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34291 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T09:43:12.150527898+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2510: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:33935 {created_time:"2022-10-21T09:43:55.630253087+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36789 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T09:44:34.762725139+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34811 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T09:45:56.849747853+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6633 deselected, 366 warnings, 2 errors in 300.55s (0:05:00) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 54s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vev6dkv466bqw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1019

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1019/display/redirect?page=changes>

Changes:

[riteshghorse] fix lints

[noreply] Update google cloud vision >= 2.0.0 (#23755)

[noreply] Update GcsIO initialization to support converting input parameters to


------------------------------------------
[...truncated 49.95 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38077 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T03:42:58.122095787+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39307 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-21T03:43:33.446702153+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2510: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34935 {created_time:"2022-10-21T03:44:18.455835341+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34627 {created_time:"2022-10-21T03:44:46.841978399+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.10/threading.py", line 946, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42447 {created_time:"2022-10-21T03:45:53.954922507+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py310.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 5 skipped, 6633 deselected, 364 warnings, 2 errors in 281.71s (0:04:41) =

> Task :sdks:python:test-suites:portable:py310:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 7m 44s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/nmyhrk3msfly6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1018

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1018/display/redirect?page=changes>

Changes:

[noreply] Issue#23599 Updated dataframe notebook

[noreply] Added a missing line break.

[Kenneth Knowles] Verify that secondary key coder is deterministic in SortValues

[Chamikara Madhusanka Jayalath] Updating Python dependencies for the 2.43.0 release

[Chamikara Madhusanka Jayalath] Moving to 2.44.0-SNAPSHOT on master branch.

[noreply] Update the timeout in ValidatesContainer suite. (#23732)


------------------------------------------
[...truncated 29.29 MB...]
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

Exception in thread run_worker_2-1:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
    for work_request in self._control_stub.Control(get_responses()):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Runner closed connection"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:46561 {grpc_message:"Runner closed connection", grpc_status:1, created_time:"2022-10-20T21:44:10.351061507+00:00"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/autocomplete_it_test.py::AutocompleteIT::test_autocomplete_output_files_on_small_input
FAILED apache_beam/examples/complete/estimate_pi_it_test.py::EstimatePiIT::test_estimate_pi_output_file
FAILED apache_beam/examples/complete/top_wikipedia_sessions_it_test.py::ComputeTopSessionsIT::test_top_wikipedia_sessions_output_files_on_small_input
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
FAILED apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
ERROR apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
ERROR apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
= 10 failed, 12 passed, 5 skipped, 6633 deselected, 40 warnings, 5 errors in 184.05s (0:03:04) =
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "Socket closed"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:42911 {grpc_message:"Socket closed", grpc_status:14, created_time:"2022-10-20T21:46:05.92439581+00:00"}"
>

> Task :sdks:python:test-suites:portable:py310:flinkExamples
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.io.network.buffer.NetworkBufferPool <init>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting the network environment and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.taskexecutor.KvStateService start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting the kvState service and its components.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.configuration.Configuration loggingFallback
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Config uses fallback configuration key 'akka.ask.timeout' instead of key 'taskmanager.slot.timeout'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 .
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Start job leader service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.filecache.FileCache <init>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: User file cache uses directory /tmp/flink-dist-cache-5ba58606-0a09-42e9-9b1b-604df94b64d7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting rest endpoint.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Log file environment variable 'log.file' is not set.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Rest endpoint listening at localhost:40765
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Proposing leadership to contender http://localhost:40765
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint startInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Web frontend listening at http://localhost:40765.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint grantLeadership
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: http://localhost:40765 was granted leadership with leaderSessionID=55042a60-7e61-4d17-ba27-b585f1c77d7d
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:45:57 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1017

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1017/display/redirect?page=changes>

Changes:

[thiagotnunes] tests: fixes SpannerIO unavailable retry test

[noreply] Remove yeandy from reviewers (#23753)

[noreply] Revert bigdataoss version upgrade (#23727)


------------------------------------------
[...truncated 48.90 MB...]
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:40777 {created_time:"2022-10-20T15:55:47.863632863+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/autocomplete_it_test.py::AutocompleteIT::test_autocomplete_output_files_on_small_input
FAILED apache_beam/examples/complete/estimate_pi_it_test.py::EstimatePiIT::test_estimate_pi_output_file
FAILED apache_beam/examples/complete/top_wikipedia_sessions_it_test.py::ComputeTopSessionsIT::test_top_wikipedia_sessions_output_files_on_small_input
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
FAILED apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
ERROR apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
ERROR apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
= 10 failed, 12 passed, 5 skipped, 6633 deselected, 40 warnings, 5 errors in 204.20s (0:03:24) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 19m 39s
133 actionable tasks: 130 executed, 2 from cache, 1 up-to-date

Publishing build scan...
https://gradle.com/s/bkuphwggxicb4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1016

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1016/display/redirect?page=changes>

Changes:

[noreply] Speed up check on website links (#23737)


------------------------------------------
[...truncated 16.04 MB...]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1457, in process
    raise ValueError('Expected size >= 0 but received %s.' % size)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 333, in __init__
    self.client = client or bigquery.BigqueryV2(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 51, in __init__
    super().__init__(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 153, in GetCredentials
    credentials = CredentialsFromFile(credentials_filename, client_info,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/capture.py",> line 192, in read
    raise OSError(
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read corpus/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']

ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:291 Error processing instruction 128. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1457, in process
    raise ValueError('Expected size >= 0 but received %s.' % size)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 333, in __init__
    self.client = client or bigquery.BigqueryV2(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 51, in __init__
    super().__init__(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 153, in GetCredentials
    credentials = CredentialsFromFile(credentials_filename, client_info,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/capture.py",> line 192, in read
    raise OSError(
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
    input_op_by_transform_id[element.transform_id].process_encoded(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1457, in process
    raise ValueError('Expected size >= 0 but received %s.' % size)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 333, in __init__
    self.client = client or bigquery.BigqueryV2(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 51, in __init__
    super().__init__(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 153, in GetCredentials
    credentials = CredentialsFromFile(credentials_filename, client_info,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/capture.py",> line 192, in read
    raise OSError(
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read_words/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']


FAILED                                                                   [ 56%]
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it ERROR [ 56%]
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:41123
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fbb6c4ed240> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fbb6c4ed2d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fbb6c4eda20> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempym4q0k00/artifacts8nul3n79' '--job-port' '33819' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:11 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:12 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:34175
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:12 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:37373
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:12 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:33819
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:12 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:33819.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:14 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_84ad6793-3f73-4ca2-a28c-ffd1079ad53f.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:14 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_84ad6793-3f73-4ca2-a28c-ffd1079ad53f.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:14 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_84ad6793-3f73-4ca2-a28c-ffd1079ad53f.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 20, 2022 9:43:14 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_84ad6793-3f73-4ca2-a28c-ffd1079ad53f.

> Task :sdks:python:test-suites:portable:py37:flinkExamples
ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:294 Error processing instruction 20. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1015

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1015/display/redirect?page=changes>

Changes:

[noreply] Support TIMESTAMP type in BigQueryIO with BEAM_ROW output type, and in

[noreply] Add PytorchBatchConverter (#23296)

[noreply] Pin version to grpcio in build-requirements.txt (#23735)

[noreply] Bump up python container versions. (#23716)

[noreply] Reduce log flood in Python PostCommit flink task (#23635)


------------------------------------------
[...truncated 55.18 MB...]
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 193. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 196. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 201. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 203. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 206. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.



> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 31s
133 actionable tasks: 88 executed, 43 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/o6wgy7d77wsfu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1014

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1014/display/redirect?page=changes>

Changes:

[noreply] Update release instructions in Python 3.10 (#23702)

[noreply] Move Tensorflow Documentation (#23729)

[noreply] Bump golang.org/x/text from 0.3.7 to 0.4.0 in /sdks (#23686)

[noreply] Unit Content markdown styles (#23592) (#23662)

[noreply] Add reopen issue command (#23733)

[noreply] Add example of real time Anomaly Detection using RunInference (#23497)


------------------------------------------
[...truncated 54.00 MB...]
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 153. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 164. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 160. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 162. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.



> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 15m 47s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mvoi7vhfvszoc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1013

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1013/display/redirect?page=changes>

Changes:

[Moritz Mack] Keep Spark version in a single place only (BeamModulePlugin)

[noreply] [Playground] Examples CD (#23664)


------------------------------------------
[...truncated 47.37 MB...]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/autocomplete_it_test.py::AutocompleteIT::test_autocomplete_output_files_on_small_input
FAILED apache_beam/examples/complete/estimate_pi_it_test.py::EstimatePiIT::test_estimate_pi_output_file
FAILED apache_beam/examples/complete/top_wikipedia_sessions_it_test.py::ComputeTopSessionsIT::test_top_wikipedia_sessions_output_files_on_small_input
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
FAILED apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
ERROR apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
ERROR apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
= 10 failed, 12 passed, 4 skipped, 6632 deselected, 40 warnings, 5 errors in 216.06s (0:03:36) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 16m 41s
133 actionable tasks: 99 executed, 32 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ckuafnvc2z7jy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1012

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1012/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #23510: Vortex multiplexing streams

[noreply] Io jms fix ack message checkpoint (#22932)


------------------------------------------
[...truncated 16.87 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:40 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:40 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:42523
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:40 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:44899
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:40 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:42085
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:40 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:40 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_bb18ffc5-6e57-4904-8d00-ef7754a170c8.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:40 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_bb18ffc5-6e57-4904-8d00-ef7754a170c8.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:41 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_bb18ffc5-6e57-4904-8d00-ef7754a170c8.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:41 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_bb18ffc5-6e57-4904-8d00-ef7754a170c8.

> Task :sdks:python:test-suites:portable:py310:flinkExamples
FAILED                                                                   [ 56%]
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it ERROR [ 56%]
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:38895
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f40b37ed000> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f40b37ed090> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f40b37ed7e0> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempv__wpnof/artifacts65emoncr' '--job-port' '41549' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:43 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:44 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:46283
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:44 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:34439
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:44 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:41549
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:44 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:44 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_7ee1bd24-ae0b-41fa-b885-e040aa305991.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:44 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_7ee1bd24-ae0b-41fa-b885-e040aa305991.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:44 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_7ee1bd24-ae0b-41fa-b885-e040aa305991.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:44 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_7ee1bd24-ae0b-41fa-b885-e040aa305991.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:45 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1019094344-8d367dc_a5df4eb9-ec32-4155-aa59-c1890e2b00d5 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@1974b45a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:45 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1019094344-8d367dc_a5df4eb9-ec32-4155-aa59-c1890e2b00d5
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:452 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:45 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:45 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1019094344-8d367dc_a5df4eb9-ec32-4155-aa59-c1890e2b00d5.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:574 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_52, PCollection=unique_name: "61Write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:581 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:93 Clean up a BigQuery table with project: apache-beam-testing, dataset: BigQueryTornadoesIT, table: monthly_tornadoes_1666172621178.
FAILED                                                                   [ 60%]
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it ERROR [ 60%]
apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input 
-------------------------------- live log call ---------------------------------
INFO     root:coders_it_test.py:48 Creating file: gs://temp-storage-for-end-to-end-tests/py-it-cloud/input/e6796d06-a958-40fc-b14d-824013105694/input.txt
ERROR    apache_beam.io.gcp.gcsio:gcsio.py:767 Error in _start_upload while inserting file gs://temp-storage-for-end-to-end-tests/py-it-cloud/input/e6796d06-a958-40fc-b14d-824013105694/input.txt: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 763, in _start_upload
    self._client.objects.Insert(self._insert_request, upload=self._upload)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py",> line 1152, in Insert
    return self._RunMethod(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 714, in _RunMethod
    http_response = upload.InitializeUpload(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/transfer.py",> line 896, in InitializeUpload
    raise exceptions.HttpError.FromResponse(http_response)
apitools.base.py.exceptions.HttpUnauthorizedError: HttpError accessing <https://www.googleapis.com/resumable/upload/storage/v1/b/temp-storage-for-end-to-end-tests/o?alt=json&name=py-it-cloud%2Finput%2Fe6796d06-a958-40fc-b14d-824013105694%2Finput.txt&uploadType=resumable>: response: <{'x-guploader-uploadid': 'ADPycdstTfOvuoyhQQ2xm5xdzRaVrm9vnZ9CU_ehApnUHrzIQ5o15XhHdiFeChnBl_7PTMxrmJAWCao_4kEJ4bUxVyP8WJ_Mfyn3', 'date': 'Wed, 19 Oct 2022 09:43:46 GMT', 'vary': 'Origin, X-Origin', 'www-authenticate': 'Bearer realm="https://accounts.google.com/"', 'cache-control': 'no-cache, no-store, max-age=0, must-revalidate', 'expires': 'Mon, 01 Jan 1990 00:00:00 GMT', 'pragma': 'no-cache', 'content-length': '438', 'server': 'UploadServer', 'content-type': 'text/html; charset=UTF-8', 'status': '401'}>, content <{
  "error": {
    "code": 401,
    "message": "Anonymous caller does not have storage.objects.create access to the Google Cloud Storage object.",
    "errors": [
      {
        "message": "Anonymous caller does not have storage.objects.create access to the Google Cloud Storage object.",
        "domain": "global",
        "reason": "required",
        "locationType": "header",
        "location": "Authorization"
      }
    ]
  }
}
>

FAILED                                                                   [ 65%]
apache_beam/examples/cookbook/custom_ptransform_test.py::CustomCountTest::test_custom_ptransform_output_files_on_small_input 
-------------------------------- live log call ---------------------------------
INFO     root:custom_ptransform_test.py:41 Creating temp file: /tmp/tmp23yjz5f8/input.txt
INFO     root:custom_ptransform.py:48 Running first pipeline
INFO     root:pipeline.py:185 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f40b37ec9d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f40b37ecaf0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f40b37ed000> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f40b37ed090> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f40b37ed240> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f40b37ed2d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f40b37ed3f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f40b37ed480> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f40b37ed510> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f40b37ed5a0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f40b37ed7e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f40b37ed900> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f40b37ed750> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f40b37ed870> ====================
INFO     apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600
INFO     apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f407be4ffa0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO     apache_beam.io.filebasedsink:filebasedsink.py:310 Starting finalize_write threads with num_shards: 1 (skipped: 0), batches: 1, num_threads: 1
INFO     apache_beam.io.filebasedsink:filebasedsink.py:358 Renamed 1 shards in 0.00 seconds.
INFO     root:custom_ptransform.py:67 Running second pipeline
INFO     root:pipeline.py:185 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f40b37ec9d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f40b37ecaf0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f40b37ed000> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f40b37ed090> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f40b37ed240> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f40b37ed2d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f40b37ed3f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f40b37ed480> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f40b37ed510> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f40b37ed5a0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f40b37ed7e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f40b37ed900> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f40b37ed750> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f40b37ed870> ====================
INFO     apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600
INFO     apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f4068363f10> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
WARNING  apache_beam.io.filebasedsink:filebasedsink.py:230 Deleting 1 existing files in target path matching: -*-of-%(num_shards)05d
INFO     apache_beam.io.filebasedsink:filebasedsink.py:310 Starting finalize_write threads with num_shards: 1 (skipped: 0), batches: 1, num_threads: 1
INFO     apache_beam.io.filebasedsink:filebasedsink.py:358 Renamed 1 shards in 0.00 seconds.
INFO     root:custom_ptransform.py:94 Running third pipeline
INFO     root:pipeline.py:185 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f40b37ec9d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f40b37ecaf0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f40b37ed000> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f40b37ed090> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f40b37ed240> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f40b37ed2d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f40b37ed3f0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f40b37ed480> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f40b37ed510> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f40b37ed5a0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f40b37ed7e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f40b37ed900> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f40b37ed750> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f40b37ed870> ====================
INFO     apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600
INFO     apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f4080f502b0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
WARNING  apache_beam.io.filebasedsink:filebasedsink.py:230 Deleting 1 existing files in target path matching: -*-of-%(num_shards)05d
INFO     apache_beam.io.filebasedsink:filebasedsink.py:310 Starting finalize_write threads with num_shards: 1 (skipped: 0), batches: 1, num_threads: 1
INFO     apache_beam.io.filebasedsink:filebasedsink.py:358 Renamed 1 shards in 0.00 seconds.
PASSED                                                                   [ 69%]
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher 
-------------------------------- live log call ---------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:36681
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.10_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f40b37ed000> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f40b37ed090> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f40b37ed7e0> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempeuq5svax/artifactssojse9rc' '--job-port' '54121' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:50 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:51 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:38059
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:51 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:34501
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:51 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:54121
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:51 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:95 Waiting for grpc channel to be ready at localhost:54121.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:53 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_4d31bc41-54aa-40d0-979b-60b2c0427470.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:53 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_4d31bc41-54aa-40d0-979b-60b2c0427470.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:53 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_4d31bc41-54aa-40d0-979b-60b2c0427470.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:53 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_4d31bc41-54aa-40d0-979b-60b2c0427470.

> Task :sdks:python:test-suites:portable:py37:flinkExamples
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:41 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1019094341-27599187_4cb52bdd-a4e1-4e3c-8954-d5e9cc922bb8 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@1d25a27f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:41 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1019094341-27599187_4cb52bdd-a4e1-4e3c-8954-d5e9cc922bb8
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:41 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:42 AM org.apache.beam.runners.flink.FlinkExecutionEnvironments createBatchExecutionEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Creating a Batch Execution Environment.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:42 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:42 AM org.apache.flink.api.java.utils.PlanGenerator logTypeRegistrationDetails
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: The job has 0 registered types and 0 default Kryo serializers
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:42 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: The configuration option taskmanager.cpu.cores required for local execution is not set, setting it to the maximal possible value.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:42 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: The configuration option taskmanager.memory.task.heap.size required for local execution is not set, setting it to the maximal possible value.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:42 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: The configuration option taskmanager.memory.task.off-heap.size required for local execution is not set, setting it to the maximal possible value.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 19, 2022 9:43:42 AM org.apache.flink.runtime.taskexecutor.TaskExecutorResourceUtils setConfigOptionToDefaultIfNotSet
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1011

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1011/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Remove numpy C API dep from public declarations.

[noreply] add expansion service option (#23712)

[noreply] Downgrade container cryptography version to avoid yanked version

[noreply] Update portable runner test timeout (#23696)


------------------------------------------
[...truncated 56.20 MB...]
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 224. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 220. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 179. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 221. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.7/queue.py", line 178, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 993, in process_bundle
    expected_inputs):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.



> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py310:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 39s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fv54rs7nsk72c

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1010

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1010/display/redirect?page=changes>

Changes:

[Andrew Pilloud] Migrate nexmark to common config for cron jobs

[Kiley Sok] beam-perf

[Kiley Sok] fix

[noreply] Bump google.golang.org/grpc from 1.50.0 to 1.50.1 in /sdks (#23654)

[noreply] [Playground][Frontend] Tags filter for Examples Catalog (#22074)

[noreply] [Go SDK] Extract output coders in expandCrossLanguage (#23641)

[noreply] Python 3.10 support (#23587)

[noreply] Fixes #22192: Avoids nullpointer error. Preserves previous behavior.

[noreply] Deflaking tests for BQ row insertions. These tests were flaky due to

[noreply] Add java 11 home to jenkins test (#23708)

[noreply] enable automatic expansion service (#23699)


------------------------------------------
[...truncated 17.96 MB...]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 343, in result
    raise self
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_interceptor.py",> line 241, in continuation
    response, call = self._thunk(new_method).with_call(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 957, in with_call
    return _end_unary_response_blocking(state, call, True, None)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:43185: Failed to connect to remote host: Connection refused"
	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:43185: Failed to connect to remote host: Connection refused {created_time:"2022-10-18T21:42:56.134680889+00:00", grpc_status:14}"
>


ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:291 Error processing instruction 195. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 627, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 460, in get
    self.fns[bundle_descriptor_id],
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1360, in __missing__
    self[key] = self.default_factory(key)  # type: ignore # pylint: disable=E1137
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 202, in default_factory
    return self._control_stub.GetProcessBundleDescriptor(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_interceptor.py",> line 216, in __call__
    response, ignored_call = self._with_call(request,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_interceptor.py",> line 257, in _with_call
    return call.result(), call
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 343, in result
    raise self
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_interceptor.py",> line 241, in continuation
    response, call = self._thunk(new_method).with_call(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 957, in with_call
    return _end_unary_response_blocking(state, call, True, None)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:43185: Failed to connect to remote host: Connection refused"
	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:43185: Failed to connect to remote host: Connection refused {grpc_status:14, created_time:"2022-10-18T21:42:56.147754181+00:00"}"
>


ERROR    apache_beam.runners.worker.sdk_worker:sdk_worker.py:291 Error processing instruction 196. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 627, in process_bundle
    bundle_processor = self.bundle_processor_cache.get(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 460, in get
    self.fns[bundle_descriptor_id],
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 1360, in __missing__
    self[key] = self.default_factory(key)  # type: ignore # pylint: disable=E1137
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 202, in default_factory
    return self._control_stub.GetProcessBundleDescriptor(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_interceptor.py",> line 216, in __call__
    response, ignored_call = self._with_call(request,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_interceptor.py",> line 257, in _with_call
    return call.result(), call
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 343, in result
    raise self
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_interceptor.py",> line 241, in continuation
    response, call = self._thunk(new_method).with_call(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 957, in with_call
    return _end_unary_response_blocking(state, call, True, None)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/grpc/_channel.py",> line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.UNAVAILABLE
	details = "failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:43185: Failed to connect to remote host: Connection refused"
	debug_error_string = "UNKNOWN:failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:43185: Failed to connect to remote host: Connection refused {created_time:"2022-10-18T21:42:56.1605723+00:00", grpc_status:14}"
>


ERROR    root:portable_runner.py:574 java.lang.RuntimeException: Error received from SDK harness for instruction 34: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1457, in process
    raise ValueError('Expected size >= 0 but received %s.' % size)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 333, in __init__
    self.client = client or bigquery.BigqueryV2(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 51, in __init__
    super().__init__(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 153, in GetCredentials
    credentials = CredentialsFromFile(credentials_filename, client_info,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/capture.py",> line 192, in read
    raise OSError(
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1003, in process_bundle
    input_op_by_transform_id[element.transform_id].process_encoded(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 623, in invoke_process
    self.output_handler.handle_process_outputs(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1457, in process
    raise ValueError('Expected size >= 0 but received %s.' % size)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 333, in __init__
    self.client = client or bigquery.BigqueryV2(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 51, in __init__
    super().__init__(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 153, in GetCredentials
    credentials = CredentialsFromFile(credentials_filename, client_info,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/_pytest/capture.py",> line 192, in read
    raise OSError(
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read_words/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']


> Task :sdks:python:test-suites:portable:py37:flinkExamples
ERROR    apache_beam.runners.worker.data_plane:data_plane.py:661 Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 809, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38755 {created_time:"2022-10-18T21:43:10.657273334+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
ERROR    root:portable_runner.py:577 java.lang.RuntimeException: Error received from SDK harness for instruction 40: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1009

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1009/display/redirect?page=changes>

Changes:

[noreply] [GitHub Actions] - Run RC Validations Workflow  (#23531)

[noreply] Add workflow to update milestone on issue close (#23629)

[noreply] add website page about data processing for ML (#23552)

[noreply] [Go SDK] Dataframe API wrapper  (#23450)

[noreply] [Go SDK]: Adds Automated Python Expansion Service (#23582)

[noreply] Include CombineFn's in __all__ (#23685)


------------------------------------------
[...truncated 19.00 MB...]
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']


ERROR    apache_beam.runners.worker.data_plane:data_plane.py:661 Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 809, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:38723 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-18T15:46:50.282787431+00:00"}"
>
ERROR    root:portable_runner.py:577 java.lang.RuntimeException: Error received from SDK harness for instruction 21: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']

FAILED                                                                   [ 95%]
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays ERROR [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics 
-------------------------------- live log call ---------------------------------
INFO     root:pipeline.py:188 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_139785044600720], ComputedExpression[set_index_DataFrame_139785415174160], ComputedExpression[pre_combine_sum_DataFrame_139785882707920]]:139785849371472]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_139785068622480]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_139785044600720], ComputedExpression[set_index_DataFrame_139785415174160], ComputedExpression[pre_combine_sum_DataFrame_139785882707920]], outputs={PlaceholderExpression[placeholder_DataFrame_139785068622480], ComputedExpression[pre_combine_sum_DataFrame_139785882707920]}]
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_139785842824976]]:139785835738448]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_139785882707920]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_139785842824976]], outputs={ComputedExpression[post_combine_sum_DataFrame_139785842824976]}]
INFO     apache_beam.io.fileio:fileio.py:595 Added temporary directory /tmp/.temp4c017abd-9086-4f20-9cf0-adc560b4bd3d
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f22982af440> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f22982af560> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f22982afa70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f22982afb00> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f22982afcb0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f22982afd40> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f22982afe60> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f22982afef0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f22982aff80> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f22982b1050> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f22982b1290> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f22982b13b0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f22982b1200> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f22982b1320> ====================
INFO     apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600
INFO     apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:908 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f223f7271d0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')

> Task :sdks:python:test-suites:portable:py39:flinkExamples
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_140056495068736], ComputedExpression[set_index_DataFrame_140054880547984], ComputedExpression[pre_combine_sum_DataFrame_140054842749424]]:140054844778000]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_140056495845824]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_140056495068736], ComputedExpression[set_index_DataFrame_140054880547984], ComputedExpression[pre_combine_sum_DataFrame_140054842749424]], outputs={PlaceholderExpression[placeholder_DataFrame_140056495845824], ComputedExpression[pre_combine_sum_DataFrame_140054842749424]}]
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_140054842752592]]:140054844778528]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_140054842749424]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_140054842752592]], outputs={ComputedExpression[post_combine_sum_DataFrame_140054842752592]}]
INFO     apache_beam.io.fileio:fileio.py:595 Added temporary directory /tmp/.temp4c909911-67e7-48d9-b0fe-64151bacbb2d
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f6125cabee0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f6125f1f040> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f6125f1f550> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f6125f1f5e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f6125f1f790> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f6125f1f820> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f6125f1f940> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f6125f1f9d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f6125f1fa60> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f6125f1faf0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f6125f1fd30> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f6125f1fe50> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f6125f1fca0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f6125f1fdc0> ====================
INFO     apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600
INFO     apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f611437b7f0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
INFO     apache_beam.io.fileio:fileio.py:677 Moving temporary file /tmp/.temp4c909911-67e7-48d9-b0fe-64151bacbb2d/6211467017578388091_327142f9-7736-45e9-bb31-4662aab2dd25 to dir: /tmp as tmpoomvtohf.result-00000-of-00001. Res: FileResult(file_name='/tmp/.temp4c909911-67e7-48d9-b0fe-64151bacbb2d/6211467017578388091_327142f9-7736-45e9-bb31-4662aab2dd25', shard_index=-1, total_shards=0, window=GlobalWindow, pane=None, destination=None)
PASSED                                                                   [100%]

==================================== ERRORS ====================================
_ ERROR at teardown of UserScoreIT.test_userscore_output_checksum_on_small_input _

java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1008

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1008/display/redirect?page=changes>

Changes:

[Alexey Romanenko] [TPC-DS] Use "nonpartitioned" input for Jenkins jobs

[noreply] Update scopes to match the existing set and update test to clear


------------------------------------------
[...truncated 19.77 MB...]

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']


ERROR    apache_beam.runners.worker.data_plane:data_plane.py:661 Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 809, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:38039 {created_time:"2022-10-18T09:47:41.874772347+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
ERROR    root:portable_runner.py:577 java.lang.RuntimeException: Error received from SDK harness for instruction 48: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']

FAILED                                                                   [ 95%]
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays ERROR [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics 
-------------------------------- live log call ---------------------------------
INFO     root:pipeline.py:188 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_140229164748176], ComputedExpression[set_index_DataFrame_140229546772496], ComputedExpression[pre_combine_sum_DataFrame_140229595290320]]:140229979138832]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_140229545666384]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_140229164748176], ComputedExpression[set_index_DataFrame_140229546772496], ComputedExpression[pre_combine_sum_DataFrame_140229595290320]], outputs={PlaceholderExpression[placeholder_DataFrame_140229545666384], ComputedExpression[pre_combine_sum_DataFrame_140229595290320]}]
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_140231738091728]]:140229979139472]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_140229595290320]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_140231738091728]], outputs={ComputedExpression[post_combine_sum_DataFrame_140231738091728]}]
INFO     apache_beam.io.fileio:fileio.py:595 Added temporary directory /tmp/.temp37f2e851-3451-46de-a62e-10d28c055594
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev

> Task :sdks:python:test-suites:portable:py39:flinkExamples
PASSED                                                                   [100%]

==================================== ERRORS ====================================
_ ERROR at teardown of UserScoreIT.test_userscore_output_checksum_on_small_input _

java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1007

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1007/display/redirect?page=changes>

Changes:

[noreply] Improved test coverage and fix the implementation of Inject and CoGBK

[noreply] Fix python log_level_overrides cannot be used on flink and other

[noreply] Better error for disabling runner v2 with cross language pipelines.


------------------------------------------
[...truncated 18.68 MB...]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']


ERROR    root:portable_runner.py:577 java.lang.RuntimeException: Error received from SDK harness for instruction 9: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']

FAILED                                                                   [ 95%]
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays ERROR [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics 
-------------------------------- live log call ---------------------------------
INFO     root:pipeline.py:188 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.

> Task :sdks:python:test-suites:portable:py39:flinkExamples
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_140451724980480], ComputedExpression[set_index_DataFrame_140451724283328], ComputedExpression[pre_combine_sum_DataFrame_140451729602976]]:140451724890752]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_140451687878960]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_140451724980480], ComputedExpression[set_index_DataFrame_140451724283328], ComputedExpression[pre_combine_sum_DataFrame_140451729602976]], outputs={PlaceholderExpression[placeholder_DataFrame_140451687878960], ComputedExpression[pre_combine_sum_DataFrame_140451729602976]}]
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_140451729603120]]:140451724893152]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_140451729602976]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_140451729603120]], outputs={ComputedExpression[post_combine_sum_DataFrame_140451729603120]}]
INFO     apache_beam.io.fileio:fileio.py:595 Added temporary directory /tmp/.temp5ddbf9f6-91dd-42b4-8b5e-0698fd4e3126
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7fbd8634bee0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7fbd8649b040> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fbd8649b550> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fbd8649b5e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7fbd8649b790> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7fbd8649b820> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7fbd8649b940> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7fbd8649b9d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7fbd8649ba60> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7fbd8649baf0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fbd8649bd30> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7fbd8649be50> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7fbd8649bca0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7fbd8649bdc0> ====================
INFO     apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600
INFO     apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:903 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7fbdcf321280> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
PASSED                                                                   [100%]

==================================== ERRORS ====================================
_ ERROR at teardown of UserScoreIT.test_userscore_output_checksum_on_small_input _

args = (['gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/f481e015-96a0-476e-980b-1a8478af1bb5/results*'],)
kwargs = {}
retry_intervals = <generator object FuzzedExponentialIntervals.__iter__ at 0x7fbdcf2d0f20>
exn_traceback = None, sleep_interval = 15.162754899339008

java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1006

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1006/display/redirect?page=changes>

Changes:

[noreply] 2.42.0 Release Blog Post  (#23406)

[noreply] Docs for state in go (#22965)

[noreply] Fix typo in 2.42.0 blog.

[noreply] Adjust 2.42.0 publishing time.

[noreply] Adds a Java RunInference example (#23619)

[noreply] Fixes #23627: Speed up website checks (#23673)

[noreply] Suppress a FloatingPointLiteralPrecision error (#23667)


------------------------------------------
[...truncated 54.24 MB...]
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 194. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 200. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 203. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 212. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 197. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 163. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.



> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 38s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rpsac4btbcgfo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1005

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1005/display/redirect?page=changes>

Changes:

[Moritz Mack] [Jenkins,Spark] Stop running Nexmark suite for deprecated Spark 2 runner

[noreply] [Playground] Examples CI (#23476)

[noreply] [Tour Of Beam] README update (#23318)

[noreply] Bump google.golang.org/api from 0.98.0 to 0.99.0 in /sdks (#23655)

[noreply] Fix  beam_PerformanceTests_PubsubIOIT_Python_Streaming (#23607)


------------------------------------------
[...truncated 19.59 MB...]
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']


ERROR    apache_beam.runners.worker.data_plane:data_plane.py:661 Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 809, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:36455 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-17T15:46:33.292435479+00:00"}"
>
ERROR    root:portable_runner.py:577 java.lang.RuntimeException: Error received from SDK harness for instruction 39: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']

FAILED                                                                   [ 95%]
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays ERROR [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics 
-------------------------------- live log call ---------------------------------
INFO     root:pipeline.py:188 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_140694273553744], ComputedExpression[set_index_DataFrame_140694275316624], ComputedExpression[pre_combine_sum_DataFrame_140694300103248]]:140694289858320]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_140694274099664]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_140694273553744], ComputedExpression[set_index_DataFrame_140694275316624], ComputedExpression[pre_combine_sum_DataFrame_140694300103248]], outputs={ComputedExpression[pre_combine_sum_DataFrame_140694300103248], PlaceholderExpression[placeholder_DataFrame_140694274099664]}]
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_140694302787280]]:140694279510352]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_140694300103248]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_140694302787280]], outputs={ComputedExpression[post_combine_sum_DataFrame_140694302787280]}]
INFO     apache_beam.io.fileio:fileio.py:595 Added temporary directory /tmp/.temp5fe3c03d-65e6-4d82-a231-d38186327d64
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7ff638f32320> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7ff638f32440> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7ff638f32950> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7ff638f329e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7ff638f32b90> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7ff638f32c20> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7ff638f32d40> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7ff638f32dd0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7ff638f32e60> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7ff638f32ef0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7ff638f34170> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7ff638f34290> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7ff638f340e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7ff638f34200> ====================
INFO     apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600
INFO     apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:908 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7ff5f0f54450> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')

> Task :sdks:python:test-suites:portable:py39:flinkExamples
PASSED                                                                   [100%]

==================================== ERRORS ====================================
_ ERROR at teardown of UserScoreIT.test_userscore_output_checksum_on_small_input _

args = (['gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/ef5959d1-5c73-4a82-8c68-5d8581e82713/results*'],)
kwargs = {}
retry_intervals = <generator object FuzzedExponentialIntervals.__iter__ at 0x7fa16cc330b0>
exn_traceback = None, sleep_interval = 12.965849604516958

    @functools.wraps(fun)
    def wrapper(*args, **kwargs):
      retry_intervals = iter(
          FuzzedExponentialIntervals(
              initial_delay_secs,
              num_retries,
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1004

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1004/display/redirect>

Changes:


------------------------------------------
[...truncated 33.45 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (4/16)#0 (cf55ea2bca889d645cb1168e0d7159d6), deploy into slot with allocation id de35331f464d11cb7ce4328119fcdd6e.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (12/16) (attempt #0) with attempt id a8d6c6d4bc441f11633ea0aea02449b0 and vertex id 0d19d4b3dcddff300e2ff1a4dbbcc442_11 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 1fb8a61a2cd31abe4c4b6a1103719b82
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (4/16)#0 (cf55ea2bca889d645cb1168e0d7159d6) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 4b6729db2970e5d017d0c95236b33ec7.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (13/16) (1e569de6b8d9df354d3604f7687b3e93) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (4/16)#0 (cf55ea2bca889d645cb1168e0d7159d6) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (13/16) (attempt #0) with attempt id 1e569de6b8d9df354d3604f7687b3e93 and vertex id 0d19d4b3dcddff300e2ff1a4dbbcc442_12 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 3b0780ff2b6157dc4214b80fba838285
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (14/16) (f5336169c3c6157837b4dec4c01614f6) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (4/16)#0 (cf55ea2bca889d645cb1168e0d7159d6) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (14/16) (attempt #0) with attempt id f5336169c3c6157837b4dec4c01614f6 and vertex id 0d19d4b3dcddff300e2ff1a4dbbcc442_13 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id f5946e052106a4302d52b9597464de25
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (4/16)#0 (cf55ea2bca889d645cb1168e0d7159d6) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (15/16) (1e0e7421c34fbaf16091e5ab37975260) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (15/16) (attempt #0) with attempt id 1e0e7421c34fbaf16091e5ab37975260 and vertex id 0d19d4b3dcddff300e2ff1a4dbbcc442_14 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 84d081060832bf6bac3f03b338de3049
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (16/16) (8fca496558ce6f9fc4113ee3c133235a) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (16/16) (attempt #0) with attempt id 8fca496558ce6f9fc4113ee3c133235a and vertex id 0d19d4b3dcddff300e2ff1a4dbbcc442_15 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 343f7fbd49230a04b48c1e9b128a85b7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (5/16)#0 (8a4b64833ef69ae8b6ee621b7fbb7817), deploy into slot with allocation id 4b6729db2970e5d017d0c95236b33ec7.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (1/16) (774bf5dc8ad535e55c7085b80308c5fa) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (1/16) (attempt #0) with attempt id 774bf5dc8ad535e55c7085b80308c5fa and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_0 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 5d8c279e8476e00e1893e8d9388bf873
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (5/16)#0 (8a4b64833ef69ae8b6ee621b7fbb7817) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot e3dcab42cbcb6c8f2c3708edfec6a307.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (5/16)#0 (8a4b64833ef69ae8b6ee621b7fbb7817) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (2/16) (35be888c1188f1343e8076251b0f89bd) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (2/16) (attempt #0) with attempt id 35be888c1188f1343e8076251b0f89bd and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_1 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id a2747af8bb148808c98d25f160d89e4a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (5/16)#0 (8a4b64833ef69ae8b6ee621b7fbb7817) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (6/16)#0 (cb23f0089a12b110473baa376318564b), deploy into slot with allocation id e3dcab42cbcb6c8f2c3708edfec6a307.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (3/16) (69c4700ff4539c09165c1dbb1933789a) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (5/16)#0 (8a4b64833ef69ae8b6ee621b7fbb7817) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (3/16) (attempt #0) with attempt id 69c4700ff4539c09165c1dbb1933789a and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_2 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 22e04d75c4c195d2ee4b903f0cc75a7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot c2cc3fb662c27e339846909707ae07bc.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (6/16)#0 (cb23f0089a12b110473baa376318564b) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (4/16) (e403702835c0691acde7b6c7196afd53) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (6/16)#0 (cb23f0089a12b110473baa376318564b) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (4/16) (attempt #0) with attempt id e403702835c0691acde7b6c7196afd53 and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_3 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id de35331f464d11cb7ce4328119fcdd6e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (6/16)#0 (cb23f0089a12b110473baa376318564b) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (7/16)#0 (3d749091db79ffe9bae741339e4610e2), deploy into slot with allocation id c2cc3fb662c27e339846909707ae07bc.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (6/16)#0 (cb23f0089a12b110473baa376318564b) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (5/16) (633beb75ce5c43cb14bf91b2aa501b0d) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (5/16) (attempt #0) with attempt id 633beb75ce5c43cb14bf91b2aa501b0d and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_4 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 4b6729db2970e5d017d0c95236b33ec7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot a2f7799a47c675931239ca3761a6bfcb.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (7/16)#0 (3d749091db79ffe9bae741339e4610e2) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (7/16)#0 (3d749091db79ffe9bae741339e4610e2) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (6/16) (7fe48585a53963e7a8e1b0abd25d0a23) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (6/16) (attempt #0) with attempt id 7fe48585a53963e7a8e1b0abd25d0a23 and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_5 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id e3dcab42cbcb6c8f2c3708edfec6a307
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (7/16) (c74f610df36be88b16e2f98567954e36) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (7/16)#0 (3d749091db79ffe9bae741339e4610e2) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (8/16)#0 (db799d6057fa07c9c23b14e7f1d533a9), deploy into slot with allocation id a2f7799a47c675931239ca3761a6bfcb.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (7/16) (attempt #0) with attempt id c74f610df36be88b16e2f98567954e36 and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_6 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id c2cc3fb662c27e339846909707ae07bc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (7/16)#0 (3d749091db79ffe9bae741339e4610e2) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (8/16) (aaee7e772ac0ae65ca2b21dab8619988) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (8/16)#0 (db799d6057fa07c9c23b14e7f1d533a9) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (8/16) (attempt #0) with attempt id aaee7e772ac0ae65ca2b21dab8619988 and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_7 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id a2f7799a47c675931239ca3761a6bfcb
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 32c24cbb9ef405f947c1264c32fbed58.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (9/16) (5da0fe9b1e4ed51eafc0b97879f6118a) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (9/16) (attempt #0) with attempt id 5da0fe9b1e4ed51eafc0b97879f6118a and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_8 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 32c24cbb9ef405f947c1264c32fbed58
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (9/16)#0 (358d9fec48019ac85e71b51ce96a4a5c), deploy into slot with allocation id 32c24cbb9ef405f947c1264c32fbed58.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (10/16) (c74b4dcf9097a81402e0f6fc25ffc8b3) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot f8c8b9b8e9e64e1c7774676db500d9cd.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (9/16)#0 (358d9fec48019ac85e71b51ce96a4a5c) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (9/16)#0 (358d9fec48019ac85e71b51ce96a4a5c) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (8/16)#0 (db799d6057fa07c9c23b14e7f1d533a9) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (9/16)#0 (358d9fec48019ac85e71b51ce96a4a5c) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (9/16)#0 (358d9fec48019ac85e71b51ce96a4a5c) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (8/16)#0 (db799d6057fa07c9c23b14e7f1d533a9) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (8/16)#0 (db799d6057fa07c9c23b14e7f1d533a9) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (10/16)#0 (b368dae592aaf16e918adc2bdb2f667f), deploy into slot with allocation id f8c8b9b8e9e64e1c7774676db500d9cd.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (10/16) (attempt #0) with attempt id c74b4dcf9097a81402e0f6fc25ffc8b3 and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_9 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id f8c8b9b8e9e64e1c7774676db500d9cd
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (11/16) (6a987b2525efde4ca0352aba0fcf8192) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (11/16) (attempt #0) with attempt id 6a987b2525efde4ca0352aba0fcf8192 and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_10 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 4d687207aab346a416effa64bd159463
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (12/16) (01e33feaf62865a71d31fbdf7e050f26) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 4d687207aab346a416effa64bd159463.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (10/16)#0 (b368dae592aaf16e918adc2bdb2f667f) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (10/16)#0 (b368dae592aaf16e918adc2bdb2f667f) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (10/16)#0 (b368dae592aaf16e918adc2bdb2f667f) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (10/16)#0 (b368dae592aaf16e918adc2bdb2f667f) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (11/16)#0 (8d23bd7b4205d6ada24d5de28b77ae6d), deploy into slot with allocation id 4d687207aab346a416effa64bd159463.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (12/16) (attempt #0) with attempt id 01e33feaf62865a71d31fbdf7e050f26 and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_11 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 1fb8a61a2cd31abe4c4b6a1103719b82
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (11/16)#0 (8d23bd7b4205d6ada24d5de28b77ae6d) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 1fb8a61a2cd31abe4c4b6a1103719b82.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (11/16)#0 (8d23bd7b4205d6ada24d5de28b77ae6d) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (13/16) (0b297b75f51c2d52eb4ad3d8921fe66d) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (13/16) (attempt #0) with attempt id 0b297b75f51c2d52eb4ad3d8921fe66d and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_12 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 3b0780ff2b6157dc4214b80fba838285
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (11/16)#0 (8d23bd7b4205d6ada24d5de28b77ae6d) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (11/16)#0 (8d23bd7b4205d6ada24d5de28b77ae6d) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (14/16) (cfd527253a2ba383b4661bf5208eb53a) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (12/16)#0 (a8d6c6d4bc441f11633ea0aea02449b0), deploy into slot with allocation id 1fb8a61a2cd31abe4c4b6a1103719b82.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (14/16) (attempt #0) with attempt id cfd527253a2ba383b4661bf5208eb53a and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_13 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id f5946e052106a4302d52b9597464de25
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (15/16) (4852069dda05da6175a5314a4b21124b) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (15/16) (attempt #0) with attempt id 4852069dda05da6175a5314a4b21124b and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_14 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 84d081060832bf6bac3f03b338de3049
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (12/16)#0 (a8d6c6d4bc441f11633ea0aea02449b0) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 3b0780ff2b6157dc4214b80fba838285.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (12/16)#0 (a8d6c6d4bc441f11633ea0aea02449b0) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (16/16) (ad17985dc7aa8843615d32d4825b9a9a) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (16/16) (attempt #0) with attempt id ad17985dc7aa8843615d32d4825b9a9a and vertex id 181921bf8d745b26f5a7a7dfbdaa6543_15 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 343f7fbd49230a04b48c1e9b128a85b7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (12/16)#0 (a8d6c6d4bc441f11633ea0aea02449b0) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (1/16) (7b430a6fb88f571d5f4c0de4e9600ff3) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (12/16)#0 (a8d6c6d4bc441f11633ea0aea02449b0) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (1/16) (attempt #0) with attempt id 7b430a6fb88f571d5f4c0de4e9600ff3 and vertex id ad72bd24e848bfbc6995eba35391c61a_0 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 5d8c279e8476e00e1893e8d9388bf873
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (2/16) (1255377bb7863736dce76cb929204cc6) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (2/16) (attempt #0) with attempt id 1255377bb7863736dce76cb929204cc6 and vertex id ad72bd24e848bfbc6995eba35391c61a_1 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id a2747af8bb148808c98d25f160d89e4a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (3/16) (0764f00341a9a91e2d596b65d3ac213e) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (3/16) (attempt #0) with attempt id 0764f00341a9a91e2d596b65d3ac213e and vertex id ad72bd24e848bfbc6995eba35391c61a_2 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 22e04d75c4c195d2ee4b903f0cc75a7e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (4/16) (885613e8036f32dfc39936fe2cd76d91) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (4/16) (attempt #0) with attempt id 885613e8036f32dfc39936fe2cd76d91 and vertex id ad72bd24e848bfbc6995eba35391c61a_3 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id de35331f464d11cb7ce4328119fcdd6e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (5/16) (23aa4030914f7472474bfaedb3770d99) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (5/16) (attempt #0) with attempt id 23aa4030914f7472474bfaedb3770d99 and vertex id ad72bd24e848bfbc6995eba35391c61a_4 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 4b6729db2970e5d017d0c95236b33ec7
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (13/16)#0 (1e569de6b8d9df354d3604f7687b3e93), deploy into slot with allocation id 3b0780ff2b6157dc4214b80fba838285.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (6/16) (7788150e7a768f74b8fcc0a8234869a4) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (6/16) (attempt #0) with attempt id 7788150e7a768f74b8fcc0a8234869a4 and vertex id ad72bd24e848bfbc6995eba35391c61a_5 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id e3dcab42cbcb6c8f2c3708edfec6a307
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (13/16)#0 (1e569de6b8d9df354d3604f7687b3e93) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (13/16)#0 (1e569de6b8d9df354d3604f7687b3e93) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot f5946e052106a4302d52b9597464de25.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (7/16) (68e2581b7be6d61942002580f480c087) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (7/16) (attempt #0) with attempt id 68e2581b7be6d61942002580f480c087 and vertex id ad72bd24e848bfbc6995eba35391c61a_6 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id c2cc3fb662c27e339846909707ae07bc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (13/16)#0 (1e569de6b8d9df354d3604f7687b3e93) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (13/16)#0 (1e569de6b8d9df354d3604f7687b3e93) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (8/16) (d27876e242a2f560c2430adb083e7ef9) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (8/16) (attempt #0) with attempt id d27876e242a2f560c2430adb083e7ef9 and vertex id ad72bd24e848bfbc6995eba35391c61a_7 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id a2f7799a47c675931239ca3761a6bfcb
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task DataSource (Impulse) (14/16)#0 (f5336169c3c6157837b4dec4c01614f6), deploy into slot with allocation id f5946e052106a4302d52b9597464de25.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (9/16) (1efe2da363140e88f091a48639e8381d) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution deploy
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Deploying DataSource (Impulse) (9/16) (attempt #0) with attempt id 1efe2da363140e88f091a48639e8381d and vertex id ad72bd24e848bfbc6995eba35391c61a_8 to 8e022257-3a0a-4fdd-bd42-5387459ef8a6 @ localhost (dataPort=-1) with allocation id 32c24cbb9ef405f947c1264c32fbed58
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (14/16)#0 (f5336169c3c6157837b4dec4c01614f6) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task DataSource (Impulse) (14/16)#0 (f5336169c3c6157837b4dec4c01614f6) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (10/16) (02505655f63373c2d2d68962ca2a1360) switched from SCHEDULED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 9:44:17 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (14/16)#0 (f5336169c3c6157837b4dec4c01614f6) switched from DEPLOYING to INITIALIZING.
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1003

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1003/display/redirect>

Changes:


------------------------------------------
[...truncated 19.36 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (9/16)#0 (e866d7125c0cc129bbdd29a3a1ce6374) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (9/16)#0 (e866d7125c0cc129bbdd29a3a1ce6374) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (9/16)#0 (e866d7125c0cc129bbdd29a3a1ce6374) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530), deploy into slot with allocation id 55ee1b05b3a881a1defa1fd7c42ac5f1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (9/16) (e866d7125c0cc129bbdd29a3a1ce6374) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot d97e4a2f1d4a4963ce2a1e9ecd3e2916.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (10/16)#0 (62d00fa245d00d53eeed254f43a0a530) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-24
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-14
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-6
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-52
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-32
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-59
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-44
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-48
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-61
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-60
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-9
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-11
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-43
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-37
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-49
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-45
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-13
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-27
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-18
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-22
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-63
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-19
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-34
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-42
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-55
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-30
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-12
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-29
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-50
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-33
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (9/16) (e866d7125c0cc129bbdd29a3a1ce6374) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (10/16) (62d00fa245d00d53eeed254f43a0a530) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9), deploy into slot with allocation id d97e4a2f1d4a4963ce2a1e9ecd3e2916.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-21
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (10/16) (62d00fa245d00d53eeed254f43a0a530) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16)#0 (abbd5c0f7595b5e324508d7db0c46a48) switched from RUNNING to FINISHED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-26
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [2]read table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16)#0 (abbd5c0f7595b5e324508d7db0c46a48).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot d29686d56fdc16fe3138ebfe65299abf.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16)#0 (60a2a426e83121b0ef7baf1d4ded90c7) switched from RUNNING to FINISHED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-41
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [2]read table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16)#0 (60a2a426e83121b0ef7baf1d4ded90c7).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-65
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:22 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-15
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-36
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-47
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a), deploy into slot with allocation id d29686d56fdc16fe3138ebfe65299abf.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-20
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-56
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 2dccae90ef326603184ddffd7ee52e22.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053), deploy into slot with allocation id 2dccae90ef326603184ddffd7ee52e22.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (11/16)#0 (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (11/16) (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (11/16) (8c0ea0b0206e8bc5b8f8b429caa7d0c9) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 1f17b0788187549422cf5f35e1ccb4e8.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab), deploy into slot with allocation id 1f17b0788187549422cf5f35e1ccb4e8.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (12/16)#0 (19dd8722960ac542cd90186ac455153a) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (12/16) (19dd8722960ac542cd90186ac455153a) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (12/16) (19dd8722960ac542cd90186ac455153a) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 02b5d96726bd962387e2f28d1c2c1196.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (14/16)#0 (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (14/16) (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (15/16)#0 (8e99f2129953778a10547debab3442d4), deploy into slot with allocation id 02b5d96726bd962387e2f28d1c2c1196.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (13/16)#0 (76f784b0b6225bdded335b5f7eec3053) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (14/16) (704ef681f85bc6cfed1bbeb0b8bbc0ab) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (13/16) (76f784b0b6225bdded335b5f7eec3053) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 854c7c03b0b5835c5ce845174bd128db.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (13/16) (76f784b0b6225bdded335b5f7eec3053) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (16/16)#0 (fa88cc5c906dbc0dc0dfa43d00552dd0), deploy into slot with allocation id 854c7c03b0b5835c5ce845174bd128db.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (15/16)#0 (8e99f2129953778a10547debab3442d4) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (15/16)#0 (8e99f2129953778a10547debab3442d4) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 17, 2022 3:46:23 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN FlatMap (FlatMap at ExtractOutput[0]) -> Map (Key Extractor) -> GroupCombine (GroupCombine at GroupCombine: ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-d111a2ee-bc79-46c2-b43a-a9085d27d6b5/output.csv/[ComputedExpression[apply_DataFrame_140600521262160]]:140600308613392/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) -> Map (Key Extractor) (16/16)#0 (fa88cc5c906dbc0dc0dfa43d00552dd0) switched from CREATED to DEPLOYING.

> Task :sdks:python:test-suites:portable:py39:flinkExamples
PASSED                                                                   [100%]

==================================== ERRORS ====================================
_ ERROR at teardown of UserScoreIT.test_userscore_output_checksum_on_small_input _

args = (['gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/8aca2916-6152-44c9-9ef1-460f24609475/results*'],)
kwargs = {}
retry_intervals = <generator object FuzzedExponentialIntervals.__iter__ at 0x7fbe1b734200>
exn_traceback = None, sleep_interval = 12.78335285025201

    @functools.wraps(fun)
    def wrapper(*args, **kwargs):
      retry_intervals = iter(
          FuzzedExponentialIntervals(

FAILURE: Build failed with an exception.

* What went wrong:
GC overhead limit exceeded

* Try:
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Exception is:
java.lang.OutOfMemoryError: GC overhead limit exceeded


* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1002

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1002/display/redirect?page=changes>

Changes:

[noreply] Blog post for Hop web in Google Cloud (#23652)


------------------------------------------
[...truncated 17.67 MB...]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']

FAILED                                                                   [ 95%]
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays ERROR [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics 
-------------------------------- live log call ---------------------------------
INFO     root:pipeline.py:188 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_140227540324880], ComputedExpression[set_index_DataFrame_140226864589520], ComputedExpression[pre_combine_sum_DataFrame_140226864306000]]:140227323821072]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_140226863380496]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_140227540324880], ComputedExpression[set_index_DataFrame_140226864589520], ComputedExpression[pre_combine_sum_DataFrame_140226864306000]], outputs={PlaceholderExpression[placeholder_DataFrame_140226863380496], ComputedExpression[pre_combine_sum_DataFrame_140226864306000]}]
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_140227290189456]]:140227293403728]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_140226864306000]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_140227290189456]], outputs={ComputedExpression[post_combine_sum_DataFrame_140227290189456]}]
INFO     apache_beam.io.fileio:fileio.py:595 Added temporary directory /tmp/.temp16b9ae9c-432d-44ab-a879-d4d1202b5aaf
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f895a5aedd0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f895a5aeef0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f895a5b3440> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f895a5b34d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f895a5b3680> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f895a5b3710> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f895a5b3830> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f895a5b38c0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f895a5b3950> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f895a5b39e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f895a5b3c20> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f895a5b3d40> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f895a5b3b90> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function populate_data_channel_coders at 0x7f895a5b3cb0> ====================
INFO     apache_beam.runners.worker.statecache:statecache.py:234 Creating state cache with size 104857600
INFO     apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:908 Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler object at 0x7f8937f4a1d0> for environment ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')

> Task :sdks:python:test-suites:portable:py39:flinkExamples
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Log file environment variable 'log.file' is not set.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Rest endpoint listening at localhost:42895
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Proposing leadership to contender http://localhost:42895
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint startInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Web frontend listening at http://localhost:42895.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint grantLeadership
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: http://localhost:42895 was granted leadership with leaderSessionID=73be245c-6779-43d5-b1ea-5e300281a81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received confirmation of leadership for leader http://localhost:42895 , session=73be245c-6779-43d5-b1ea-5e300281a81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Proposing leadership to contender LeaderContender: DefaultDispatcherRunner
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Proposing leadership to contender LeaderContender: ResourceManagerServiceImpl
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner lambda$grantLeadership$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DefaultDispatcherRunner was granted leadership with leader id da214976-8981-4093-91d9-ffc1f0baf8cc. Creating new DispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl lambda$grantLeadership$2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resource manager service is granted leadership with session id 98eb2e47-7c29-4708-8d58-3216e0db819f.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.minicluster.MiniCluster start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Flink Mini Cluster started successfully
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess startInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Start SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess recoverJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Recover all persisted job graphs that are not finished, yet.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess recoverJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Successfully recovered 0 persisted job graphs.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/rpc/resourcemanager_1 .
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_2 .
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.resourcemanager.ResourceManager onStart
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting the resource manager.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received confirmation of leadership for leader akka://flink/user/rpc/dispatcher_2 , session=da214976-8981-4093-91d9-ffc1f0baf8cc
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received confirmation of leadership for leader akka://flink/user/rpc/resourcemanager_1 , session=98eb2e47-7c29-4708-8d58-3216e0db819f
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.taskexecutor.TaskExecutor connectToResourceManager
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Connecting to ResourceManager akka://flink/user/rpc/resourcemanager_1(8d583216e0db819f98eb2e477c294708).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.registration.RetryingRegistration lambda$startRegistration$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolved ResourceManager address, beginning registration
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.resourcemanager.ResourceManager registerTaskExecutorInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Registering TaskManager with ResourceID 62cb61ed-10db-4113-991c-24a4a5e3bc13 (akka://flink/user/rpc/taskmanager_0) at ResourceManager
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.Dispatcher submitJob
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received JobGraph submission 'BeamApp-jenkins-1016214608-39ad1eec' (0b98b1193d3b8651a667666a1e0843c2).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.taskexecutor.TaskExecutorToResourceManagerConnection onRegistrationSuccess
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Successful registration at resource manager akka://flink/user/rpc/resourcemanager_1 under registration id 6029539b11cf91c935449e98d353cf6a.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.Dispatcher internalSubmitJob
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Submitting job 'BeamApp-jenkins-1016214608-39ad1eec' (0b98b1193d3b8651a667666a1e0843c2).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Proposing leadership to contender LeaderContender: JobMasterServiceLeadershipRunner
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_3 .
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.jobmaster.JobMaster <init>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Initializing job 'BeamApp-jenkins-1016214608-39ad1eec' (0b98b1193d3b8651a667666a1e0843c2).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.scheduler.DefaultSchedulerFactory createInstance
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Using restart back off time strategy NoRestartBackoffTimeStrategy for BeamApp-jenkins-1016214608-39ad1eec (0b98b1193d3b8651a667666a1e0843c2).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder buildGraph
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Running initialization on master for job BeamApp-jenkins-1016214608-39ad1eec (0b98b1193d3b8651a667666a1e0843c2).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder buildGraph
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Successfully ran initialization on master in 2 ms.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology generateNewPipelinedRegions
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Built 2 new pipelined regions in 1 ms, total 2 pipelined regions currently.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.scheduler.DefaultScheduler <init>
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Using failover strategy org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategy@16da49da for BeamApp-jenkins-1016214608-39ad1eec (0b98b1193d3b8651a667666a1e0843c2).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received confirmation of leadership for leader akka://flink/user/rpc/jobmanager_3 , session=21ea7d77-5b1a-4753-ace2-0686d961032a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.jobmaster.JobMaster startJobExecution
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting execution of job 'BeamApp-jenkins-1016214608-39ad1eec' (0b98b1193d3b8651a667666a1e0843c2) under job master id ace20686d961032a21ea7d775b1a4753.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.scheduler.DefaultScheduler startSchedulingInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.DefaultExecutionGraph transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job BeamApp-jenkins-1016214608-39ad1eec (0b98b1193d3b8651a667666a1e0843c2) switched from state CREATED to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (1/16) (d9372d8a96723c4691c52ad1a73cc039) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (2/16) (468c36c263fe36d8da2ed6d350f11050) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (3/16) (8a47b7417242882f49a872eff2ec833f) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (4/16) (8294c22569f82d44696781fa58961404) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (5/16) (1df9a9f79e0b7f3b39c0ba4062d73170) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (6/16) (bec3c421f908a3c40a7db8201b79bf2e) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (7/16) (56a76f9fcc341fc42342c5dfe976a303) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (8/16) (71cd52f31ec770339be8ccbe14496256) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (9/16) (eea10559b0e3cd47d65cc344f2a193f3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (10/16) (244497418a4b7bd282d72ce187132a0b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:13 PM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSource (Impulse) (11/16) (afcfadfcb31450e739537eb5e7f2d87f) switched from CREATED to SCHEDULED.

> Task :sdks:python:test-suites:portable:py39:flinkExamples
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Log file environment variable 'log.file' is not set.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Rest endpoint listening at localhost:42895
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Proposing leadership to contender http://localhost:42895
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint startInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Web frontend listening at http://localhost:42895.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint grantLeadership
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: http://localhost:42895 was granted leadership with leaderSessionID=73be245c-6779-43d5-b1ea-5e300281a81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received confirmation of leadership for leader http://localhost:42895 , session=73be245c-6779-43d5-b1ea-5e300281a81c
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Proposing leadership to contender LeaderContender: DefaultDispatcherRunner
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting resource manager service.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Proposing leadership to contender LeaderContender: ResourceManagerServiceImpl
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner lambda$grantLeadership$0
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DefaultDispatcherRunner was granted leadership with leader id da214976-8981-4093-91d9-ffc1f0baf8cc. Creating new DispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl lambda$grantLeadership$2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resource manager service is granted leadership with session id 98eb2e47-7c29-4708-8d58-3216e0db819f.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.minicluster.MiniCluster start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Flink Mini Cluster started successfully
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess startInternal
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Start SessionDispatcherLeaderProcess.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:46:12 PM org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess recoverJobs
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Recover all persisted job graphs that are not finished, yet.java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1001

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1001/display/redirect>

Changes:


------------------------------------------
[...truncated 54.40 MB...]
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 209. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 211. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 218. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 213. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.

ERROR:apache_beam.runners.worker.sdk_worker:Error processing instruction 66. Original traceback is
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 507, in input_elements
    element = received.get(timeout=1)
  File "/usr/lib/python3.9/queue.py", line 179, in get
    raise Empty
_queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 596, in do_instruction
    return getattr(self, request_type)(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 992, in process_bundle
    for element in data_channel.input_elements(instruction_id,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 510, in input_elements
    raise RuntimeError('Channel closed prematurely.')
RuntimeError: Channel closed prematurely.


Failed to find "code" in the query parameters of the redirect.
Invalid authorization: Try running with --noauth_local_webserver.

Your browser has been opened to visit:

    https://accounts.google.com/o/oauth2/v2/auth?client_id=1042881264118.apps.googleusercontent.com&redirect_uri=http%3A%2F%2Flocalhost%3A8080%2F&scope=https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fbigquery+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fbigquery.insertdata+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fbigquery.readonly+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fcloud-platform+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fcloud-platform.read-only+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fdevstorage.full_control+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fdevstorage.read_only+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fdevstorage.read_write&access_type=offline&response_type=code

If your browser is on a different machine then exit and re-run this
application with the command-line parameter

  --noauth_local_webserver

Failed to find "code" in the query parameters of the redirect.
Invalid authorization: Try running with --noauth_local_webserver.

Your browser has been opened to visit:

    https://accounts.google.com/o/oauth2/v2/auth?client_id=1042881264118.apps.googleusercontent.com&redirect_uri=http%3A%2F%2Flocalhost%3A8090%2F&scope=https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fbigquery+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fbigquery.insertdata+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fbigquery.readonly+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fcloud-platform+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fcloud-platform.read-only+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fdevstorage.full_control+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fdevstorage.read_only+https%3A%2F%2Fwww.googleapis.com%2Fauth%2Fdevstorage.read_write&access_type=offline&response_type=code

If your browser is on a different machine then exit and re-run this
application with the command-line parameter

  --noauth_local_webserver


> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 18m 9s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/4rn36s2y4c2zi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #1000

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/1000/display/redirect>

Changes:


------------------------------------------
[...truncated 51.14 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (3/16) (1cc45b614e4d8d5d407d89fe4254d9ac) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (4/16) (d6779a1fcd6a84660cdd99acc316dd28) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (5/16) (bcbbb68ffc266407fd01da301241a887) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (6/16) (0f2438fceab959cdb36da6f4a286ead5) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (7/16) (e84d70486c861ebc1e57ad8a2af64457) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (8/16) (e9ad9d0e2a1bada999a407628a505703) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (9/16) (69ab2b09d86b8ac989bfabdb7295ea32) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (10/16) (1b929cb72164708488327e77bab91593) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (11/16) (358d0d38bcca758f9c4d7d725841a763) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (12/16) (bf626c7d24230039fcaed475b21539da) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (13/16) (f3e0d99df31c1b0441add7a6fba6abe8) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (14/16) (1874bf89fc3bfe76d15d2ae44bd7f121) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (15/16) (691397e5091ee43133f1995018146cf4) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (16/16) (5c55782d235677413f40610e01d94d23) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/16) (a2b7cd1db05f75b5f9eff74b8e44976e) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (2/16) (8ec5e8570557577057228883739ade91) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16) (a08a443bd7650e409a11b8fbe33ed271) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (4/16) (7775a21de165332f3287699546951f91) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (5/16) (911766989f9b35191f9784c3ae0251ca) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16) (bad4d83d542e5c7e89bb17dc09d7ae3b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16) (9f83246fec52b89900ad3c8eb8df387d) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (8/16) (29a24e92736b49b1106e96b30686571b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (9/16) (be356d61b873fcae2bdc6a488ea9cb41) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (10/16) (6d16da9fa7d74beef6948db9cdfcefb2) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (11/16) (d06d38f1b9bc995903afbc62473172ff) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16) (4fd0740b201995b22f700d51e5a400f5) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (13/16) (12fc1f0919a24930d7999250a9a58f57) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (14/16) (05ded51dcc58914dad07632427c041cc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (15/16) (aaac8072353527dc796f990f26d2191a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [3]read_words/Read/{Map(<lambda at iobase.py:908>), SDFBoundedSourceReader}) -> FlatMap (FlatMap at ExtractOutput[0]) (16/16) (0093ab484f718761926cfe9b4fc6e194) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (1/16) (cd143f5f669b409c670d7797c05e14d1) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (2/16) (0cf8579a380e95677b906564b000a29e) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (3/16) (0ed607e1d3ff6cc19ff08b6dad75d535) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (4/16) (b60b3f4b2114f4295d8937f63d85c4ae) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (5/16) (00932875210d8230a6deb516708b0db5) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (6/16) (2626ac340e258e492e8e4603f6dcbf7c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (7/16) (6a0ffa72a955d1e35fea34981d14b4f3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (8/16) (0d333d557629e6b9790ab30c28c5cd36) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (9/16) (214cda9b9b31f66873649602bf78b747) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (10/16) (6387e74df3274f4139832acc3bfd44fc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (11/16) (b195b194e404f2609e92ade73489793a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (12/16) (3b9984e77bd26efdeb3d25c685fec563) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (13/16) (c4ca0c665ff09f01e333a5d941412a0c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (14/16) (36dbf788609d18dc73da3dc40e132ef3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (15/16) (875fc4fa285a6a95d72d18f266a4e630) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read_words/{Read, _PassThroughThenCleanup}) (16/16) (9c76d7c103387222b259924f57336ea9) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (1/16) (0de23aa22dd966f96dee404fc0f9a9cb) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (2/16) (82afb5c464c568e6d2313d37068a1876) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (3/16) (18f01a928367a81f755c2f943cb51338) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (4/16) (f62be9e6342d7a952771d70dad9dd1bd) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (5/16) (72f9b862e1f0f28ca85921628ed3f586) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (6/16) (8c6bf521fb5dca6d45260bac166e8bd9) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (7/16) (8941f68ff498b9dba938d3e4a980baf8) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (8/16) (59227195675e880333603ead2f0f8e95) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (9/16) (cfe3bef8ef516f386eb3f548d9339784) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (10/16) (d04893036c80a5be26a83fee198852b2) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (11/16) (f6de0b61ca9f1fe5ae2ca03f51b68b55) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (12/16) (b9123751351bdf59debb1013f4062c64) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (13/16) (f4687df5409f63b89655e87bb5b7354a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (14/16) (f82387095e971065deceb504a4a8c5d5) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (15/16) (6f1289bc50b09b9bbd90773a0ed07574) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (16/16) (a1aa25d905b4dac405cc1e6c537369a1) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (1/16) (206f2b27a052800b7f8e37b4bf35df9c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (2/16) (763bf313885e9d30a9311a39442d1d59) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (3/16) (5f4f308c8919ff9a260f13af316afdba) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (4/16) (a79d5a2eb067b9b2398c591f71398c00) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (5/16) (1ecc12a304d26d6e20c8bfec6db0627f) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (6/16) (84d1334530032c2ba3c583149fb4c091) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (7/16) (55a55d06f225ffbf40cb98b748108bcc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (8/16) (77143393f5e570ce16a35bd5a45bb077) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (9/16) (efb2a6b85d679e5c63f68e5b8d369539) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (10/16) (8ba5edfde44cbaa49041f761380b9613) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (11/16) (216c1a99925801273d4c21ac6f78ba8f) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (12/16) (a0816388e3697a079b6afe7909e21b39) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (13/16) (33cb8ff5bd001e94ef3a707c78c0aa4e) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (14/16) (2c6723df1ce13327f1020324b44853b3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (15/16) (a50832f7c8faea2efd285225713ba828) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read_words/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (16/16) (84dafdcf6b65a48845f6e530d97287bd) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (1/16) (c8eebd2fffc86313b1d98405fdfc7f84) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (2/16) (76f73fc9ae9a3d826a7046abf31ece87) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (3/16) (e9d83e11a003f273787be5fe35f945fc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (4/16) (02378865c0c1e4c003201068509c78b7) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (5/16) (4981737648981a14ce6fc6f20f0eeddf) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (6/16) (069d26df40ef0ec191f4067e55664ae4) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (7/16) (4744b2179c4972d1641d414d4ff4a8b0) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (8/16) (c1cf0b9141b0245a37946cc749d9881c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (9/16) (5f785e18f332fb16bb68a77aa74919a5) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (10/16) (0917487f317239329362bb62f6d3cc5e) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (11/16) (adf3f37c490db5661298006ca3235828) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (12/16) (486021cfff1412456bea6335d441b721) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (13/16) (1bfd9ea9d85d96d6b2bb941787d1c25a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (14/16) (7092ae4b92637c6255f5a265c9e865cc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (15/16) (682264edfbddc58fc8eb87f56fb09f8b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (16/16) (29f907e32d7ef2ad64b868df60f3be3b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (1/16) (c4badcfa00c6274fc9ec8b82b14292c3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (2/16) (d1860c263155951d09c34ccecc138941) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (3/16) (e01e77608dc43fe9000d94c143f4dd3d) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (4/16) (0224accc0cbf6effafb08f2a5b315d20) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (5/16) (c7c7571a23c15fc04b50acb3bf3970e6) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (6/16) (ad70d02ed2e80d7146bd3026c7095812) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (7/16) (3de8ba0306d022504c30cbe69ae0d2e2) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (8/16) (117bc1cc130565e8eec013c0402faac4) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (9/16) (c739f15b8edb3ca62996c6e58addce08) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (10/16) (2b7e32c710950cab26313636544cf2d6) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (11/16) (ecf7ea4878ef9be2e2cf4ac22bdcf561) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (12/16) (a199ca646899bb556a32f08b8b9b655c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (13/16) (ed5f4650533bd3bca693e98fb959f6ad) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (14/16) (800c468e85932757ffcf4d0717eec960) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (15/16) (5b2103de871edcfdf87936ea311cbcdd) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (16/16) (90762c55012a2873b2db6bb40dd1425d) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/16) (fa93b6c5d5e024018653f46c1b48629a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (2/16) (8417086937cb2f42b332f6e2677eeac5) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16) (81a350ba55eae73c6f674e382965f4bd) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (4/16) (a4213f9fdfa90baf5d3da7a280ca3e7d) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (5/16) (bdc179d11fa6e5b1676e2773021504d5) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16) (3d876f7569e2037aa6f0da4fd233555c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16) (09587908e2485d7c8fd176c4da4c0ba4) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (8/16) (87e55e8651c138b71ebf330270bbedaf) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (9/16) (e882acc08a315a4a199db2dcf0529ba2) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (10/16) (59667d154356604ce628521a3f4246b8) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (11/16) (1b08933dfbbe53dcc3094eea97df6379) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16) (93cbf5872fddc876d5da98b8cd6ccb2a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (13/16) (6fe76327a6981c880b9e47244a040087) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 9:44:03 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (14/16) (d8f44ce8fbb2af440598fd4797708baf) switched from CREATED to SCHEDULED.
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #999

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/999/display/redirect?page=changes>

Changes:

[noreply] [GitHub Actions] - Verify Release Build Workflow  (#23390)


------------------------------------------
[...truncated 33.01 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (6/16) (1746b2e632c457a65f9923366cca1201) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (7/16) (cde5f9ac0a0db812aa75bf14c3ad0f66) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (8/16) (eb6184df279bbd51f862404c02a79721) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (9/16) (5a08f862d2cb47da6e9142568cd9e21c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (10/16) (506e544df9bc6be3619f3c9aac31db36) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (11/16) (987e1bef9958a615e180ab12cd85c512) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (12/16) (cf446916ae3b27829d979d2f6e52e92c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (13/16) (aed96f8de23d6cd69558cef80ccfa42c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (14/16) (b29434e767d994cc25c6b076f621637e) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (15/16) (824a8079d1b729e4578aff57627c6822) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [2]read corpus/{Read, _PassThroughThenCleanup}) (16/16) (e85147acf8ce535232ddd6c924fc62c0) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (1/16) (87611a7429d8a139c7f359a6da623cff) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (2/16) (b5b6541b4a85e8186a975adc17d4a416) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (3/16) (79fd1442935edf84d830a801968628a2) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (4/16) (91154428f3a6781706dbda4bc3fd07ba) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (5/16) (11bb2c2d84261ca8bce7d1a4d5e5f140) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (6/16) (e8e55d9353e052bcb7fc3e19751c5f7a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (7/16) (3f70f482c9686e3bacd4db740b2853e0) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (8/16) (5bc1765634554c663a024327911a8d37) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (9/16) (c089d01297304a08a3cb78729bad8ade) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (10/16) (e94839373aa0e8ebd35992c10822f167) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (11/16) (dd56feb401a8d88d42092a4db4ba2468) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (12/16) (f0107a3c73cb5614b9536b0ec0162993) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (13/16) (f7a4b9bdf036177eca7af1d1e1b62904) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (14/16) (61239b2fdbb1361ca546d7a31c051eda) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (15/16) (2726608eed7ecc4034d88f71b3ba9208) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[1]) (16/16) (6db000230caa3a35bb4f79f2798f646c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (1/16) (818bb506b2d2466f42b753c2d7e71021) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (2/16) (17e593e832788d0341ece1d21f3ee611) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (3/16) (d451280bf093f25888f680006f3a21cd) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (4/16) (7c2e5c95f2cb0d1e90047600a03ae6a0) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (5/16) (869d3607a096bb7f6927368657e579e0) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (6/16) (5c3520083cdc57950507ec9e2aec4e88) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (7/16) (11bcd36622923f1b08d1fb595d58b603) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (8/16) (716c185cd8f8a266d54253ad916d4a4a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (9/16) (ff10e9187e1bce956ebbc49df17c6530) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (10/16) (5105b8781ff46707f28da9981bde38fc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (11/16) (a27ee11468cd420d108c9b1f26d75e38) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (12/16) (3791808079dddce05ff305a95df9eac8) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (13/16) (d8b642d21a839ad54579caca2098663d) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (14/16) (e6aee262227343ceccf750925a832f6b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (15/16) (e8dd5fcf8cdf75f444d5a33212be2738) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: FlatMap (FlatMap at ExtractOutput[0]) (16/16) (db88364a3927fea26b968ce53865b4b6) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (1/16) (4977100e7e714ea491a6c80c39d77674) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (2/16) (8907bf2e51c27da0922faf9aaea43510) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16) (70937e92753b90d4f6a911b3e715eb11) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (4/16) (ecf8bf4291dcf901e0e30890156df5f3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (5/16) (079e05e607747ba68059fda5daacc482) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16) (cb869c84e6d2fb7150253b04bbf5966b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16) (d35a1c94e4b1d3f234f2af04abb6210f) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (8/16) (18cc153406e5bc91c488c61dbbe32d9a) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (9/16) (60e151b174e866c2a4717f16ea188454) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (10/16) (9c648450bfa14b7682001d62047bb936) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (11/16) (10b4595065e95bd4cd151dc5fc26adc0) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16) (a73136258acc89281f1a513dc0d7dc09) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (13/16) (6931290a2b47581b3aeb422176f3bf17) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (14/16) (c7c4ccba826df32466fc47818dc3ec70) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (15/16) (b200247d47cd703ebb54ead8d595b2f1) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [1]attach corpus) -> FlatMap (FlatMap at ExtractOutput[0]) (16/16) (c626b46093af3ddbef1883e22d2352dd) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/16) (ba4a59ca32f1eb1877a22ec400d02338) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (2/16) (d3e0a82b3fa9bf3103e7807585f13856) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16) (53cace14cfeed436cc279d5e0de15fae) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (4/16) (c98846705065a8fef6229639c93884f3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (5/16) (7d0cda07b76a5e5cbb6f2f42f86bd465) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16) (7f36b54aa7961390c043758e859d2e63) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16) (6d69965007d916006f66c6b5e0b5c045) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (8/16) (c9a0571ab3dbd828724a2eb84c50d668) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (9/16) (b596581f0c03e3cdd4ae401d84b93b89) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (10/16) (69be8f0328993b78d00bca5e4b8cb956) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (11/16) (6fd63da8ca5bdf22fe6712833fbe8e42) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16) (493d956b4ba0682b148b720cebeaec98) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (13/16) (0b20caa77b05f091ab278014d97ad6d3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (14/16) (b2205c7c8b46b95ddb2028b50f38ed2c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (15/16) (94cf94d6f5c84460f5f356a5d2ed0073) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read corpus/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (16/16) (cc4c84a916a6d51fc5691329089d7e22) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (1/16) (84a5007964438d0bf85c402aac7309ae) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (2/16) (8ff06120e11b96f5935250a2c72bd720) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (3/16) (f73e0cd2e82215c0e52ba33dd5d19ae4) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (4/16) (87f50c5dd13dca5708ac633df53e22e1) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (5/16) (f34130af7026a4e1ed38139e9627ecc9) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (6/16) (33ee8c98daeeb5332a18287b00314db1) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (7/16) (cddc46d7aa452e86124852ae3f09fee3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (8/16) (953c08536b397269114961bd155c23f3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (9/16) (03638a9fdc2f56f8e625dff36b3b1e10) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (10/16) (774a0accdc151c4ed6e1cccd225bc09b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (11/16) (e123a45d6efec53716411996dec2bafd) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (12/16) (4f28d88f9d51c72ad666cc55d00f4bb5) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (13/16) (2db8c5e825e745768e88ece7db5590af) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (14/16) (22e8d3e75f3a4bbadf13a06940dd08dc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (15/16) (957cd71c4b1abb99f05816d9614d1afe) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [1]read corpus/_PassThroughThenCleanup/ParDo(RemoveExtractedFiles)) (16/16) (c56ef15fd2b4e1aeba8a2efb141ab5c3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (1/16) (00deb25c9948e5be1499f47ee2a75d15) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (2/16) (d7b33c4e81ec8a2cd0a45c62d1b338b0) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (3/16) (22b4710e4b64eeb15288e39562c8f7f4) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (4/16) (6c9b6b4adbcd4a4b95e7f3dc6a639efc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (5/16) (7cdac818879ad0764ea832f8dafb90ee) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (6/16) (e0e384aecbdd3599e05f2008ea296b94) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (7/16) (d1b3746c4d9e86c327dba32d00e2882b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (8/16) (74c6931a1f3c489634d7736bd3bc357b) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (9/16) (7954b7762bbf1183f2be76d7395fff27) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (10/16) (795969ef86d513379cc980ecdd2c9646) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (11/16) (597be3ae41674754959c134097a42f31) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (12/16) (6fc979d63e0833649b6b0458ef02689e) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (13/16) (4f94f90b80f6780a41ac30d945610fed) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (14/16) (4cf1b5393c5c9f7966ad9ae1587456c2) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (15/16) (b469518db61adf2af8749bb1965c4dd3) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: DataSink (DiscardingOutput) (16/16) (2ff784c85ffec0c99f2c0b972492b902) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/16) (41475db49117e66fc672840256d990ad) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (2/16) (3ee1cbf62e185e1660481ff45d7fc445) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (3/16) (06b57104daa238499e6d5ea19997121d) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (4/16) (085bfd789d4b561ba7fb0c54d40f0884) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (5/16) (55019e88ff3ba2590b15559167568415) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (6/16) (be173fcdddd92a02c41a6878b3663f4c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (7/16) (6f40a54c5438c7f73ecf4871372c475d) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (8/16) (d77ba1b23a4157eea913b804c1796a40) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (9/16) (a18dece0d3daa4ac63d05d08040ef210) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (10/16) (309b5ea9fa608573d46082ffae7c4195) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (11/16) (db9e91da9125deb870eb1fc12961261f) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16) (859a337baa5a7a19a334fe573ea2f295) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (13/16) (40f98255cf61e98d31b03428ed6fb7cc) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (14/16) (3efac2b445d8e9dcd42b445a6acc2e1c) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (15/16) (3866aa6d7c69f852a2c49571c61e2431) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]read_words/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (16/16) (df84091f8f690faf40ed1d3ccdee871e) switched from CREATED to SCHEDULED.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 16, 2022 3:43:21 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: CHAIN MapPartition (MapPartition at [2]create_ignore_word/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/16) (646730c0c839c0613d8f66f2f13b57b7) switched from CREATED to SCHEDULED.
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #998

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/998/display/redirect>

Changes:


------------------------------------------
[...truncated 35.78 MB...]
    self.client = client or bigquery.BigqueryV2(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 51, in __init__
    super().__init__(
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/apitools/base/py/credentials_lib.py",> line 153, in GetCredentials
    credentials = CredentialsFromFile(credentials_filename, client_info,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/capture.py",> line 192, in read
    raise OSError(
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']
=============================== warnings summary ===============================
../../build/gradleenv/2022703443/lib/python3.9/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

../../build/gradleenv/2022703443/lib/python3.9/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/typehints/pandas_type_compatibility_test.py:66
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    }).set_index(pd.Int64Index(range(123, 223), name='an_index')),

apache_beam/typehints/pandas_type_compatibility_test.py:89
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    pd.Int64Index(range(123, 223), name='an_index'),

apache_beam/typehints/pandas_type_compatibility_test.py:90
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
    pd.Int64Index(range(475, 575), name='another_index'),

apache_beam/examples/complete/estimate_pi_it_test.py::EstimatePiIT::test_estimate_pi_output_file
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:34939 {created_time:"2022-10-15T21:42:04.384747532+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2510: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread run_worker_3-1
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 254, in run
      for work_request in self._control_stub.Control(get_responses()):
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Runner closed connection"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:35023 {created_time:"2022-10-15T21:43:46.379637705+00:00", grpc_status:1, grpc_message:"Runner closed connection"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:42353 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-15T21:46:37.770953425+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/autocomplete_it_test.py::AutocompleteIT::test_autocomplete_output_files_on_small_input
FAILED apache_beam/examples/complete/estimate_pi_it_test.py::EstimatePiIT::test_estimate_pi_output_file
FAILED apache_beam/examples/complete/top_wikipedia_sessions_it_test.py::ComputeTopSessionsIT::test_top_wikipedia_sessions_output_files_on_small_input
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
FAILED apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
ERROR apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
ERROR apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
= 10 failed, 12 passed, 4 skipped, 6632 deselected, 47 warnings, 5 errors in 409.41s (0:06:49) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples
PASSED                                                                   [100%]

==================================== ERRORS ====================================
_ ERROR at teardown of UserScoreIT.test_userscore_output_checksum_on_small_input _

args = (['gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/a72e5c3b-81e0-491d-9f8a-37a7f53fbc8c/results*'],)
kwargs = {}
retry_intervals = <generator object FuzzedExponentialIntervals.__iter__ at 0x7f682a3d95d0>
exn_traceback = None, sleep_interval = 13.891245450266831

    @functools.wraps(fun)
    def wrapper(*args, **kwargs):
      retry_intervals = iter(
          FuzzedExponentialIntervals(
              initial_delay_secs,
              num_retries,
              factor,
              fuzz=0.5 if fuzz else 0,
              max_delay_secs=max_delay_secs,
              stop_after_secs=stop_after_secs))
      while True:
        try:
          return fun(*args, **kwargs)
        except Exception as exn:  # pylint: disable=broad-except
          if not retry_filter(exn):
            raise
          # Get the traceback object for the current exception. The
          # sys.exc_info() function returns a tuple with three elements:
          # exception type, exception value, and exception traceback.
          exn_traceback = sys.exc_info()[2]
          try:
            try:
>             sleep_interval = next(retry_intervals)
E             StopIteration

java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #997

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/997/display/redirect>

Changes:


------------------------------------------
[...truncated 19.01 MB...]
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']


ERROR    apache_beam.runners.worker.data_plane:data_plane.py:661 Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 809, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:44719 {created_time:"2022-10-15T15:46:44.623787952+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>
ERROR    root:portable_runner.py:577 java.lang.RuntimeException: Error received from SDK harness for instruction 21: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']

FAILED                                                                   [ 95%]
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays ERROR [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics 
-------------------------------- live log call ---------------------------------
INFO     root:pipeline.py:188 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.

> Task :sdks:python:test-suites:portable:py39:flinkExamples
PASSED                                                                   [100%]

==================================== ERRORS ====================================
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #996

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/996/display/redirect>

Changes:


------------------------------------------
[...truncated 18.79 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (11/16) (4b21f0b59bc137dc57c1429d2c786b21) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-48
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-25
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (12/16)#0 (dfbaaaf7bf3841588b2ce593ebeeba46) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (12/16)#0 (dfbaaaf7bf3841588b2ce593ebeeba46) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (12/16)#0 (dfbaaaf7bf3841588b2ce593ebeeba46) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (12/16)#0 (dfbaaaf7bf3841588b2ce593ebeeba46) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-55
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-5
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-11
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 0bbfbfd50a3ba5ec36100d73afb96e06.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (11/16) (4b21f0b59bc137dc57c1429d2c786b21) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (12/16) (dfbaaaf7bf3841588b2ce593ebeeba46) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (12/16) (dfbaaaf7bf3841588b2ce593ebeeba46) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-39
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-20
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-61
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-57
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (13/16)#0 (e7f5fa99d4b9a78ce2072d3a7a49fdbc), deploy into slot with allocation id 0bbfbfd50a3ba5ec36100d73afb96e06.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-49
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-52
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.data.GrpcDataService data
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Beam Fn Data client connected.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 218a9b5be00003ff59f0639d14d5d332.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-31
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (13/16)#0 (e7f5fa99d4b9a78ce2072d3a7a49fdbc) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (13/16)#0 (e7f5fa99d4b9a78ce2072d3a7a49fdbc) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (13/16)#0 (e7f5fa99d4b9a78ce2072d3a7a49fdbc) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (13/16)#0 (e7f5fa99d4b9a78ce2072d3a7a49fdbc) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (13/16) (e7f5fa99d4b9a78ce2072d3a7a49fdbc) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (13/16) (e7f5fa99d4b9a78ce2072d3a7a49fdbc) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (14/16)#0 (9dc0fc757c36e942efb2e383b02e87a9), deploy into slot with allocation id 218a9b5be00003ff59f0639d14d5d332.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 88f2f143ab2907260d93b1ae971a3bda.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (14/16)#0 (9dc0fc757c36e942efb2e383b02e87a9) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (14/16)#0 (9dc0fc757c36e942efb2e383b02e87a9) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (14/16)#0 (9dc0fc757c36e942efb2e383b02e87a9) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (14/16)#0 (9dc0fc757c36e942efb2e383b02e87a9) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (14/16) (9dc0fc757c36e942efb2e383b02e87a9) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (14/16) (9dc0fc757c36e942efb2e383b02e87a9) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (15/16)#0 (9e21a3e5895aad0f53bbf9277f7816b4), deploy into slot with allocation id 88f2f143ab2907260d93b1ae971a3bda.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 00f135f68d1cc985f7116d5bad0aff76.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (15/16)#0 (9e21a3e5895aad0f53bbf9277f7816b4) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (15/16)#0 (9e21a3e5895aad0f53bbf9277f7816b4) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (15/16)#0 (9e21a3e5895aad0f53bbf9277f7816b4) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (15/16) (9e21a3e5895aad0f53bbf9277f7816b4) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (15/16)#0 (9e21a3e5895aad0f53bbf9277f7816b4) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (15/16) (9e21a3e5895aad0f53bbf9277f7816b4) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (16/16)#0 (6ada36d2e340270f9a3d8b3992eb94d7), deploy into slot with allocation id 00f135f68d1cc985f7116d5bad0aff76.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (16/16)#0 (6ada36d2e340270f9a3d8b3992eb94d7) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (16/16)#0 (6ada36d2e340270f9a3d8b3992eb94d7) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (16/16)#0 (6ada36d2e340270f9a3d8b3992eb94d7) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (16/16)#0 (6ada36d2e340270f9a3d8b3992eb94d7) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (16/16) (6ada36d2e340270f9a3d8b3992eb94d7) switched from DEPLOYING to INITIALIZING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.executiongraph.Execution transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) (16/16) (6ada36d2e340270f9a3d8b3992eb94d7) switched from INITIALIZING to RUNNING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.metrics.groups.TaskMetricGroup getOrAddOperator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: The operator name GroupReduce (GroupReduce at ToPCollection(df) - gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-13b8c80c-7fd8-4ea8-8688-39301b97e393/output.csv/[ComputedExpression[apply_DataFrame_139964817449936]]:139964817537872/CoGroupByKey/CoGroupByKeyImpl/GroupByKey) exceeded the 80 characters length limit and was truncated.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 03be6c714b62a3a374517bf5a4270960.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-34
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-63
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-58
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-15
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-42
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-38
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-60
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-41
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-53
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService getProcessBundleDescriptor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: getProcessBundleDescriptor request with id 1-35
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (1/16)#0 (ddfa05eb954ea5d432f01f1837456f79), deploy into slot with allocation id 03be6c714b62a3a374517bf5a4270960.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (1/16)#0 (ddfa05eb954ea5d432f01f1837456f79) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (1/16)#0 (ddfa05eb954ea5d432f01f1837456f79) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot c98421da86992e2d4009d6aab4299ed2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (2/16)#0 (d28ae5330d0c7a9b6885388a974cdcbb), deploy into slot with allocation id c98421da86992e2d4009d6aab4299ed2.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 13b3b1e78065921b8c580a446985c1d8.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (2/16)#0 (d28ae5330d0c7a9b6885388a974cdcbb) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (2/16)#0 (d28ae5330d0c7a9b6885388a974cdcbb) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (3/16)#0 (ca7f28bc8e3bb0c054a3ae25d645a212), deploy into slot with allocation id 13b3b1e78065921b8c580a446985c1d8.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 739453a51c895ae869edcb00ec5ee345.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (3/16)#0 (ca7f28bc8e3bb0c054a3ae25d645a212) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (3/16)#0 (ca7f28bc8e3bb0c054a3ae25d645a212) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (4/16)#0 (d1fc29b904c64873b42a5ff0f79f3015), deploy into slot with allocation id 739453a51c895ae869edcb00ec5ee345.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (4/16)#0 (d1fc29b904c64873b42a5ff0f79f3015) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 9e39ec2735c7a82d63c6bf41df0b745a.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (4/16)#0 (d1fc29b904c64873b42a5ff0f79f3015) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (5/16)#0 (f75997b16226e8ac6195344a91592797), deploy into slot with allocation id 9e39ec2735c7a82d63c6bf41df0b745a.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 73f07f5a77d94c5c47022a9f86d72c5a.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (5/16)#0 (f75997b16226e8ac6195344a91592797) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (5/16)#0 (f75997b16226e8ac6195344a91592797) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (6/16)#0 (95ee1a0fad563c5b62ba7f0c1d829bf8), deploy into slot with allocation id 73f07f5a77d94c5c47022a9f86d72c5a.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot ae335d64401e02e364c25b392fa6c801.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (6/16)#0 (95ee1a0fad563c5b62ba7f0c1d829bf8) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (6/16)#0 (95ee1a0fad563c5b62ba7f0c1d829bf8) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (7/16)#0 (5c4605e358146ee491d536e90fbaa6b8), deploy into slot with allocation id ae335d64401e02e364c25b392fa6c801.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot dca9dfc29249d7df4760e0054faaab00.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (7/16)#0 (5c4605e358146ee491d536e90fbaa6b8) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (7/16)#0 (5c4605e358146ee491d536e90fbaa6b8) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (8/16)#0 (5ce92be37de97bca4a329d1c22ee204c), deploy into slot with allocation id dca9dfc29249d7df4760e0054faaab00.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot e66e0f911fcd68389c9cb41519d9c2aa.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (8/16)#0 (5ce92be37de97bca4a329d1c22ee204c) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (8/16)#0 (5ce92be37de97bca4a329d1c22ee204c) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (9/16)#0 (d7a102b28fae45a95d203b443af79234), deploy into slot with allocation id e66e0f911fcd68389c9cb41519d9c2aa.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 3b848ca1f845e298b019da383819e782.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (9/16)#0 (d7a102b28fae45a95d203b443af79234) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (9/16)#0 (d7a102b28fae45a95d203b443af79234) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (10/16)#0 (8080b164f51ba86946215b88a283b64d), deploy into slot with allocation id 3b848ca1f845e298b019da383819e782.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 3b674b4f087ffe6be0089a5c23838e9d.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (10/16)#0 (8080b164f51ba86946215b88a283b64d) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (10/16)#0 (8080b164f51ba86946215b88a283b64d) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (11/16)#0 (5e04be422bfbfab0dc415f02e0ee1763), deploy into slot with allocation id 3b674b4f087ffe6be0089a5c23838e9d.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot bb89315be4c9a073b282d01eba851e36.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (11/16)#0 (5e04be422bfbfab0dc415f02e0ee1763) switched from CREATED to DEPLOYING.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Loading JAR files for task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (11/16)#0 (5e04be422bfbfab0dc415f02e0ee1763) [DEPLOYING].
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.TaskExecutor submitTask
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Received task MapPartition (MapPartition at [8]{ToPCollection(df) - gs:, WriteToPandas(df) - gs:}) (12/16)#0 (70b865ca656eb298fbca965c32eea70a), deploy into slot with allocation id bb89315be4c9a073b282d01eba851e36.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl markExistingSlotActive
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Activate slot 0bbfbfd50a3ba5ec36100d73afb96e06.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:47:19 AM org.apache.flink.runtime.taskmanager.Task transitionState

> Task :sdks:python:test-suites:portable:py39:flinkExamples
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:46:57 AM org.apache.flink.runtime.taskmanager.Task doRun
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Freeing task resources for CHAIN MapPartition (MapPartition at [2]read table/_PassThroughThenCleanup/Create/{FlatMap(<lambda at core.py:3481>), Map(decode)}) -> FlatMap (FlatMap at ExtractOutput[0]) (12/16)#0 (68fcb12b224809f2b1d777080882daad).
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:46:57 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSource (Impulse) (10/16)#0 ece0400489ac0a5f2de5b31b15f9a3a1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:46:57 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSource (Impulse) (5/16)#0 b792030d21bb57bb1e2a6c4c8601dd7c.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:46:57 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Un-registering task and sending final execution state FINISHED to JobManager for task DataSource (Impulse) (8/16)#0 1e961675201576f3c59502b32ef3b51f.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 9:46:57 AM org.apache.flink.runtime.taskexecutor.TaskExecutor unregisterTaskAndNotifyFinalState
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #995

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/995/display/redirect?page=changes>

Changes:

[noreply] Make GCP OAuth scopes configurable via pipeline options. (#23644)

[noreply] Update BQIO to a single scheduled executor service reduce threads


------------------------------------------
[...truncated 18.97 MB...]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']


ERROR    apache_beam.runners.worker.data_plane:data_plane.py:661 Failed to read inputs in the data plane.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:35133 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-15T03:50:56.020847549+00:00"}"
>
ERROR    root:portable_runner.py:577 java.lang.RuntimeException: Error received from SDK harness for instruction 2: Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 287, in _execute
    response = task()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 360, in <lambda>
    lambda: self.create_worker().do_instruction(request), request)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 597, in do_instruction
    getattr(request, request_type), request.instruction_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 634, in process_bundle
    bundle_processor.process_bundle(instruction_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1004, in process_bundle
    element.data)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 227, in process_encoded
    self.output(decoded_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 528, in output
    _cast_to_receiver(self.receivers[output_index]).receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1491, in _reraise_augmented
    raise exn
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1581, in handle_process_outputs
    self._write_value_to_tag(tag, windowed_value, watermark_estimator)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1694, in _write_value_to_tag
    self.main_receivers.receive(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 240, in receive
    self.consumer.process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 908, in process
    delayed_applications = self.dofn_runner.process(o)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1419, in process
    self._reraise_augmented(exn)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1507, in _reraise_augmented
    raise new_exn.with_traceback(tb)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1417, in process
    return self.do_fn_invoker.invoke_process(windowed_value)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 624, in invoke_process
    windowed_value, self.process_method(windowed_value.value))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/common.py",> line 1571, in handle_process_outputs
    for result in results:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 1455, in process
    element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/transforms/core.py",> line 331, in split_and_size
    for part in self.split(element, restriction):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/iobase.py",> line 1641, in split
    estimated_size = restriction.source().estimate_size()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py",> line 697, in estimate_size
    bq = bigquery_tools.BigQueryWrapper()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_tools.py",> line 338, in __init__
    "user-agent": "apache-beam-%s" % apache_beam.__version__
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",> line 58, in __init__
    response_encoding=response_encoding)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 261, in __init__
    self._SetCredentials(**credentials_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py",> line 309, in _SetCredentials
    self._credentials = credentials_lib.GetCredentials(**args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 154, in GetCredentials
    oauth2client_args=oauth2client_args)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/credentials_lib.py",> line 560, in CredentialsFromFile
    credentials = tools.run_flow(flow, credential_store, flags)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/_helpers.py",> line 133, in positional_wrapper
    return wrapped(*args, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/oauth2client/tools.py",> line 240, in run_flow
    code = input('Enter verification code: ').strip()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/_pytest/capture.py",> line 193, in read
    "pytest: reading from stdin while output is captured!  Consider using `-s`."
OSError: pytest: reading from stdin while output is captured!  Consider using `-s`. [while running 'read table/Read/SDFBoundedSourceReader/ParDo(SDFBoundedSourceDoFn)/SplitAndSize0']

INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 3:50:56 AM org.apache.flink.runtime.blob.BlobServer close
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped BLOB server at 0.0.0.0:42977
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 15, 2022 3:50:56 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService lambda$stopService$8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Stopped Akka RPC service.
FAILED                                                                   [ 95%]
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays ERROR [ 95%]
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics 
-------------------------------- live log call ---------------------------------
INFO     root:pipeline.py:188 Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.

> Task :sdks:python:test-suites:portable:py39:flinkExamples
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[set_column_DataFrame_139716307975376], ComputedExpression[set_index_DataFrame_139714738583152], ComputedExpression[pre_combine_sum_DataFrame_139716065691056]]:139716065689808]> for Stage[inputs={PlaceholderExpression[placeholder_DataFrame_139716070995904]}, partitioning=Arbitrary, ops=[ComputedExpression[set_column_DataFrame_139716307975376], ComputedExpression[set_index_DataFrame_139714738583152], ComputedExpression[pre_combine_sum_DataFrame_139716065691056]], outputs={PlaceholderExpression[placeholder_DataFrame_139716070995904], ComputedExpression[pre_combine_sum_DataFrame_139716065691056]}]
INFO     root:transforms.py:182 Computing dataframe stage <ComputeStage(PTransform) label=[[ComputedExpression[post_combine_sum_DataFrame_139716065690624]]:139716068757664]> for Stage[inputs={ComputedExpression[pre_combine_sum_DataFrame_139716065691056]}, partitioning=Index, ops=[ComputedExpression[post_combine_sum_DataFrame_139716065690624]], outputs={ComputedExpression[post_combine_sum_DataFrame_139716065690624]}]
INFO     apache_beam.io.fileio:fileio.py:595 Added temporary directory /tmp/.tempba4c61f6-33e3-425d-a230-ee7c5f339d62
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.9_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function annotate_downstream_side_inputs at 0x7f11f98a9c10> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function fix_side_input_pcoll_coders at 0x7f11f98a9d30> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f11f98ad280> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f11f98ad310> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_sdf at 0x7f11f98ad4c0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function expand_gbk at 0x7f11f98ad550> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sink_flattens at 0x7f11f98ad670> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function greedily_fuse at 0x7f11f98ad700> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function read_to_impulse at 0x7f11f98ad790> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function impulse_to_input at 0x7f11f98ad820> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f11f98ada60> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function add_impulse_to_dangling_transforms at 0x7f11f98adb80> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function setup_timer_mapping at 0x7f11f98ad9d0> ====================
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #994

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/994/display/redirect?page=changes>

Changes:

[Moritz Mack] [Spark dataset runner] Add direct translation of Reshuffle and


------------------------------------------
[...truncated 50.16 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:34833 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-14T21:46:43.736949363+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:37205 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-14T21:47:22.606350467+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2510: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:35295 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-14T21:48:14.305311702+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:38419 {created_time:"2022-10-14T21:48:38.153093346+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 38 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:32861 {created_time:"2022-10-14T21:51:22.565443329+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 88 warnings, 2 errors in 706.60s (0:11:46) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 52s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/yruq5r6gekwui

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #993

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/993/display/redirect?page=changes>

Changes:

[Moritz Mack] Minor improvements to the tpcds gradle build for Spark

[Moritz Mack] Fix SparkSessionFactory to not fail when using Spark master local[*]


------------------------------------------
[...truncated 50.25 MB...]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
        state_thread = threading.Thread(
            target=functools.partial(self._observe_state, message_thread),
            name='wait_until_finish_state_observer')
        state_thread.daemon = True
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
        state_thread.start()
        start_time = time.time()
        duration_secs = duration / 1000
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:45553 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-14T15:44:48.389695412+00:00"}"
>

>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1014154458-b05772e4_33e10286-01af-4c0d-b6d4-5ce20ff3805a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:37701
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fe7e43e7440> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fe7e43e74d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fe7e43e7c20> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-temp696hhsfe/artifactspvuyqfpv' '--job-port' '59173' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:56 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:56 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:37249
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:57 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:41859
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:57 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:59173
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:57 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:59173.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:58 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_c0ad37d3-3cc5-41e7-89f1-0aacc38d93a0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:58 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_c0ad37d3-3cc5-41e7-89f1-0aacc38d93a0.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:58 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_c0ad37d3-3cc5-41e7-89f1-0aacc38d93a0.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:58 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_c0ad37d3-3cc5-41e7-89f1-0aacc38d93a0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:59 PM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1014154458-b05772e4_33e10286-01af-4c0d-b6d4-5ce20ff3805a with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@ce19db8
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:59 PM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1014154458-b05772e4_33e10286-01af-4c0d-b6d4-5ce20ff3805a
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:59 PM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 14, 2022 3:44:59 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1014154458-b05772e4_33e10286-01af-4c0d-b6d4-5ce20ff3805a.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665762292319.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 41 warnings, 2 errors in 491.69s (0:08:11) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 56s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mhlz3nqk6qanw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #992

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/992/display/redirect?page=changes>

Changes:

[Moritz Mack] Align translation logging for Spark dataset runner with rdd runner for


------------------------------------------
[...truncated 50.21 MB...]
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665740736766.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 41 warnings, 2 errors in 533.78s (0:08:53) =

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:37015 {created_time:"2022-10-14T09:43:36.380842169+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:37521 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-14T09:44:07.852557418+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:43143 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-14T09:44:09.316251252+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:39593 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-14T09:45:05.108391876+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:34425 {created_time:"2022-10-14T09:45:33.205746953+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 35s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/my6qq4jxyeqwo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #991

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/991/display/redirect?page=changes>

Changes:

[noreply] Bump Legacy dataflow container image tag (#23625)


------------------------------------------
[...truncated 50.30 MB...]
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665719103617.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_te  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
st.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:43193 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-14T03:43:37.707192567+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:41711 {created_time:"2022-10-14T03:43:38.465488458+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:35003 {created_time:"2022-10-14T03:44:31.498537746+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 41 warnings, 2 errors in 503.79s (0:08:23) =
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:38861 {created_time:"2022-10-14T03:45:00.129755264+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:45747 {created_time:"2022-10-14T03:45:00.381652135+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 8s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7v36ataaa5rqe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #990

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/990/display/redirect?page=changes>

Changes:

[Kiley Sok] Add agent to open modules

[Kiley Sok] check for empty

[Kiley Sok] limit to jamm and update comments

[Kiley Sok] reuse options, pr comments

[rszper] Added content: The direct runner is not suited to production pipelines

[yixiaoshen] Remove artificial timeout in FirestoreV1IT, Dataflow runner is very slow

[noreply] Update

[noreply] Merge pull request #23524: Adding beam blog info to the Community page

[noreply] Update publish_release_notes to generate PR list (#23630)


------------------------------------------
[...truncated 50.16 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:45331 {created_time:"2022-10-13T21:43:31.98209857+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:46481 {created_time:"2022-10-13T21:44:06.110125682+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2510: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:36101 {created_time:"2022-10-13T21:44:57.41985148+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:32945 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T21:45:22.578013395+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 44 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:36891 {created_time:"2022-10-13T21:47:57.464871482+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 94 warnings, 2 errors in 471.69s (0:07:51) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 19s
133 actionable tasks: 88 executed, 43 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tfwkoo446pcjo

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #989

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/989/display/redirect?page=changes>

Changes:

[noreply] Use new github output format (#23624)

[noreply] Tour of Beam frontend state management (#23420) (#23572)


------------------------------------------
[...truncated 50.06 MB...]
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665675794614.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 41 warnings, 2 errors in 270.77s (0:04:30) =
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:45173 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T15:41:56.763548521+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:34675 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T15:41:58.773977586+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39995 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T15:42:42.691600236+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37019 {created_time:"2022-10-13T15:42:43.47186902+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36669 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T15:43:12.055348681+00:00"}"
>


> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 6m 16s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bgoedgct7cdmu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #988

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/988/display/redirect>

Changes:


------------------------------------------
[...truncated 50.10 MB...]
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:40125 {created_time:"2022-10-13T09:43:38.010807275+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:45913 {created_time:"2022-10-13T09:44:09.560047382+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2510: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:45967 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T09:45:02.363288245+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:46751 {created_time:"2022-10-13T09:45:29.713082272+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 41 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:44683 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T09:48:31.986171514+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 91 warnings, 2 errors in 535.56s (0:08:55) =

> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 49s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/whfy4xwfwff7k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #987

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/987/display/redirect?page=changes>

Changes:

[noreply] Extend a timeout to create a bt cluster. (#23617)


------------------------------------------
[...truncated 50.05 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:44331 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T03:42:47.973214405+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:36899 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-13T03:43:21.556466957+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2510: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:33587 {created_time:"2022-10-13T03:44:15.412696522+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:41255 {created_time:"2022-10-13T03:44:44.046032531+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 44 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:44337 {created_time:"2022-10-13T03:47:37.142184701+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 94 warnings, 2 errors in 483.78s (0:08:03) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 49s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/msnlcocyhf7l2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #986

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/986/display/redirect?page=changes>

Changes:

[noreply] Migrate GcsOptions#getExecutorService to an unbounded

[noreply] (BQ Java) Explicitly set coder for multi-partition batch load writes 

[noreply] Fix typo in bootstrap_beam_venv.py (#23574)

[noreply] Bump github.com/spf13/cobra from 1.5.0 to 1.6.0 in /sdks (#23591)

[noreply] [Playground][Tour Of Beam] Datastore entities split by origin (#23088)

[noreply] use write schema only for read api (#23594)

[noreply] [Go SDK]: SingleFlight bundle descriptor requests (#23589)


------------------------------------------
[...truncated 50.23 MB...]
        duration_secs = duration / 1000
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1012214901-ae8a1fb7_d5ca5cc9-94bb-4421-b652-ce8377905639 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:43253
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f000c9f03b0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f000c9f0440> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f000c9f0b90> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempkm988bn3/artifacts3cql59wz' '--job-port' '49307' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:48:58 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:48:58 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:38175
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:48:59 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:44289
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:48:59 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:49307
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:48:59 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:49:01 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_c2b9d61a-3a39-43b3-afff-efb9dae0782b.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:49:01 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_c2b9d61a-3a39-43b3-afff-efb9dae0782b.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:49:01 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_c2b9d61a-3a39-43b3-afff-efb9dae0782b.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:49:01 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_c2b9d61a-3a39-43b3-afff-efb9dae0782b.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:49:02 PM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1012214901-ae8a1fb7_d5ca5cc9-94bb-4421-b652-ce8377905639 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@569d40e
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:49:02 PM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1012214901-ae8a1fb7_d5ca5cc9-94bb-4421-b652-ce8377905639
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:49:02 PM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:49:02 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1012214901-ae8a1fb7_d5ca5cc9-94bb-4421-b652-ce8377905639.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665611335836.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:35819 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-12T21:51:46.272755861+00:00"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 41 warnings, 2 errors in 505.40s (0:08:25) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 13m 51s
133 actionable tasks: 90 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/yarwx7n2nzatq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #985

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/985/display/redirect?page=changes>

Changes:

[Alexey Romanenko] [website][adhoc] Fix spellcheck errors and typos


------------------------------------------
[...truncated 50.14 MB...]
          else:
            current_state = message.state_response.state
            if current_state != previous_state:
              _LOGGER.info(
                  "Job state changed to %s",
                  self.runner_api_state_to_pipeline_state(current_state))
              previous_state = current_state
          self._messages.append(message)
    
      message_thread = threading.Thread(
          target=read_messages, name='wait_until_finish_read')
      message_thread.daemon = True
      message_thread.start()
    
      if duration:
        state_thread = threading.Thread(
            target=functools.partial(self._observe_state, message_thread),
            name='wait_until_finish_state_observer')
        state_thread.daemon = True
        state_thread.start()
        start_time = time.time()
        duration_secs = duration / 1000
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1012154445-74e9d5e0_fd6bd324-3b95-44c9-ad0f-0db9d1820f91 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:40219
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f49f24ee3b0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f49f24ee440> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f49f24eeb90> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-temphhs4499l/artifactsb2p3coa9' '--job-port' '59955' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:43 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:44 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:35837
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:44 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:40437
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:44 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:59955
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:44 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:44 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_35730ab2-321d-4d07-872f-17203e676b78.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:44 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_35730ab2-321d-4d07-872f-17203e676b78.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:44 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_35730ab2-321d-4d07-872f-17203e676b78.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:44 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_35730ab2-321d-4d07-872f-17203e676b78.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:45 PM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1012154445-74e9d5e0_fd6bd324-3b95-44c9-ad0f-0db9d1820f91 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@74dccb6b
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:45 PM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1012154445-74e9d5e0_fd6bd324-3b95-44c9-ad0f-0db9d1820f91
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:45 PM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:45 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1012154445-74e9d5e0_fd6bd324-3b95-44c9-ad0f-0db9d1820f91.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665589481314.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 41 warnings, 2 errors in 469.22s (0:07:49) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 33s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7uqmt2wrmmgra

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #984

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/984/display/redirect?page=changes>

Changes:

[noreply] Remove obsolete and deprecated bigquery native write. #23557 (#23558)

[noreply] Increase Python PostCommit timeout. (#23595)


------------------------------------------
[...truncated 50.22 MB...]
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1012094535-3616d43_155fafb2-bc88-4fda-8676-e02faa97bc3b failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:37393
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f5f9e8f33b0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f5f9e8f3440> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f5f9e8f3b90> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempaakxasyt/artifactssnmiexa8' '--job-port' '52507' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:34 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:34 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:39961
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:34 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:44241
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:34 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:52507
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:34 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:35 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_83c7df4e-5f39-4f86-9504-5e8b0698edf9.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:35 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_83c7df4e-5f39-4f86-9504-5e8b0698edf9.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:35 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_83c7df4e-5f39-4f86-9504-5e8b0698edf9.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:35 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_83c7df4e-5f39-4f86-9504-5e8b0698edf9.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:35 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1012094535-3616d43_155fafb2-bc88-4fda-8676-e02faa97bc3b with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@e6f4af2
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:36 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1012094535-3616d43_155fafb2-bc88-4fda-8676-e02faa97bc3b
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:36 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 9:45:36 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1012094535-3616d43_155fafb2-bc88-4fda-8676-e02faa97bc3b.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665567930882.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1991: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1997: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2484: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2486: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2517: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1987: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6632 deselected, 41 warnings, 2 errors in 526.56s (0:08:46) =
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:38103 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-12T09:48:21.235512813+00:00"}"
>


> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 28s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/cjcq3tbxwioi6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #983

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/983/display/redirect?page=changes>

Changes:

[noreply] Feature/name all java threads (#23387)

[noreply] [Go SDK] Don't construct plans in lock section. (#23583)


------------------------------------------
[...truncated 50.12 MB...]
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f5cd7c4fc20> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempvi8qubiu/artifacts3_a708jf' '--job-port' '53831' '--artifact-port' '0' '--expansion-port' '0']
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:56 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:40771 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-12T03:44:49.923454819+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
 WARNING: Unable to retrieve the requested metadata.
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:35955 {created_time:"2022-10-12T03:47:34.344702254+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:56 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:39029
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:56 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:46295
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:56 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:53831
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:44:56 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:53831.
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:53831.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:45:00 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_286b68ff-0395-4a00-b45a-611865e64407.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:45:00 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_286b68ff-0395-4a00-b45a-611865e64407.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:45:00 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_286b68ff-0395-4a00-b45a-611865e64407.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:45:00 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_286b68ff-0395-4a00-b45a-611865e64407.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:45:00 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1012034500-e052965e_82fe1e9d-3002-42f9-be42-53a1470f580d with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@99630ea
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:45:00 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1012034500-e052965e_82fe1e9d-3002-42f9-be42-53a1470f580d
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:45:01 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 12, 2022 3:45:01 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1012034500-e052965e_82fe1e9d-3002-42f9-be42-53a1470f580d.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665546293114.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2152: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2158: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2642: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2644: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2675: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2148: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6647 deselected, 41 warnings, 2 errors in 488.86s (0:08:08) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 51s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/3242yi4di4csw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #982

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/982/display/redirect?page=changes>

Changes:

[Robert Bradshaw] Add a multi-process shared utility.

[Robert Bradshaw] Add fastener dependency.

[Robert Bradshaw] Refactor to have an explicit acquire/release API.

[Robert Bradshaw] Drop a TODO about deferred construction parameterization.

[Robert Bradshaw] Fix unused import/var.

[Moritz Mack] Replace website references to deprecated aws / kinesis modules with more

[noreply] Add database role to SpannerConfig for role-based access control.

[noreply] Remove obsolete and deprecated bigquery native read. (#23557)


------------------------------------------
[...truncated 50.11 MB...]
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1011214721-79d88df7_2707d0dc-1c45-4e38-a926-a81582452c9d failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:42417
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f1d3ee77440> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f1d3ee774d0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f1d3ee77c20> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-temprzroqb1w/artifactsrua3ou7p' '--job-port' '40989' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:19 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:20 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:43891
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:20 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:40941
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:20 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:40989
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:20 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:40989.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:21 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_fe5fa21d-3ad9-4d07-9dea-a670d6022279.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:21 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_fe5fa21d-3ad9-4d07-9dea-a670d6022279.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:21 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_fe5fa21d-3ad9-4d07-9dea-a670d6022279.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:21 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_fe5fa21d-3ad9-4d07-9dea-a670d6022279.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:22 PM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1011214721-79d88df7_2707d0dc-1c45-4e38-a926-a81582452c9d with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@7f65449a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:22 PM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1011214721-79d88df7_2707d0dc-1c45-4e38-a926-a81582452c9d
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:22 PM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:47:22 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1011214721-79d88df7_2707d0dc-1c45-4e38-a926-a81582452c9d.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665524834805.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2152: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2158: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2642: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2644: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2675: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2148: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or


Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6647 deselected, 41 warnings, 2 errors in 540.70s (0:09:00) =
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:42419 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-11T21:50:09.821049811+00:00"}"
>


> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 29s
133 actionable tasks: 89 executed, 42 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tkaodccxvphje

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #981

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/981/display/redirect?page=changes>

Changes:

[git] BEAM-13592 Add getOrderingKey in

[git] Add CHANGES entry

[git] Rename transform name according to review comment

[git] Update  to pass ordering key

[egalpin] Adds ordering key to OutgoingMessage builder, adds new coders to pubsub

[egalpin] Fixes pubsub bounded writer allowing for orderingKey

[egalpin] Alters order of pubsub message support in registrar

[egalpin] Removed publishTime and messageId in grpc pubsub client publish

[egalpin] Attempts to allow different pubsub root url for PubsubIO.Write

[egalpin] Fixes pubsub tests root url

[egalpin] Puts PubsubMessageCoder last in registrar

[egalpin] Uses MoreObjects over Objects

[egalpin] Renames PubsubMessageCoder to

[noreply] fix distribution example in golang guide (#23567)


------------------------------------------
[...truncated 50.17 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:39467 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-11T15:46:51.171115508+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:33839 {created_time:"2022-10-11T15:47:43.309849679+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2801: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:46115 {created_time:"2022-10-11T15:48:48.298011541+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:37647 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-11T15:49:18.398727938+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 39 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:39261 {created_time:"2022-10-11T15:52:15.156493343+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6664 deselected, 89 warnings, 2 errors in 559.41s (0:09:19) =

> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 22s
133 actionable tasks: 90 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5skg2rtbono7m

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #980

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/980/display/redirect?page=changes>

Changes:

[Moritz Mack] Downgrade Scala version in Spark job-server to prevent Scala


------------------------------------------
[...truncated 50.01 MB...]
              _LOGGER.info(
                  "Job state changed to %s",
                  self.runner_api_state_to_pipeline_state(current_state))
              previous_state = current_state
          self._messages.append(message)
    
      message_thread = threading.Thread(
          target=read_messages, name='wait_until_finish_read')
      message_thread.daemon = True
      message_thread.start()
    
      if duration:
        state_thread = threading.Thread(
            target=functools.partial(self._observe_state, message_thread),
            name='wait_until_finish_state_observer')
        state_thread.daemon = True
        state_thread.start()
        start_time = time.time()
        duration_secs = duration / 1000
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1011094559-62646d1f_3ce520f0-70c2-4c8a-9cbf-fc795417b3a0 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:46113
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f8950560680> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f8950560710> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f8950560e60> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-temp94g05jin/artifactsog_u7fko' '--job-port' '43513' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:56 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:57 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:43133
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:57 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:37557
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:57 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:43513
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:57 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:43513.
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:43513.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:59 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_c01f9de5-8caa-4b4c-aeda-95509c5c74eb.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:59 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_c01f9de5-8caa-4b4c-aeda-95509c5c74eb.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:59 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_c01f9de5-8caa-4b4c-aeda-95509c5c74eb.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:45:59 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_c01f9de5-8caa-4b4c-aeda-95509c5c74eb.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:46:00 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1011094559-62646d1f_3ce520f0-70c2-4c8a-9cbf-fc795417b3a0 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@501fc60a
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:46:00 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1011094559-62646d1f_3ce520f0-70c2-4c8a-9cbf-fc795417b3a0
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:46:00 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 11, 2022 9:46:01 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1011094559-62646d1f_3ce520f0-70c2-4c8a-9cbf-fc795417b3a0.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665481552213.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2808: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()


apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6664 deselected, 41 warnings, 2 errors in 591.23s (0:09:51) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 11m 21s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/mrglyguyu3ipi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #979

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/979/display/redirect?page=changes>

Changes:

[noreply] [Playground] complexity indicator (#23477)

[noreply] Reolling forward property-based tests for coders (#23425)

[noreply] Updated README for jupyterlab-sidepanel


------------------------------------------
[...truncated 50.15 MB...]
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665459917768.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2808: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:45463 {created_time:"2022-10-11T03:45:14.58781854+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:40557 {created_time:"2022-10-11T03:45:14.7325864+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:39749 {created_time:"2022-10-11T03:45:15.509816102+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:46273 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-11T03:48:14.214811346+00:00"}"
>

apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6664 deselected, 41 warnings, 2 errors in 509.44s (0:08:29) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 21s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tccrby4b7dqsu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #978

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/978/display/redirect?page=changes>

Changes:

[bulat.safiullin] [Website] update python-dependencies.md link #23478

[bulat.safiullin] [Website] update styles of iframe with video #23499

[bulat.safiullin] [Website] add version.html to shortcodes, update jet.md 22985

[noreply] Support named databases in Firestore connector. Fix and enable Firestore

[noreply] [fixes #23000] Update the Python SDK harness state cache to be a loading

[noreply] Fix permission for Build python wheel branch_repo_nightly step (#23563)


------------------------------------------
[...truncated 50.10 MB...]
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1010214753-76973320_8e5aa923-94a3-4eb6-a3d9-56a8636d0c04 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:35137
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f0c26c899e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f0c26c89a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f0c26c86200> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempiliitu90/artifacts0yzten4j' '--job-port' '33935' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:50 PM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:51 PM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:38369
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:51 PM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:35823
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:51 PM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:33935
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:51 PM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:33935.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:52 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_1dba31ef-21f5-4652-ac7e-dda932e800d6.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:52 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_1dba31ef-21f5-4652-ac7e-dda932e800d6.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:52 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_1dba31ef-21f5-4652-ac7e-dda932e800d6.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:52 PM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_1dba31ef-21f5-4652-ac7e-dda932e800d6.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:53 PM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1010214753-76973320_8e5aa923-94a3-4eb6-a3d9-56a8636d0c04 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@5fb8d382
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:53 PM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1010214753-76973320_8e5aa923-94a3-4eb6-a3d9-56a8636d0c04
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:53 PM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:47:54 PM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1010214753-76973320_8e5aa923-94a3-4eb6-a3d9-56a8636d0c04.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"

coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665438466978.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:37095 {created_time:"2022-10-10T21:47:43.279818672+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2808: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6660 deselected, 41 warnings, 2 errors in 489.29s (0:08:09) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 12m 46s
133 actionable tasks: 90 executed, 41 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/2qhdbki6vxo4u

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #977

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/977/display/redirect>

Changes:


------------------------------------------
[...truncated 50.23 MB...]
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38183 {created_time:"2022-10-10T16:02:24.062372553+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:36599 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-10T16:02:57.72683402+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2801: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:38459 {created_time:"2022-10-10T16:04:15.412854382+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43337 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-10T16:04:44.639283473+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 40 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:37311 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-10T16:09:07.115575419+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/wordcount_debugging_test.py::WordCountDebuggingTest::test_basics
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 4 failed, 18 passed, 4 skipped, 6658 deselected, 90 warnings, 2 errors in 1707.16s (0:28:27) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 31m 17s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/eavxfgdocfqgc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #976

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/976/display/redirect>

Changes:


------------------------------------------
[...truncated 50.13 MB...]
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f4307752200> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-tempmj1l2trh/artifactsq2l3m7l0' '--job-port' '41591' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:47 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:47 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:42703
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:48 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:34483
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:48 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:41591
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:48 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:41591.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:51 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_4af6a467-3a52-4600-af94-f635bdd80908.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:51 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_4af6a467-3a52-4600-af94-f635bdd80908.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:51 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_4af6a467-3a52-4600-af94-f635bdd80908.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:51 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_4af6a467-3a52-4600-af94-f635bdd80908.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:52 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1010094551-a28c27c0_8fdafd72-8c89-4b44-9dd8-15779b0f5fd5 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@62989fa4
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:52 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1010094551-a28c27c0_8fdafd72-8c89-4b44-9dd8-15779b0f5fd5
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:52 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 9:45:53 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1010094551-a28c27c0_8fdafd72-8c89-4b44-9dd8-15779b0f5fd5.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665395144795.

=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

    raise self
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:37291 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-10T09:45:41.556549938+00:00"}"
>

Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
  File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.7/threading.py", line 870, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
    target=lambda: self._read_inputs(elements_iterator),
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:44263 {created_time:"2022-10-10T09:48:31.554761303+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
>

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2808: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6658 deselected, 41 warnings, 2 errors in 534.49s (0:08:54) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 10m 38s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vdsqbq4zwgkl4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #975

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/975/display/redirect>

Changes:


------------------------------------------
[...truncated 50.15 MB...]
    
      if duration:
        state_thread = threading.Thread(
            target=functools.partial(self._observe_state, message_thread),
            name='wait_until_finish_state_observer')
        state_thread.daemon = True
        state_thread.start()
        start_time = time.time()
        duration_secs = duration / 1000
        while (time.time() - start_time < duration_secs and
               state_thread.is_alive()):
          time.sleep(1)
      else:
        self._observe_state(message_thread)
    
      if self._runtime_exception:
>       raise self._runtime_exception
E       RuntimeError: Pipeline BeamApp-jenkins-1010034435-7d16343c_73c4e3d9-a0b7-4bfa-b760-46d2370f6b23 failed in state FAILED: java.  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
    for elements in elements_iterator:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.CANCELLED
	details = "Multiplexer hanging up"
	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:32935 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-10T03:47:16.069657415+00:00"}"
>

lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
E       coder_id: "ref_Coder_FastPrimitivesCoder_3"
E       is_bounded: BOUNDED
E       windowing_strategy_id: "ref_Windowing_Windowing_1"
E       }] were consumed but never produced

apache_beam/runners/portability/portable_runner.py:607: RuntimeError
------------------------------ Captured log call -------------------------------
INFO     apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93 Listening for workers at localhost:36795
INFO     root:environments.py:376 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.43.0.dev
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7f71ea7119e0> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7f71ea711a70> ====================
INFO     apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7f71ea710200> ====================
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.43.0-SNAPSHOT.jar'> '--flink-master' '[auto]' '--artifacts-dir' '/tmp/beam-temp3kmxetdj/artifacts_edai0if' '--job-port' '35983' '--artifact-port' '0' '--expansion-port' '0']
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:31 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 WARNING: Unable to retrieve the requested metadata.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: ArtifactStagingService started on localhost:45983
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Java ExpansionService started on localhost:45647
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: JobService started on localhost:35983
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:32 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Job server now running, terminate with Ctrl+C
WARNING  root:subprocess_server.py:98 Waiting for grpc channel to be ready at localhost:35983.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:35 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Staging artifacts for job_7f5626f5-bf5a-4793-814e-180b0e01cded.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:35 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 resolveNextEnvironment
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Resolving artifacts for job_7f5626f5-bf5a-4793-814e-180b0e01cded.ref_Environment_default_environment_1.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:35 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 onNext
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Getting 0 artifacts for job_7f5626f5-bf5a-4793-814e-180b0e01cded.null.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:35 AM org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$2 finishStaging
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Artifacts fully staged for job_7f5626f5-bf5a-4793-814e-180b0e01cded.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:36 AM org.apache.beam.runners.flink.FlinkJobInvoker invokeWithExecutor
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Invoking job BeamApp-jenkins-1010034435-7d16343c_73c4e3d9-a0b7-4bfa-b760-46d2370f6b23 with pipeline runner org.apache.beam.runners.flink.FlinkPipelineRunner@6d91fb69
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:36 AM org.apache.beam.runners.jobsubmission.JobInvocation start
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Starting job invocation BeamApp-jenkins-1010034435-7d16343c_73c4e3d9-a0b7-4bfa-b760-46d2370f6b23
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:458 Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
  with Pipeline() as p:
    p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STOPPED
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to STARTING
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to RUNNING
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:36 AM org.apache.beam.runners.flink.FlinkPipelineRunner runPipelineWithTranslator
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 INFO: Translating pipeline to Flink program.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 Oct 10, 2022 3:44:36 AM org.apache.beam.runners.jobsubmission.JobInvocation$1 onFailure
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 SEVERE: Error during job invocation BeamApp-jenkins-1010034435-7d16343c_73c4e3d9-a0b7-4bfa-b760-46d2370f6b23.
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 coder_id: "ref_Coder_FastPrimitivesCoder_3"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 is_bounded: BOUNDED
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 windowing_strategy_id: "ref_Windowing_Windowing_1"
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 }] were consumed but never produced
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkArgument(Preconditions.java:440)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.buildNetwork(QueryablePipeline.java:234)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.<init>(QueryablePipeline.java:127)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.QueryablePipeline.forTransforms(QueryablePipeline.java:107)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.core.construction.graph.FusedPipeline.toPipeline(FusedPipeline.java:81)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:112)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:85)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 	at java.lang.Thread.run(Thread.java:750)
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:126 
ERROR    root:portable_runner.py:577 java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_60, PCollection=unique_name: "64SaveToBQ/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.None"
coder_id: "ref_Coder_FastPrimitivesCoder_3"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
INFO     apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED
INFO     apache_beam.io.gcp.tests.utils:utils.py:98 Clean up a BigQuery table with project: apache-beam-testing, dataset: FiltersTestIT, table: cold_days_1665373469173.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
    from imp import load_source

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2808: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    | _PassThroughThenCleanup(files_to_remove_pcoll))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:664: FutureWarning: WriteToFiles is experimental.
    sink=lambda _: _WriteToPandasFileSink(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py37.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6658 deselected, 41 warnings, 2 errors in 465.29s (0:07:45) =

> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 23s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7y4zsvjymrpfy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python_Examples_Flink #974

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/974/display/redirect>

Changes:


------------------------------------------
[...truncated 50.12 MB...]
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:33511 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-09T21:42:39.204640709+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:38821 {created_time:"2022-10-09T21:43:12.615767458+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2801: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:34255 {created_time:"2022-10-09T21:44:04.404871109+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:33419 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-09T21:44:34.069642525+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/dataframe/io.py>:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/io/fileio.py>:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py>:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py",> line 654, in _read_inputs
      for elements in elements_iterator:
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 426, in __next__
      return self._next()
    File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py",> line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv4:127.0.0.1:40623 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-10-09T21:47:19.963787682+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/pytest_postCommitExamples-flink-py39.xml> -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6658 deselected, 93 warnings, 2 errors in 463.27s (0:07:43) =

> Task :sdks:python:test-suites:portable:py39:flinkExamples FAILED
> Task :sdks:python:test-suites:portable:py37:flinkExamples FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 240

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:flinkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 9m 33s
133 actionable tasks: 87 executed, 44 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xjteovwnilzyu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org