You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/10/09 01:44:24 UTC

Build failed in Jenkins: beam_PostCommit_Python_Examples_Spark #935

See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/935/display/redirect?page=changes>

Changes:

[srohde] Add documentation link to the interactive environment

[noreply] Fix Small pytorch notebook bug fix (#23407)

[noreply] PubsubIO - Improve limit validations to consider attributes (#23023)

[noreply] Example of Online Clustering  (#23289)

[noreply] Bump google.golang.org/api from 0.97.0 to 0.98.0 in /sdks (#23394)

[noreply] Increase Go Dataflow Postcommit timeout to 5h (#23423)

[noreply] [Playground] [Backend] Updating endpoints for playground examples

[noreply] Send JavaScript messages to Playground iframes when switching the

[noreply] [Playground] [Backend] Adding SDK to the example response (#22871)


------------------------------------------
[...truncated 1.61 MB...]

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/bigquery.py:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py:1133: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py:1135: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/runners/worker/data_plane.py", line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/runners/worker/data_plane.py", line 654, in _read_inputs
      for elements in elements_iterator:
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py", line 426, in __next__
      return self._next()
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py", line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43851 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-09-29T19:29:27.960910885+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/bigquery.py:2775: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    temp_location = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/bigquery.py:2777: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/bigquery.py:2801: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    pipeline_options=pcoll.pipeline.options,

apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/runners/worker/data_plane.py", line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/runners/worker/data_plane.py", line 654, in _read_inputs
      for elements in elements_iterator:
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py", line 426, in __next__
      return self._next()
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py", line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:43227 {grpc_message:"Multiplexer hanging up", grpc_status:1, created_time:"2022-09-29T19:30:08.644828315+00:00"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/bigquery.py:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py:1126: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    self.project = self.project or p.options.view_as(GoogleCloudOptions).project

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/gcp/tests/utils.py:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/runners/worker/data_plane.py", line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/runners/worker/data_plane.py", line 654, in _read_inputs
      for elements in elements_iterator:
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py", line 426, in __next__
      return self._next()
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py", line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:41705 {created_time:"2022-09-29T19:30:12.483868474+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

apache_beam/examples/dataframe/flight_delays_it_test.py: 43 warnings
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError.  Select only valid columns before calling the reduction.
    return airline_df[at_top_airports].mean()

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/dataframe/io.py:659: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/io/fileio.py:590: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/_pytest/threadexception.py:73: PytestUnhandledThreadExceptionWarning: Exception in thread read_grpc_client_inputs
  
  Traceback (most recent call last):
    File "/usr/lib/python3.9/threading.py", line 973, in _bootstrap_inner
      self.run()
    File "/usr/lib/python3.9/threading.py", line 910, in run
      self._target(*self._args, **self._kwargs)
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/runners/worker/data_plane.py", line 671, in <lambda>
      target=lambda: self._read_inputs(elements_iterator),
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/apache_beam/runners/worker/data_plane.py", line 654, in _read_inputs
      for elements in elements_iterator:
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py", line 426, in __next__
      return self._next()
    File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/build/gradleenv/2022703443/lib/python3.9/site-packages/grpc/_channel.py", line 826, in _next
      raise self
  grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
  	status = StatusCode.CANCELLED
  	details = "Multiplexer hanging up"
  	debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:39277 {created_time:"2022-09-29T19:31:39.180511321+00:00", grpc_status:1, grpc_message:"Multiplexer hanging up"}"
  >
  
    warnings.warn(pytest.PytestUnhandledThreadExceptionWarning(msg))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: /home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/pytest_postCommitExamples-spark-py39.xml -
=========================== short test summary info ============================
FAILED apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
FAILED apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
FAILED apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
ERROR apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
ERROR apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
= 3 failed, 19 passed, 4 skipped, 6649 deselected, 94 warnings, 2 errors in 249.77s (0:04:09) =

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/test-suites/portable/common.gradle' line: 271

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:sparkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python_Examples_Spark/src/sdks/python/test-suites/portable/common.gradle' line: 271

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:sparkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 5m 42s
80 actionable tasks: 51 executed, 27 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/rhgn6iokg47sa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
FATAL: java.io.IOException: Pipe closed after 0 cycles
java.io.IOException: Pipe closed after 0 cycles
	at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:126)
	at org.apache.sshd.common.channel.ChannelPipedInputStream.read(ChannelPipedInputStream.java:105)
	at hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:94)
	at hudson.remoting.ChunkedInputStream.readHeader(ChunkedInputStream.java:75)
	at hudson.remoting.ChunkedInputStream.readUntilBreak(ChunkedInputStream.java:105)
	at hudson.remoting.ChunkedCommandTransport.readBlock(ChunkedCommandTransport.java:39)
	at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:61)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to apache-beam-jenkins-3
		at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1784)
		at hudson.remoting.Request.call(Request.java:199)
		at hudson.remoting.Channel.call(Channel.java:999)
		at hudson.Launcher$RemoteLauncher.kill(Launcher.java:1150)
		at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
		at hudson.model.Run.execute(Run.java:1896)
		at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
		at hudson.model.ResourceController.execute(ResourceController.java:101)
		at hudson.model.Executor.run(Executor.java:442)
Caused: hudson.remoting.RequestAbortedException
	at hudson.remoting.Request.abort(Request.java:345)
	at hudson.remoting.Channel.terminate(Channel.java:1080)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:90)
ERROR: apache-beam-jenkins-3 is offline; cannot locate jdk_1.8_latest

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org