You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kamil Wasilewski (Jira)" <ji...@apache.org> on 2020/01/02 11:08:00 UTC
[jira] [Commented] (BEAM-9028)
bigquery_read_it_test.ReadTests.test_iobase_source: grpc error
[ https://issues.apache.org/jira/browse/BEAM-9028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006733#comment-17006733 ]
Kamil Wasilewski commented on BEAM-9028:
----------------------------------------
We use local embedded Flink cluster here and the test had failed most probably because of low memory on worker. I took a look on recent failed and aborted Python 3.7 PostCommit tasks and there were no further errors in _test_iobase_source_ tests. Let's observe this for some time, if that happened again, we could use an external Flink cluster instead.
> bigquery_read_it_test.ReadTests.test_iobase_source: grpc error
> --------------------------------------------------------------
>
> Key: BEAM-9028
> URL: https://issues.apache.org/jira/browse/BEAM-9028
> Project: Beam
> Issue Type: Bug
> Components: io-py-gcp
> Reporter: Udi Meiri
> Assignee: Kamil Wasilewski
> Priority: Major
>
> It's not clear what the root cause is (there's also a "cannot allocate memory" error message).
> {code}
> 14:16:06 ERROR: test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests)
> 14:16:06 ----------------------------------------------------------------------
> 14:16:06 Traceback (most recent call last):
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py", line 154, in test_iobase_source
> 14:16:06 assert_that(result, equal_to(self.TABLE_DATA))
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/pipeline.py", line 480, in __exit__
> 14:16:06 self.run().wait_until_finish()
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/pipeline.py", line 460, in run
> 14:16:06 self._options).run(False)
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/pipeline.py", line 473, in run
> 14:16:06 return self.runner.run_pipeline(self, self._options)
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/portability/flink_runner.py", line 45, in run_pipeline
> 14:16:06 return super(FlinkRunner, self).run_pipeline(pipeline, options)
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/portability/portable_runner.py", line 330, in run_pipeline
> 14:16:06 result.wait_until_finish()
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/portability/portable_runner.py", line 438, in wait_until_finish
> 14:16:06 for state_response in self._state_stream:
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py", line 416, in __next__
> 14:16:06 return self._next()
> 14:16:06 File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py", line 703, in _next
> 14:16:06 raise self
> 14:16:06 grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
> 14:16:06 status = StatusCode.UNAVAILABLE
> 14:16:06 details = "Socket closed"
> 14:16:06 debug_error_string = "{"created":"@1577139361.436477926","description":"Error received from peer ipv4:127.0.0.1:51557","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Socket closed","grpc_status":14}"
> 14:16:06 >
> {code}
> https://builds.apache.org/job/beam_PostCommit_Python37/1210/timestamps/?time=HH:mm:ss&timeZone=GMT-8&appendLog&locale=en_US
--
This message was sent by Atlassian Jira
(v8.3.4#803005)