You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2021/10/06 21:10:00 UTC
[jira] [Updated] (BEAM-12448) Received a GOAWAY with error code
ENHANCE_YOUR_CALM and debug data equal to "too_many_pings"
[ https://issues.apache.org/jira/browse/BEAM-12448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kyle Weaver updated BEAM-12448:
-------------------------------
Resolution: Fixed
Status: Resolved (was: Open)
> Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings"
> --------------------------------------------------------------------------------------------
>
> Key: BEAM-12448
> URL: https://issues.apache.org/jira/browse/BEAM-12448
> Project: Beam
> Issue Type: Bug
> Components: runner-flink, sdk-py-harness
> Affects Versions: 2.29.0
> Reporter: Ravikiran Borse
> Priority: P2
> Fix For: 2.34.0
>
> Attachments: Screenshot 2021-06-09 at 8.31.23 AM.png, flink-root-standalonesession-0-gg34-bn.log, flink-root-taskexecutor-0-gg34-bn.log, flink-root-taskexecutor-0-gg34-bn.out, wordcount_with_metrics.py
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Beam: 2.31.0
> Flink 1.12.0
> Python 3.8.5
> # tr -dc "A-Za-z 0-9" < /dev/urandom | fold -w100|head -n 9000000 > bigfile.txt
> # python3 wordcount_with_metrics.py --input beam/bigfile.txt --out bigfile-output.txt
>
>
> E0603 04:50:42.552403830 8442 chttp2_transport.cc:1117] Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings"
> ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
> Traceback (most recent call last):
> File "/usr/local/lib/python3.8/dist-packages/apache_beam/runners/worker/data_plane.py", line 581, in _read_inputs
> for elements in elements_iterator:
> File "/usr/local/lib/python3.8/dist-packages/grpc/_channel.py", line 426, in __next__
> return self._next()
> File "/usr/local/lib/python3.8/dist-packages/grpc/_channel.py", line 826, in _next
> raise self
> grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
> status = StatusCode.UNAVAILABLE
> details = "Socket closed"
> debug_error_string = "\{"created":"@1622695842.552861174","description":"Error received from peer ipv6:[::1]:45717","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Socket closed","grpc_status":14}"
> >
> Exception in thread read_grpc_client_inputs:
> Traceback (most recent call last):
> File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
> self.run()
> File "/usr/lib/python3.8/threading.py", line 870, in run
> self._target(*self._args, **self._kwargs)
> File "/usr/local/lib/python3.8/dist-packages/apache_beam/runners/worker/data_plane.py", line 598, in <lambda>
> target=lambda: self._read_inputs(elements_iterator),
> File "/usr/local/lib/python3.8/dist-packages/apache_beam/runners/worker/data_plane.py", line 581, in _read_inputs
> for elements in elements_iterator:
> File "/usr/local/lib/python3.8/dist-packages/grpc/_channel.py", line 426, in __next__
> return self._next()
> File "/usr/local/lib/python3.8/dist-packages/grpc/_channel.py", line 826, in _next
> raise self
> grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
> status = StatusCode.UNAVAILABLE
> details = "Socket closed"
> debug_error_string = "\{"created":"@1622695842.552861174","description":"Error received from peer ipv6:[::1]:45717","file":"src/core/lib/surface/call.cc","file_line":1066,"grpc_message":"Socket closed","grpc_status":14}"
--
This message was sent by Atlassian Jira
(v8.3.4#803005)