You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Enrico Canzonieri (Jira)" <ji...@apache.org> on 2019/09/26 22:43:00 UTC

[jira] [Work started] (BEAM-7933) Adding timeout to JobServer grpc calls

     [ https://issues.apache.org/jira/browse/BEAM-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on BEAM-7933 started by Enrico Canzonieri.
-----------------------------------------------
> Adding timeout to JobServer grpc calls
> --------------------------------------
>
>                 Key: BEAM-7933
>                 URL: https://issues.apache.org/jira/browse/BEAM-7933
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-py-core
>    Affects Versions: 2.14.0
>            Reporter: Enrico Canzonieri
>            Assignee: Enrico Canzonieri
>            Priority: Minor
>              Labels: portability
>
> grpc calls to the JobServer from the Python SDK do not have timeouts. That means that the call to pipeline.run()could hang forever if the JobServer is not running (or failing to start).
> E.g. [https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/portability/portable_runner.py#L307] the call to Prepare() doesn't provide any timeout value and the same applies to other JobServer requests.
> As part of this ticket we could add a default timeout of 60 seconds as the default timeout for http client.
> Additionally, we could consider adding a --job-server-request-timeout to the [PortableOptions|https://github.com/apache/beam/blob/master/sdks/python/apache_beam/options/pipeline_options.py#L805] class to be used in the JobServer interactions inside probable_runner.py.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)