You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2022/01/14 19:41:00 UTC

[jira] [Updated] (BEAM-12758) Refactor Code to Better control Beam Retries

     [ https://issues.apache.org/jira/browse/BEAM-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-12758:
-----------------------------------
    Status: Open  (was: Triage Needed)

> Refactor Code to Better control Beam Retries
> --------------------------------------------
>
>                 Key: BEAM-12758
>                 URL: https://issues.apache.org/jira/browse/BEAM-12758
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-py-gcp
>            Reporter: Ryan Thompson
>            Priority: P3
>
> Uploads might be retried in an underlying library on an upload thread.
> [https://github.com/apache/beam/blob/c026c9fa00239a6f3650a6fa69f3aa864f692afe/sdks/python/apache_beam/io/gcp/gcsio.py#L635-L639]
>  
> The code is written in such a way as to not easily allow retries. One way to do so would be to allow http errors to be raised and then retry.
>  
> See also https://issues.apache.org/jira/browse/BEAM-12567



--
This message was sent by Atlassian Jira
(v8.20.1#820001)