[jira] [Commented] (BEAM-4650) Add retry policy to Python BQ streaming sink

["Tarush Grover (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-4650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16684735#comment-16684735 ] 

Tarush Grover commented on BEAM-4650:
-------------------------------------

[~chamikara] I see the retry filter in retry.py file : https://github.com/apache/beam/blob/master/sdks/python/apache_beam/utils/retry.py#L99.

We want to give user an interface so that user can customise the retry policy for big query like based on what of errors should be consider for retry etc. Is my current understanding correct?

> Add retry policy to Python BQ streaming sink
> --------------------------------------------
>
>                 Key: BEAM-4650
>                 URL: https://issues.apache.org/jira/browse/BEAM-4650
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py-core
>            Reporter: Chamikara Jayalath
>            Assignee: Tarush Grover
>            Priority: Major
>
> Java supports specifying a retry policy when performing streaming writes to BQ: [https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/InsertRetryPolicy.java]
>  
> We should update Python BQ streaming sink to support this as well.
> https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/bigquery.py#L1430



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)