You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Danny McCormick (Jira)" <ji...@apache.org> on 2022/06/04 12:44:00 UTC

[jira] [Commented] (BEAM-7803) BigQuery Streaming Inserts in Python perform GetTable call too many times

    [ https://issues.apache.org/jira/browse/BEAM-7803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17548027#comment-17548027 ] 

Danny McCormick commented on BEAM-7803:
---------------------------------------

This issue has been migrated to https://github.com/apache/beam/issues/19683

> BigQuery Streaming Inserts in Python perform GetTable call too many times
> -------------------------------------------------------------------------
>
>                 Key: BEAM-7803
>                 URL: https://issues.apache.org/jira/browse/BEAM-7803
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-py-gcp
>            Reporter: Pablo Estrada
>            Priority: P3
>
> Create table if needed is called once per destination per bundle. We should call it only once per destination at all. This can be done by passing the created tables as a side input.
>  
> [https://github.com/apache/beam/blob/v2.13.0/sdks/python/apache_beam/io/gcp/bigquery.py#L804-L816]



--
This message was sent by Atlassian Jira
(v8.20.7#820007)