You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2022/06/03 23:52:00 UTC
[jira] [Commented] (BEAM-6931) Remove destination tables in BigQueryStorageQuerySource
[ https://issues.apache.org/jira/browse/BEAM-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17547638#comment-17547638 ]
Kenneth Knowles commented on BEAM-6931:
---------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/19375
> Remove destination tables in BigQueryStorageQuerySource
> -------------------------------------------------------
>
> Key: BEAM-6931
> URL: https://issues.apache.org/jira/browse/BEAM-6931
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Reporter: Kenneth Jung
> Priority: P3
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> In BigQueryStorageQuerySource, the results of a BigQuery query are written to a (named) temporary destination table rather than to an anonymous table since the BigQuery storage API can't currently read from all anonymous tables. When this API restriction is removed, then the BigQueryStorageQuerySource can start reading directly from anonymous result tables and most of the logic related to template compatibility and temporary dataset cleanup can be removed.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)