You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/09/17 04:57:00 UTC

[jira] [Work logged] (BEAM-10916) Remove experimental annotations from BigQuery storage API source

     [ https://issues.apache.org/jira/browse/BEAM-10916?focusedWorklogId=485529&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-485529 ]

ASF GitHub Bot logged work on BEAM-10916:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 17/Sep/20 04:56
            Start Date: 17/Sep/20 04:56
    Worklog Time Spent: 10m 
      Work Description: kmjung commented on a change in pull request #12767:
URL: https://github.com/apache/beam/pull/12767#discussion_r489970520



##########
File path: website/www/site/content/en/documentation/io/built-in/google-bigquery.md
##########
@@ -322,21 +322,17 @@ in the following example:
 ### Using the BigQuery Storage API {#storage-api}
 
 The [BigQuery Storage API](https://cloud.google.com/bigquery/docs/reference/storage/)
-allows you to directly access tables in BigQuery storage. As a result, your
-pipeline can read from BigQuery storage faster than previously possible.
+allows you to directly access tables in BigQuery storage, and supports features
+such as column selection and predicate filter push-down which can allow more
+efficient pipeline execution.
 
-The Beam SDK for Java (version 2.11.0 and later) adds support for the beta
-release of the BigQuery Storage API as an [experimental feature](https://beam.apache.org/releases/javadoc/current/index.html?org/apache/beam/sdk/annotations/Experimental.html).
-Beam's support for the BigQuery Storage API has the following limitations:
+The Beam SDK for Java supports using the BigQuery Storage API when reading from
+BigQuery. SDK versions before 2.24.0 support the BigQuery Storage API as an
+[experimental feature](https://beam.apache.org/releases/javadoc/current/index.html?org/apache/beam/sdk/annotations/Experimental.html)
+and use the pre-GA BigQuery Storage API surface. Callers should migrate
+pipelines which use the BigQuery Storage API to use SDK version 2.24.0 or later.
 
-* The SDK for Python does not support the BigQuery Storage API.
-* SDK versions 2.11.0 and 2.12.0 do not support reading with a query string; you
-  can only read from a table.
-* SDK versions before 2.15.0 do not support dynamic work rebalancing. As a
-  result, reads might be less efficient in the presence of stragglers.
-
-Because this is currently a Beam experimental feature, export based reads are
-recommended for production jobs.
+The Beam SDK for Python does not support the BigQuery Storage API.

Review comment:
       Sorry, to be clear, do you mean a JIRA feature request to support Python?




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 485529)
    Remaining Estimate: 0h
            Time Spent: 10m

> Remove experimental annotations from BigQuery storage API source
> ----------------------------------------------------------------
>
>                 Key: BEAM-10916
>                 URL: https://issues.apache.org/jira/browse/BEAM-10916
>             Project: Beam
>          Issue Type: Task
>          Components: io-java-gcp
>            Reporter: Kenneth Jung
>            Priority: P2
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> The BigQuery Storage API is GA and its connector is ready for use in production. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)