You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Eugene Kirpichov (JIRA)" <ji...@apache.org> on 2017/08/14 21:37:00 UTC

[jira] [Closed] (BEAM-2700) BigQueryIO should support using file load jobs when using unbounded collections

     [ https://issues.apache.org/jira/browse/BEAM-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Eugene Kirpichov closed BEAM-2700.
----------------------------------
       Resolution: Fixed
    Fix Version/s: 2.2.0

> BigQueryIO should support using file load jobs when using unbounded collections
> -------------------------------------------------------------------------------
>
>                 Key: BEAM-2700
>                 URL: https://issues.apache.org/jira/browse/BEAM-2700
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-java-gcp
>    Affects Versions: 2.2.0
>            Reporter: Reuven Lax
>            Assignee: Reuven Lax
>             Fix For: 2.2.0
>
>
> Currently the method used for inserting into BigQuery is based on the input PCollection. Bounded input using file load jobs, unbounded input uses streaming inserts. However while streaming inserts have far lower latency, then cost quite a bit more and they provide weaker consistency guarantees. Users should be able to choose which method to use, irrespective of the input PCollection.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)