You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Heejong Lee (JIRA)" <ji...@apache.org> on 2018/12/11 22:06:00 UTC

[jira] [Comment Edited] (BEAM-6183) BigQuery insertAll API request rate is not properly controlled

    [ https://issues.apache.org/jira/browse/BEAM-6183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16718080#comment-16718080 ] 

Heejong Lee edited comment on BEAM-6183 at 12/11/18 10:05 PM:
--------------------------------------------------------------

Looks like it's better to stick to the current implementation with no rate controlling as far as we can address the performance issue of throttling.


was (Author: heejong):
[https://docs.google.com/document/d/1EhRNWLevm86GD_QtvlrTauHITVMwQBzuemyp-w4Z_ck/edit?usp=sharing]

> BigQuery insertAll API request rate is not properly controlled
> --------------------------------------------------------------
>
>                 Key: BEAM-6183
>                 URL: https://issues.apache.org/jira/browse/BEAM-6183
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-gcp
>    Affects Versions: 2.8.0
>            Reporter: Heejong Lee
>            Assignee: Heejong Lee
>            Priority: Major
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> BigQuery insertAll API request rate is not properly controlled so it produces too many rate limit exceeded error messages in the worker log.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)