You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Chamikara Madhusanka Jayalath (Jira)" <ji...@apache.org> on 2020/05/20 17:45:00 UTC

[jira] [Created] (BEAM-10045) Reduce logging related to ratelimitExceeded error for BQ sink when performing streaming inserts

Chamikara Madhusanka Jayalath created BEAM-10045:
----------------------------------------------------

             Summary: Reduce logging related to ratelimitExceeded error for BQ sink when performing streaming inserts
                 Key: BEAM-10045
                 URL: https://issues.apache.org/jira/browse/BEAM-10045
             Project: Beam
          Issue Type: Improvement
          Components: io-java-gcp
            Reporter: Chamikara Madhusanka Jayalath


These errors are usually temporary and pipelines may recover.

 

We can consider not logging till we backoff for a certain amount of time here.

[https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryServicesImpl.java#L792]

 

cc: [~reuvenlax]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)