You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Andrew Pilloud (Jira)" <ji...@apache.org> on 2020/05/27 18:04:00 UTC

[jira] [Created] (BEAM-10117) BigQuery IO race results in erroneous "Job failed." message

Andrew Pilloud created BEAM-10117:
-------------------------------------

             Summary: BigQuery IO race results in erroneous "Job failed." message
                 Key: BEAM-10117
                 URL: https://issues.apache.org/jira/browse/BEAM-10117
             Project: Beam
          Issue Type: Bug
          Components: io-java-gcp
            Reporter: Andrew Pilloud


BigQuery IO prints out a "Job failed. retrying." if the job hasn't finished starting by the time we query the status of the job. This leads to customer confusion.

https://github.com/apache/beam/blame/2a4092dfb8c46408818402b1c4a09a8cd44e907a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryHelpers.java#L140

{code:java}
2020-05-26T14:14:21.357Z Job beam_load_..._00001_00000-0 failed. retrying. 
2020-05-26T14:14:22.974Z job beam_load_..._00001_00000-0 started 
2020-05-26T14:14:59.829Z Job beam_load_..._00001_00000-0 completed successfully.  {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)