You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Danny McCormick (Jira)" <ji...@apache.org> on 2022/06/04 18:08:00 UTC

[jira] [Commented] (BEAM-10999) Bigquery Warning messages cause Dataflow job to fail

    [ https://issues.apache.org/jira/browse/BEAM-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17548928#comment-17548928 ] 

Danny McCormick commented on BEAM-10999:
----------------------------------------

This issue has been migrated to https://github.com/apache/beam/issues/20538

> Bigquery Warning messages cause Dataflow job to fail
> ----------------------------------------------------
>
>                 Key: BEAM-10999
>                 URL: https://issues.apache.org/jira/browse/BEAM-10999
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-gcp
>    Affects Versions: 2.19.0, 2.24.0
>         Environment: Google Dataflow
>            Reporter: Robert Coe
>            Priority: P3
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I have a job fails when BigQuery throws any warning messages, even if the query is successful.
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers.parseStatus Checks for "getErrors" and sets status to failure if there are any. However, this can include warning messages.
> [Google's Bigquery Client Code|[https://github.com/googleapis/google-api-java-client-services/blob/master/clients/google-api-services-bigquery/v2/1.30.1/com/google/api/services/bigquery/model/JobStatus.java]] states that 
> "Errors here do not necessarily mean that the job has completed or was unsuccessful."
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)