You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/11/30 17:12:02 UTC

[jira] [Commented] (BEAM-10999) Bigquery Warning messages cause Dataflow job to fail

    [ https://issues.apache.org/jira/browse/BEAM-10999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17240884#comment-17240884 ] 

Beam JIRA Bot commented on BEAM-10999:
--------------------------------------

This issue is P2 but has been unassigned without any comment for 60 days so it has been labeled "stale-P2". If this issue is still affecting you, we care! Please comment and remove the label. Otherwise, in 14 days the issue will be moved to P3.

Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed explanation of what these priorities mean.


> Bigquery Warning messages cause Dataflow job to fail
> ----------------------------------------------------
>
>                 Key: BEAM-10999
>                 URL: https://issues.apache.org/jira/browse/BEAM-10999
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-gcp
>    Affects Versions: 2.19.0, 2.24.0
>         Environment: Google Dataflow
>            Reporter: Robert Coe
>            Priority: P2
>              Labels: stale-P2
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> I have a job fails when BigQuery throws any warning messages, even if the query is successful.
> org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers.parseStatus Checks for "getErrors" and sets status to failure if there are any. However, this can include warning messages.
> [Google's Bigquery Client Code|[https://github.com/googleapis/google-api-java-client-services/blob/master/clients/google-api-services-bigquery/v2/1.30.1/com/google/api/services/bigquery/model/JobStatus.java]] states that 
> "Errors here do not necessarily mean that the job has completed or was unsuccessful."
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)