You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Chamikara Jayalath (JIRA)" <ji...@apache.org> on 2017/09/06 00:58:00 UTC

[jira] [Created] (BEAM-2843) Log the reason for failure for BigQuery jobs

Chamikara Jayalath created BEAM-2843:
----------------------------------------

             Summary: Log the reason for failure for BigQuery jobs
                 Key: BEAM-2843
                 URL: https://issues.apache.org/jira/browse/BEAM-2843
             Project: Beam
          Issue Type: Improvement
          Components: sdk-java-gcp
            Reporter: Chamikara Jayalath
            Priority: Minor


For BigQuery load jobs we currently retry few times and log the job ID.

It might be good to get the reason for the failure from BigQuery (prob. this is available through status poll) and log that as well. For example, failed load jobs are logged at following location.
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L202





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)