[GitHub] [beam] damccorm opened a new issue, #21507: BigQuery DIRECT_READ does not validate pipeline's project ID and instead tries to read from a null project

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #21507:
URL: https://github.com/apache/beam/issues/21507

   When a pipeline is created without a GCP project ID and tries to read from BigQuery using Storage Read API, it runs into the following unhelpful error:
   ```
   
   org.apache.beam.sdk.Pipeline$PipelineExecutionException: com.google.api.gax.rpc.PermissionDeniedException:
   io.grpc.StatusRuntimeException: PERMISSION_DENIED: BigQuery Storage API has not been used in project
   770406736630 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/bigquerystorage.googleapis.com/overview?project=770406736630
   then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our
   systems and retry.
   ```
   
   It looks like no validation for project ID is happening, and Beam tries to read without a project ID. Project 770406736630 mentioned in the error is a `null` project and throws off the user because it isn't their project.
   
    
   
   Doing the same but using the EXPORT read method results in this more helpful error.
   ```
   
   org.apache.beam.sdk.Pipeline$PipelineExecutionException: java.lang.NullPointerException: Required parameter
   projectId must be specified.
   ```
   
    
   
   Imported from Jira [BEAM-14119](https://issues.apache.org/jira/browse/BEAM-14119). Original Jira may contain additional context.
   Reported by: ahmedabu.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org