[GitHub] [beam] ahmedabu98 commented on issue #21405: When BigqueryIO's STORAGE_API_AT_LEAST_ONCE method is used and the table spec doesn't contain the project id the pipeline fails

["ahmedabu98 (via GitHub)" <gi...@apache.org>]

ahmedabu98 commented on issue #21405:
URL: https://github.com/apache/beam/issues/21405#issuecomment-1682663238

   @slilichenko are you still running into this issue?
   
   I've outlined what I tried below. Let me know if I'm misunderstanding the issue:
   
   I was able to reproduce this by not including the project in pipeline options nor in the table spec, then setting `.withoutValidation()` on the write configuration. However, this is working as intended. Validation is meant to check these things at pipeline construction time and throw an error before it runs. Without validation, you will run into a RuntimeException. FYI this behavior is not unique to `STORAGE_API_AT_LEAST_ONCE`, other write methods will also fail with Runetime/IO Exceptions when they try loading data to BQ.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org