You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 16:22:31 UTC

[GitHub] [beam] damccorm opened a new issue, #20242: BigQueryBatchFileLoads dynamic destination

damccorm opened a new issue, #20242:
URL: https://github.com/apache/beam/issues/20242

   I am trying to use BigQueryBatchFileLoads to upload data from pubsub. It works fine for a single table, but when I try to use a dynamic destination such as
   destination=lambda elem: "my_project:my_dataset." **** elem["sensor_key"],
   it just makes a new table for each time the triggering_frequency procs. I know it makes temporary tables before loading it all into one, but it never loads them. It just creates more and more tables.
   
   Imported from Jira [BEAM-9917](https://issues.apache.org/jira/browse/BEAM-9917). Original Jira may contain additional context.
   Reported by: tordaut.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org