[GitHub] [beam] kennknowles opened a new issue, #18267: beam.io.BigQuerySink Python SDK does not support WRITE_TRUNCATE write disposition when specifying table with partition decorator

[GitBox <gi...@apache.org>]

kennknowles opened a new issue, #18267:
URL: https://github.com/apache/beam/issues/18267

   When trying to write to a BigQuery partition with this transform 
   
   pcoll | beam.io.Write(beam.io.BigQuerySink(table, schema=self.get_schema(), 
            create_disposition=beam.io.BigQueryDisposition.CREATE_NEVER,
            write_disposition=beam.io.BigQueryDisposition.WRITE_TRUNCATE)))
   
   I get the following error code: 
   
   "code": 400,
     "message": "Invalid table ID \"table$20170103\". Table IDs must be alphanumeric (plus underscores) and must be at most 1024 characters long. Also, Table decorators cannot be used."
   
   The table is partitioned by day already.
   
   Imported from Jira [BEAM-2332](https://issues.apache.org/jira/browse/BEAM-2332). Original Jira may contain additional context.
   Reported by: jc.rodrigue@gmail.com.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] Abacn commented on issue #18267: beam.io.BigQuerySink Python SDK does not support WRITE_TRUNCATE write disposition when specifying table with partition decorator

[GitBox <gi...@apache.org>]

Abacn commented on issue #18267:
URL: https://github.com/apache/beam/issues/18267#issuecomment-1397876866

   BigQuerySink is deprecated since Beam v2.11.0. This task my ends with won't do.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org