You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/25 23:03:08 UTC
[GitHub] [beam] kennycontreras opened a new issue, #22058: [Feature Request]: Add option to create table if needed in bigqueryio.Write() (golang sdk)
kennycontreras opened a new issue, #22058:
URL: https://github.com/apache/beam/issues/22058
### What would you like to happen?
`bigqueryio.Write()` allows you to write into BigQuery while providing a table string in the format of `project:dataset.table`. At the moment, if the table doesn't exist, it will fail. And there's no option like `.withCreateDisposition(CreateDisposition.CREATE_IF_NEEDED)` in the Java SDK to create the table if it doesn't exist.
It will be a great feature to add this. The pipeline already checks if the PCollection<T> has a valid schema with the existing table, so we can use this information (T of schema type) to create the table if needed.
### Issue Priority
Priority: 0
### Issue Component
Component: io-go-gcp
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] youngoli commented on issue #22058: [Feature Request]: [Go SDK] Add option to create table if needed in bigqueryio.Write()
Posted by GitBox <gi...@apache.org>.
youngoli commented on issue #22058:
URL: https://github.com/apache/beam/issues/22058#issuecomment-1169462755
This is a good feature, and something I originally intended. When I first tried, I ran into issues getting the create disposition working with the Storage Write API. But it's absolutely something we should aim for since this is a feature in both the Java and Python native versions of BQ IO.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] lostluck closed issue #22058: [Feature Request]: [Go SDK] Add option to create table if needed in bigqueryio.Write()
Posted by "lostluck (via GitHub)" <gi...@apache.org>.
lostluck closed issue #22058: [Feature Request]: [Go SDK] Add option to create table if needed in bigqueryio.Write()
URL: https://github.com/apache/beam/issues/22058
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] pabloem commented on issue #22058: [Feature Request]: [Go SDK] Add option to create table if needed in bigqueryio.Write()
Posted by GitBox <gi...@apache.org>.
pabloem commented on issue #22058:
URL: https://github.com/apache/beam/issues/22058#issuecomment-1167774115
fyi @youngoli
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [beam] github-actions[bot] closed issue #22058: [Feature Request]: [Go SDK] Add option to create table if needed in bigqueryio.Write()
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #22058: [Feature Request]: [Go SDK] Add option to create table if needed in bigqueryio.Write()
URL: https://github.com/apache/beam/issues/22058
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@beam.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org