You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Danny McCormick (Jira)" <ji...@apache.org> on 2022/06/04 14:27:00 UTC

[jira] [Commented] (BEAM-8560) Construction time schema Validation for writing to BQ

    [ https://issues.apache.org/jira/browse/BEAM-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17548269#comment-17548269 ] 

Danny McCormick commented on BEAM-8560:
---------------------------------------

This issue has been migrated to https://github.com/apache/beam/issues/19911

> Construction time schema Validation for writing to BQ
> -----------------------------------------------------
>
>                 Key: BEAM-8560
>                 URL: https://issues.apache.org/jira/browse/BEAM-8560
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Brian Hulette
>            Priority: P3
>              Labels: Clarified
>
> `BigQueryIO.write` should be able to validate the schema of the input PCollection against the schema for this table (either retrieved from DataCatalog, or from BQ metadata). Then we can fail at pipeline construction time rather than waiting until execution.
> At the very least this should work when writing Beam Rows.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)