You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2022/01/15 01:02:00 UTC

[jira] [Work started] (BEAM-9706) Add ignoreUnknownValues flag to beam.io.WriteToBigQuery

     [ https://issues.apache.org/jira/browse/BEAM-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on BEAM-9706 started by Pablo Estrada.
-------------------------------------------
> Add ignoreUnknownValues flag to beam.io.WriteToBigQuery
> -------------------------------------------------------
>
>                 Key: BEAM-9706
>                 URL: https://issues.apache.org/jira/browse/BEAM-9706
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-py-gcp
>            Reporter: Lucas Rolim
>            Assignee: Pablo Estrada
>            Priority: P3
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> This flag is already in the Java SDK and it is critical to deal with ETL that consumes from Pub/Subs populated from plenty of external APIS that I (as data engineer) don't have control.
>  
> It simply ignores "extra" attributes and doesn't throw an error when inserting on BigQuery.
> Java-related issue:
> https://issues.apache.org/jira/browse/BEAM-1267



--
This message was sent by Atlassian Jira
(v8.20.1#820001)