You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2022/01/18 23:12:00 UTC

[jira] [Commented] (BEAM-11001) Avro/BigQuery disagreement on DATE type representation

    [ https://issues.apache.org/jira/browse/BEAM-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478257#comment-17478257 ] 

Kenneth Knowles commented on BEAM-11001:
----------------------------------------

[~reuvenlax] know anything about this?

> Avro/BigQuery disagreement on DATE type representation
> ------------------------------------------------------
>
>                 Key: BEAM-11001
>                 URL: https://issues.apache.org/jira/browse/BEAM-11001
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-gcp
>    Affects Versions: 2.24.0
>            Reporter: Coda
>            Priority: P3
>
> I'm trying to write a job using an Avro format function to write to BQ. The BQ table has a {{DATE}} column, Beam converts that to a {{[ "null", "string" ]}}, but when the BQ load job runs, it errors out with:
> {{Field date_column has incompatible types. Configured schema: date; Avro file: string.}}
> If I write an integer, I get a {{Not in union ["null","string"]}} error from Avro.
> This happens regardless of whether {{useAvroLogicalTypes}} is set.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)