You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2022/01/18 23:12:00 UTC
[jira] [Commented] (BEAM-11001) Avro/BigQuery disagreement on DATE type representation
[ https://issues.apache.org/jira/browse/BEAM-11001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478257#comment-17478257 ]
Kenneth Knowles commented on BEAM-11001:
----------------------------------------
[~reuvenlax] know anything about this?
> Avro/BigQuery disagreement on DATE type representation
> ------------------------------------------------------
>
> Key: BEAM-11001
> URL: https://issues.apache.org/jira/browse/BEAM-11001
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.24.0
> Reporter: Coda
> Priority: P3
>
> I'm trying to write a job using an Avro format function to write to BQ. The BQ table has a {{DATE}} column, Beam converts that to a {{[ "null", "string" ]}}, but when the BQ load job runs, it errors out with:
> {{Field date_column has incompatible types. Configured schema: date; Avro file: string.}}
> If I write an integer, I get a {{Not in union ["null","string"]}} error from Avro.
> This happens regardless of whether {{useAvroLogicalTypes}} is set.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)