You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Coda (Jira)" <ji...@apache.org> on 2020/10/02 00:04:00 UTC

[jira] [Created] (BEAM-11001) Avro/BigQuery disagreement on DATE type representation

Coda created BEAM-11001:
---------------------------

             Summary: Avro/BigQuery disagreement on DATE type representation
                 Key: BEAM-11001
                 URL: https://issues.apache.org/jira/browse/BEAM-11001
             Project: Beam
          Issue Type: Bug
          Components: io-java-gcp
    Affects Versions: 2.24.0
            Reporter: Coda


I'm trying to write a job using an Avro format function to write to BQ. The BQ table has a {{DATE}} column, Beam converts that to a {{[ "null", "string" ]}}, but when the BQ load job runs, it errors out with:

{{Field date_column has incompatible types. Configured schema: date; Avro file: string.}}

If I write an integer, I get a {{Not in union ["null","string"]}} error from Avro.

This happens regardless of whether {{useAvroLogicalTypes}} is set.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)