You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Ryan Berti (Jira)" <ji...@apache.org> on 2020/01/14 17:48:00 UTC

[jira] [Commented] (BEAM-9052) BigQueryUtils toBeamRow to support the bytes type

    [ https://issues.apache.org/jira/browse/BEAM-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015244#comment-17015244 ] 

Ryan Berti commented on BEAM-9052:
----------------------------------

Looks like AvroUtils.toBeamRowStrict can replace BigQueryUtils.toBeamRow in our use case. I'm going to close this ticket and BEAM-9051. Sounds like the Avro support in BigQueryUtils should be deprecated. 

> BigQueryUtils toBeamRow to support the bytes type
> -------------------------------------------------
>
>                 Key: BEAM-9052
>                 URL: https://issues.apache.org/jira/browse/BEAM-9052
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-gcp
>    Affects Versions: 2.16.0
>            Reporter: Ryan Berti
>            Assignee: Ryan Berti
>            Priority: Minor
>
> The BigQueryUtils toBeamRow implementation doesn't currently support the Avro/Beam bytes type via the convertAvroFormat method: [https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryUtils.java#L558]. A simple implementation which casts the Avro value to a ByteBuffer instance and returns the underlying byte array should suffice.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)