You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Yueyang Qiu (Jira)" <ji...@apache.org> on 2019/09/12 21:35:00 UTC

[jira] [Work started] (BEAM-8098) BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond

     [ https://issues.apache.org/jira/browse/BEAM-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on BEAM-8098 started by Yueyang Qiu.
-----------------------------------------
> BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK correspond
> ---------------------------------------------------------------------------------------
>
>                 Key: BEAM-8098
>                 URL: https://issues.apache.org/jira/browse/BEAM-8098
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-gcp
>            Reporter: Yueyang Qiu
>            Assignee: Yueyang Qiu
>            Priority: Minor
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> While working on [https://github.com/apache/beam/pull/9144], I realized there is a gap in BigQueryIO documentation on mapping between data types defined in BigQuery and in Beam SDK.
>  
> For example, if a user reads a BYTES field from BigQuery into Beam, it will be represented as java.nio.ByteBuffer type in Beam Java SDK. The user will need to do an explicit type cast to ByteBuffer in order to use the data, but there is no easy way the user can know which type they should cast to, unless digging into BigQueryIO's implementation (Java - Avro - BigQuery).



--
This message was sent by Atlassian Jira
(v8.3.2#803003)