You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Tyson Hamilton (Jira)" <ji...@apache.org> on 2021/03/30 16:31:00 UTC
[jira] [Commented] (BEAM-9114) BigQueryIO TableRowParser should
support Arrow and Avro data formats
[ https://issues.apache.org/jira/browse/BEAM-9114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311632#comment-17311632 ]
Tyson Hamilton commented on BEAM-9114:
--------------------------------------
[~bhulette] could you describe what needs to happen here? There are a couple PRs that were never merged so it isn't totally clear where we currently stand:
[https://github.com/apache/beam/pull/10369]
[https://github.com/apache/beam/pull/10384]
> BigQueryIO TableRowParser should support Arrow and Avro data formats
> --------------------------------------------------------------------
>
> Key: BEAM-9114
> URL: https://issues.apache.org/jira/browse/BEAM-9114
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Reporter: Kirill Kozlov
> Priority: P3
>
> We should implement a function like BigQueryIO#readRows that encapsulate row conversion logic [1] for both Arrow and Avro data formats.
> BigQueryTable#buildIOReader from SQL extension should call the function described above.
>
> [1] https://github.com/apache/beam/pull/10369#discussion_r365979515
--
This message was sent by Atlassian Jira
(v8.3.4#803005)