You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Daniel Oliveira <da...@google.com> on 2021/10/18 23:25:22 UTC
Design doc out for cross-language Java BigQuery IO. Looking for feedback.
Hey devs,
I'm gonna be working on cross-language BigQuery IO, and step one of that is
externalizing an existing BigQuery IO. Since I'm not that experienced with
BigQuery, I wrote a design doc to outline what I'm planning and get
feedback before I start: https://s.apache.org/beam-bigquery-externalization
This doc covers an initial cross-language API (i.e. a description of the
payloads for reads and writes), discusses using Beam schemas to represent
BigQuery rows portably, and since this first iteration is basically a
minimum viable product, it covers major areas of future work and what they
would entail. I appreciate any and all feedback!
Thanks,
Daniel Oliveira