You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Chun Yang (Jira)" <ji...@apache.org> on 2019/11/27 18:08:00 UTC
[jira] [Created] (BEAM-8841) Add ability to perform BigQuery file
loads using avro
Chun Yang created BEAM-8841:
-------------------------------
Summary: Add ability to perform BigQuery file loads using avro
Key: BEAM-8841
URL: https://issues.apache.org/jira/browse/BEAM-8841
Project: Beam
Issue Type: Improvement
Components: io-py-gcp
Reporter: Chun Yang
Currently, JSON format is used for file loads into BigQuery in the Python SDK. JSON has some disadvantages including size of serialized data and inability to represent NaN and infinity float values.
BigQuery supports loading files in avro format, which can overcome these disadvantages. The Java SDK already supports loading files using avro format (BEAM-2879) so it makes sense to support it in the Python SDK as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)