You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2020/10/09 15:06:58 UTC

[GitHub] [beam] kmjung commented on pull request #13058: [BEAM-11047] Convert Avro INTEGER to Long, not String

kmjung commented on pull request #13058:
URL: https://github.com/apache/beam/pull/13058#issuecomment-706236204


   The purpose of the convertGenericRecordToTableRow class is to provide compatibility with BigQuery's legacy JSON TableRow type. I can't find any documentation here, but my understanding is that -- regrettably -- INTEGER values are sent as strings in the original JSON, and so this is done here for compatibility reasons. I don't think we can change this at this point, anyways, as existing pipelines rely on this behavior.
   
   If you're looking to optimize your storage API pipelines, I would encourage you to look at consuming the GenericRecords produced by the stream source directly, rather than converting them to TableRow.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org