You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/10/01 18:48:00 UTC
[jira] [Work logged] (BEAM-10930) Use dense encoding for BigQuery
JSON API interactions
[ https://issues.apache.org/jira/browse/BEAM-10930?focusedWorklogId=493639&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-493639 ]
ASF GitHub Bot logged work on BEAM-10930:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 01/Oct/20 18:47
Start Date: 01/Oct/20 18:47
Worklog Time Spent: 10m
Work Description: lukecwik commented on pull request #12874:
URL: https://github.com/apache/beam/pull/12874#issuecomment-702328565
Run Java PreCommit
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 493639)
Time Spent: 1h 50m (was: 1h 40m)
> Use dense encoding for BigQuery JSON API interactions
> -----------------------------------------------------
>
> Key: BEAM-10930
> URL: https://issues.apache.org/jira/browse/BEAM-10930
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Reporter: Seth Hollyman
> Priority: P2
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> Did a quick audit of java BigQueryIO, which leverages the underlying discovery client for the HTTP interactions with the BigQuery service.
>
> By default, interactions with BigQuery will use pretty-printed JSON responses which may include significant whitespace due to the complexity inherent in the BigQuery JSON response structure. This whitespace is all unnecessary for programmatic interactions, and interactions should use dense encoding as JSON is whitespace agnostic.
> Information about the system parameters can be found at the below URL. In particular, the prettyPrint parameter governs dense-vs-pretty JSON representation.
> [https://cloud.google.com/apis/docs/system-parameters]
>
> I already have a fix for this issue in progress, creating this issue in order to submit the PR for review.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)