You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (Jira)" <ji...@apache.org> on 2019/08/29 23:53:00 UTC

[jira] [Comment Edited] (ARROW-4668) [C++] Support GCP BigQuery Storage API

    [ https://issues.apache.org/jira/browse/ARROW-4668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919049#comment-16919049 ] 

Wes McKinney edited comment on ARROW-4668 at 8/29/19 11:52 PM:
---------------------------------------------------------------

Yeah, it's different. GCS is generic blob storage (like Amazon S3). BigQuery is a SQL-based data warehouse product. Its internal storage is not exposed to customers as files, so you have to use the storage API to access the raw data without necessarily running SQL queries


was (Author: wesmckinn):
Yeah, it's different. GCS is generic blob storage. BigQuery is a SQL-based data warehouse product. Its internal storage is not exposed to customers as files, so you have to use the storage API to access the raw data without necessarily running SQL queries

> [C++] Support GCP BigQuery Storage API
> --------------------------------------
>
>                 Key: ARROW-4668
>                 URL: https://issues.apache.org/jira/browse/ARROW-4668
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++
>            Reporter: Micah Kornfield
>            Assignee: Micah Kornfield
>            Priority: Major
>              Labels: filesystem
>             Fix For: 1.0.0
>
>
> Docs: [https://cloud.google.com/bigquery/docs/reference/storage/] 
> Need to investigate the best way to do this maybe just see if we can build our client on GCP (once a protobuf definition is published to [https://github.com/googleapis/googleapis/tree/master/google)?|https://github.com/googleapis/googleapis/tree/master/google)]
>  
> This will serve as a parent issue, and sub-issues will be added for subtasks if necessary.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)