[jira] [Work logged] (BEAM-14273) Update BQ connector to support new JSON type (Python)

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/BEAM-14273?focusedWorklogId=760165&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-760165 ]

ASF GitHub Bot logged work on BEAM-14273:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 21/Apr/22 16:12
            Start Date: 21/Apr/22 16:12
    Worklog Time Spent: 10m 
      Work Description: ahmedabu98 opened a new pull request, #17431:
URL: https://github.com/apache/beam/pull/17431

   BigQuery now natively supports JSON data type [1]. This PR adds integration tests for using the JSON data type with Python BigQueryIO read and write methods.
   
   Batch loads currently only support CSV loads, so FILE_LOADS write method is not included.
   
   [1] https://cloud.google.com/bigquery/docs/reference/standard-sql/json-data#query_json_data




Issue Time Tracking
-------------------

            Worklog Id:     (was: 760165)
    Remaining Estimate: 0h
            Time Spent: 10m

> Update BQ connector to support new JSON type (Python)
> -----------------------------------------------------
>
>                 Key: BEAM-14273
>                 URL: https://issues.apache.org/jira/browse/BEAM-14273
>             Project: Beam
>          Issue Type: New Feature
>          Components: io-py-gcp
>            Reporter: Ahmed Abualsaud
>            Assignee: Ahmed Abualsaud
>            Priority: P2
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> BQ has a new JSON type that is defined here: [https://cloud.google.com/bigquery/docs/reference/standard-sql/data-types#json_type]
> We should update Beam BQ Java and Python connectors to support that for various read methods (export jobs, storage API) and write methods (load jobs, streaming inserts, storage API).
> We should also add integration tests that exercise reading from /writing to BQ tables with columns that has JSON type.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)