You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Jarek Potiuk (Jira)" <ji...@apache.org> on 2019/11/18 00:46:00 UTC

[jira] [Resolved] (AIRFLOW-3489) PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL json properly

     [ https://issues.apache.org/jira/browse/AIRFLOW-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jarek Potiuk resolved AIRFLOW-3489.
-----------------------------------
    Fix Version/s: 2.0.0
       Resolution: Fixed

> PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL json properly 
> -----------------------------------------------------------------------------
>
>                 Key: AIRFLOW-3489
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3489
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: gcp
>            Reporter: Duan Shiqiang
>            Priority: Major
>              Labels: bigquery
>             Fix For: 2.0.0
>
>
> PostgresToGoogleCloudStorageOperator saves json data (postgres json or jsonb) as native python types (i.e. dictionary) to gcs new line separated json data.
> But it generates bigquery schema for that field as data type string which won't work if user want to import the gcs data into bigquery.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)