You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "jack (JIRA)" <ji...@apache.org> on 2019/07/17 11:33:00 UTC
[jira] [Commented] (AIRFLOW-3489)
PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL json
properly
[ https://issues.apache.org/jira/browse/AIRFLOW-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16886943#comment-16886943 ]
jack commented on AIRFLOW-3489:
-------------------------------
[~kaxilnaik] [~kamil.bregula] [~higrys] what is the preferred way to fix it?
> PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL json properly
> -----------------------------------------------------------------------------
>
> Key: AIRFLOW-3489
> URL: https://issues.apache.org/jira/browse/AIRFLOW-3489
> Project: Apache Airflow
> Issue Type: Bug
> Components: gcp
> Reporter: Duan Shiqiang
> Priority: Major
> Labels: bigquery
>
> PostgresToGoogleCloudStorageOperator saves json data (postgres json or jsonb) as native python types (i.e. dictionary) to gcs new line separated json data.
> But it generates bigquery schema for that field as data type string which won't work if user want to import the gcs data into bigquery.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)