You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Pratap Koritala (JIRA)" <ji...@apache.org> on 2017/07/13 17:05:00 UTC

[jira] [Created] (AIRFLOW-1410) BigQuery Operator flattens the repeated column and it's not configurable

Pratap Koritala created AIRFLOW-1410:
----------------------------------------

             Summary: BigQuery Operator flattens the repeated column and it's not configurable
                 Key: AIRFLOW-1410
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1410
             Project: Apache Airflow
          Issue Type: Bug
          Components: contrib, hooks
            Reporter: Pratap Koritala
            Priority: Minor


For Legacy SQL, BigQuery Operator/Hook flattens the repeated column. The underlying Google Query JSON API's parameter "flattenResult" has default value of false, by not setting it every Legacy SQL result is flattened. 

Without this config option, Legacy SQL can't be used for queries with repeated columns.  Even though it looks like feature request, I consider this as a bug as this config option should have been in the first place.

I am working on submitting PR to github project.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)