You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/12/11 23:15:00 UTC

[jira] [Commented] (AIRFLOW-1892) Added capability in BigQuery hook to extract data for selected columns

    [ https://issues.apache.org/jira/browse/AIRFLOW-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286720#comment-16286720 ] 

ASF subversion and git services commented on AIRFLOW-1892:
----------------------------------------------------------

Commit c6f46b1024d49e5d462fd16fb8b0aed032351720 in incubator-airflow's branch refs/heads/master from [~kaxilnaik]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=c6f46b1 ]

[AIRFLOW-1892] Modify BQ hook to extract data filtered by column

Closes #2855 from kaxil/patch-2


> Added capability in BigQuery hook to extract data for selected columns
> ----------------------------------------------------------------------
>
>                 Key: AIRFLOW-1892
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1892
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib, gcp
>    Affects Versions: 1.10.0
>            Reporter: Kaxil Naik
>            Assignee: Kaxil Naik
>            Priority: Minor
>             Fix For: 1.10.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> The `get_tabledata` method in `bigquery_hook` currently does not support extracting data for a specific field, instead, it extracts the full table.
> The proposal is to add the parameter to extract data for specific columns from a BigQuery table. The idea after that is to create an operator to get data in a python list.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)