You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2017/12/11 23:15:00 UTC
[jira] [Commented] (AIRFLOW-1892) Added capability in BigQuery hook
to extract data for selected columns
[ https://issues.apache.org/jira/browse/AIRFLOW-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16286720#comment-16286720 ]
ASF subversion and git services commented on AIRFLOW-1892:
----------------------------------------------------------
Commit c6f46b1024d49e5d462fd16fb8b0aed032351720 in incubator-airflow's branch refs/heads/master from [~kaxilnaik]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=c6f46b1 ]
[AIRFLOW-1892] Modify BQ hook to extract data filtered by column
Closes #2855 from kaxil/patch-2
> Added capability in BigQuery hook to extract data for selected columns
> ----------------------------------------------------------------------
>
> Key: AIRFLOW-1892
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1892
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib, gcp
> Affects Versions: 1.10.0
> Reporter: Kaxil Naik
> Assignee: Kaxil Naik
> Priority: Minor
> Fix For: 1.10.0
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> The `get_tabledata` method in `bigquery_hook` currently does not support extracting data for a specific field, instead, it extracts the full table.
> The proposal is to add the parameter to extract data for specific columns from a BigQuery table. The idea after that is to create an operator to get data in a python list.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)