You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Mohannad Albanayosy (Jira)" <ji...@apache.org> on 2019/09/25 14:07:00 UTC

[jira] [Work started] (AIRFLOW-5549) Extend BigQueryGetDataOperator to handle pagination

     [ https://issues.apache.org/jira/browse/AIRFLOW-5549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on AIRFLOW-5549 started by Mohannad Albanayosy.
----------------------------------------------------
> Extend BigQueryGetDataOperator to handle pagination
> ---------------------------------------------------
>
>                 Key: AIRFLOW-5549
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5549
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: gcp
>    Affects Versions: 1.10.4
>            Reporter: Mohannad Albanayosy
>            Assignee: Mohannad Albanayosy
>            Priority: Minor
>
> h2. Problem
> Currently the _BigQueryGetDataOperator_ returns a list of rows only and not the total number of rows available and the page token to navigate to the next page. It also does not handle pagination (to request the next set of rows).
> h2. Proposed implementation
> Extend the operator to return the required meta data as well as handle pagination.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)