You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Mohannad Albanayosy (Jira)" <ji...@apache.org> on 2019/09/25 14:07:00 UTC

[jira] [Created] (AIRFLOW-5549) Extend BigQueryGetDataOperator to handle pagination

Mohannad Albanayosy created AIRFLOW-5549:
--------------------------------------------

             Summary: Extend BigQueryGetDataOperator to handle pagination
                 Key: AIRFLOW-5549
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5549
             Project: Apache Airflow
          Issue Type: Improvement
          Components: gcp
    Affects Versions: 1.10.4
            Reporter: Mohannad Albanayosy
            Assignee: Mohannad Albanayosy


h2. Problem

Currently the _BigQueryGetDataOperator_ returns a list of rows only and not the total number of rows available and the page token to navigate to the next page. It also does not handle pagination (to request the next set of rows).
h2. Proposed implementation

Extend the operator to return the required meta data as well as handle pagination.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)