You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Bence Nagy (JIRA)" <ji...@apache.org> on 2016/05/06 14:02:12 UTC

[jira] [Created] (AIRFLOW-60) Implement a GenericBulkTransfer operator

Bence Nagy created AIRFLOW-60:
---------------------------------

             Summary: Implement a GenericBulkTransfer operator
                 Key: AIRFLOW-60
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-60
             Project: Apache Airflow
          Issue Type: New Feature
          Components: operators
    Affects Versions: Airflow 1.7.0
            Reporter: Bence Nagy


This would be almost the same as GenericTransfer, except it would use {{bulk_dump}} and {{bulk_load}} instead of {{get_records}} and {{insert_rows}} to be able to transfer data larger than what fits into memory.

Depends on AIRFLOW-58.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)