You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "mohsen (JIRA)" <ji...@apache.org> on 2016/09/04 12:18:20 UTC
[jira] [Created] (AIRFLOW-487) Split/Chunk operator
mohsen created AIRFLOW-487:
------------------------------
Summary: Split/Chunk operator
Key: AIRFLOW-487
URL: https://issues.apache.org/jira/browse/AIRFLOW-487
Project: Apache Airflow
Issue Type: New Feature
Reporter: mohsen
it would be nice to have a split (python) operator, which takes a job that returns a list and streams each item to the specified job. like this pattern: http://www.workflowpatterns.com/patterns/control/basic/wcp2.php
also, a chunk operator that splits a list to smaller chunks is more general solution
i don't know if i should post this feature request here, or if there is any try on this already.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)