[jira] [Commented] (AIRFLOW-198) Create an ShortCircuitIfNotCurrentOperator

["ASF subversion and git services (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15527857#comment-15527857 ] 

ASF subversion and git services commented on AIRFLOW-198:
---------------------------------------------------------

Commit edf033be65b575f44aa221d5d0ec9ecb6b32c67a in incubator-airflow's branch refs/heads/master from [~gwax]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=edf033b ]

[AIRFLOW-198] Implement latest_only_operator

Dear Airflow Maintainers,

Please accept this PR that addresses the following
issues:
-
https://issues.apache.org/jira/browse/AIRFLOW-198

Testing Done:
- Local testing of dag operation with
LatestOnlyOperator
- Unit test added

Closes #1752 from gwax/latest_only


> Create an ShortCircuitIfNotCurrentOperator
> ------------------------------------------
>
>                 Key: AIRFLOW-198
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-198
>             Project: Apache Airflow
>          Issue Type: New Feature
>            Reporter: Peter Attardo
>            Assignee: Siddharth Anand
>
> Taken from: https://cwiki.apache.org/confluence/display/AIRFLOW/Roadmap
> "For cases where we need to only run the latest in a series of task instance runs and mark the others as skipped. For example, we may have job to execute a DB snapshot every day. If the DAG is paused for 5 days and then unpaused, we don’t want to run all 5, just the latest. With this feature, we will provide “cron” functionality for task scheduling that is not related to ETL"
> I've decided to implement this as a subclass of ShortCircuitOperator - OnlyRunCurrentOperator/ShortCircuitIfNotCurrentOperator will skip downstream if the dag run being executed is not current.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)