You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Kaxil Naik (Jira)" <ji...@apache.org> on 2020/01/27 08:42:00 UTC

[jira] [Resolved] (AIRFLOW-2923) LatestOnlyOperator cascade skip through all_done and dummy

     [ https://issues.apache.org/jira/browse/AIRFLOW-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kaxil Naik resolved AIRFLOW-2923.
---------------------------------
    Fix Version/s: 2.0.0
       Resolution: Fixed

> LatestOnlyOperator cascade skip through all_done and dummy
> ----------------------------------------------------------
>
>                 Key: AIRFLOW-2923
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2923
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.9.0, 1.10.5, 1.10.6, 1.10.7
>         Environment: CeleryExecutor, 2-nodes cluster, RMQ, PostgreSQL
>            Reporter: Dmytro Kulyk
>            Assignee: Cedrik Neumann
>            Priority: Major
>              Labels: cascade, latestonly, skip
>             Fix For: 2.0.0
>
>         Attachments: cube_update.py, screenshot-1.png
>
>
> DAG with consolidating point (calc_ready : dummy)
> as per [https://airflow.apache.org/concepts.html#latest-run-only] given task should be ran even catching up an execution DagRuns for a previous periods
>  However, LatestOnlyOperator cascading through calc_ready despite of it is a dummy and trigger_rule=all_done, none_failed
>  Same behavior when trigger_rule=all_success
> {code}
> t_ready = DummyOperator(
>   task_id = 'calc_ready',
>   trigger_rule = TriggerRule.ALL_DONE,
>   dag=dag)
> {code}
> !screenshot-1.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)