You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Dmytro Kulyk (Jira)" <ji...@apache.org> on 2019/12/31 16:40:00 UTC
[jira] [Commented] (AIRFLOW-2923) LatestOnlyOperator cascade skip
through all_done and dummy
[ https://issues.apache.org/jira/browse/AIRFLOW-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17006165#comment-17006165 ]
Dmytro Kulyk commented on AIRFLOW-2923:
---------------------------------------
still not fixed in 1.10.7
> LatestOnlyOperator cascade skip through all_done and dummy
> ----------------------------------------------------------
>
> Key: AIRFLOW-2923
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2923
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Affects Versions: 1.9.0, 1.10.5, 1.10.6, 1.10.7
> Environment: CeleryExecutor, 2-nodes cluster, RMQ, PostgreSQL
> Reporter: Dmytro Kulyk
> Assignee: Cedrik Neumann
> Priority: Major
> Labels: cascade, latestonly, skip
> Attachments: cube_update.py, screenshot-1.png
>
>
> DAG with consolidating point (calc_ready : dummy)
> as per [https://airflow.apache.org/concepts.html#latest-run-only] given task should be ran even catching up an execution DagRuns for a previous periods
> However, LatestOnlyOperator cascading through calc_ready despite of it is a dummy and trigger_rule=all_done, none_failed
> Same behavior when trigger_rule=all_success
> {code}
> t_ready = DummyOperator(
> task_id = 'calc_ready',
> trigger_rule = TriggerRule.ALL_DONE,
> dag=dag)
> {code}
> !screenshot-1.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)