You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/01/27 08:42:00 UTC

[jira] [Commented] (AIRFLOW-2923) LatestOnlyOperator cascade skip through all_done and dummy

    [ https://issues.apache.org/jira/browse/AIRFLOW-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024169#comment-17024169 ] 

ASF GitHub Bot commented on AIRFLOW-2923:
-----------------------------------------

kaxil commented on pull request #5970: [AIRFLOW-2923][AIRFLOW-1784] Implement LatestOnlyOperator as BaseBranchOperator
URL: https://github.com/apache/airflow/pull/5970
 
 
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> LatestOnlyOperator cascade skip through all_done and dummy
> ----------------------------------------------------------
>
>                 Key: AIRFLOW-2923
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2923
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.9.0, 1.10.5, 1.10.6, 1.10.7
>         Environment: CeleryExecutor, 2-nodes cluster, RMQ, PostgreSQL
>            Reporter: Dmytro Kulyk
>            Assignee: Cedrik Neumann
>            Priority: Major
>              Labels: cascade, latestonly, skip
>         Attachments: cube_update.py, screenshot-1.png
>
>
> DAG with consolidating point (calc_ready : dummy)
> as per [https://airflow.apache.org/concepts.html#latest-run-only] given task should be ran even catching up an execution DagRuns for a previous periods
>  However, LatestOnlyOperator cascading through calc_ready despite of it is a dummy and trigger_rule=all_done, none_failed
>  Same behavior when trigger_rule=all_success
> {code}
> t_ready = DummyOperator(
>   task_id = 'calc_ready',
>   trigger_rule = TriggerRule.ALL_DONE,
>   dag=dag)
> {code}
> !screenshot-1.png!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)