[GitHub] [airflow] uranusjr commented on issue #16506: Replication of Subdag behaviour with Task Groups

[GitBox <gi...@apache.org>]

uranusjr commented on issue #16506:
URL: https://github.com/apache/airflow/issues/16506#issuecomment-889001756


   Since TaskGroup does not have any effect in the scheduler now (I believe), I feel the best solution is to put an operator at the end of the task group that succeeds when any of its upstreams is not skipped, something like
   
   ```
      ______________________ TaskGroup _____________________
     |                                                      |
    --> Success --> ShortCurcuit --> Skipped --> AnySuccess --> ThisWillRunNormally
            `--------------------------------------^
   ```
   
   This can be done with a PythonOperator subclass with trigger rule `DUMMY` and overriding `execute()`. You could also just write that logic in `ThisWillRunNormally`, but having an extra operator probably makes things easier to reason with. What do you think?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org