[GitHub] [airflow] andrewgodwin commented on issue #18113: callback functions not called when a dag run is marked success or failure

[GitBox <gi...@apache.org>]

andrewgodwin commented on issue #18113:
URL: https://github.com/apache/airflow/issues/18113#issuecomment-919439356


   Unfortunately the triggerer mechanism doesn't solve this - triggers can run separately, but even to raise a task failure, deferred tasks have to be sent back to a worker to execute, so they're still bound by the same sort of rules.
   
   One thing I do want to look at soon, however, is extending the Executor interface to allow executors to run more than just Tasks - in essence, opening up the ability to submit other workloads (like callback functions) to run on executors, and hopefully pave the way for moving these and a lot of other things out of the scheduler/webserver.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org