[GitHub] [airflow] tanvn edited a comment on issue #18031: Alert if a task misses deadline

[GitBox <gi...@apache.org>]

tanvn edited a comment on issue #18031:
URL: https://github.com/apache/airflow/issues/18031#issuecomment-966792927


   > I believe the intention of using ExternalTaskSensor with a deadline planned is to set a timeout and have no retries so if it doesn't complete by the timeout it fails, not just run forever.
   
   Thank you for the information.
   (I am quite new to Airflow so please excuse my lack of knowledge 🙇 )
   Actually I tried adding a timeout to my ExternalTaskSensor before but its behavior seemed not change. Maybe I should retry with a shorter one.
   And by the way, with `soft_fail=True`, my `on_failure_callback` will not be called, I believe. 
   (`on_retry_callback` won't be called either with `mode : "reschedule"`.)
   Therefore, I have to create a new sensor based on the ExternalTaskSensor (the logic is quite the same but there is no inheritance relationship between them) to check deadlines of other tasks in the same DAG, to send a notification when the deadline missed while make it possible to let Airflow mark the DAG as SUCCESS when it tasks finished after deadline.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org