[GitHub] [airflow] kristoffern commented on issue #19699: task_instances stuck in "queued" and are missing corresponding celery_taskmeta entries

[GitBox <gi...@apache.org>]

kristoffern commented on issue #19699:
URL: https://github.com/apache/airflow/issues/19699#issuecomment-974013578


   @ashb Yes that sounds like the ideal solution to this problem.
   I tried looking in the code base but I'm too unfamiliar with it to find where and how it would be best implemented.
   
   Sounds on your description though like its in the spectrum of a somewhat easy fix?
   
   Personally I would be fine with a 5min timeout to avoid risking killing tasks by mistake. But we wan't to keep the system responsive and fast which would be more in line with ~1min timeout. But then again the tasks get stuck so rarely compared to the overall amount of tasks that a 5min timeout shouldn't be too much of a problem (again just speaking of our own specific situation).
   
   Thank you for the fast reply, and again. Your deep dive into the scheduler was really really good :+1:


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org