[GitHub] [airflow] tanelk commented on issue #29416: Optionally allow a task pool to count tasks in the 'deferred' state as occupying slots in that pool

["tanelk (via GitHub)" <gi...@apache.org>]

tanelk commented on issue #29416:
URL: https://github.com/apache/airflow/issues/29416#issuecomment-1423685677

   There is one more thing to keep in mind.
   
   The lifecycle of a deferrable task is something like this:
   none -> scheduled -> queued -> running -> deferred -> scheduled -> queued -> running -> success
   Currently it only consumes pool slots in queued and running states and you'd like to add deferred to that list. In that chain there still is a scheduled (the second one), that splits the execution into two parts. Handling that could be little more work than just updating the `Pool.slots_stats`. `TI.next_method` could be used to distinguish the two scheduled states but that does not jibe with scheduler.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org