You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "potiuk (via GitHub)" <gi...@apache.org> on 2023/02/08 09:01:36 UTC

[GitHub] [airflow] potiuk commented on issue #29416: Optionally allow a task pool to count tasks in the 'deferred' state as occupying slots in that pool

potiuk commented on issue #29416:
URL: https://github.com/apache/airflow/issues/29416#issuecomment-1422255026

   Yes. The small problem is that this must be a global feature due to the way how pools work for now and it would be a potentially breaking behaviour and one that has potential to dead-lock in some circumstances. 
   
   But I tihnk we could likely do it in the way that Pool could have a "include_deferred" flag that could be false by default and I think the query in scheduler could be efficiently using it to include/exclude deferred tasks. That would be a nice "feature" - but it has a few consequences across the board (modifying CLI, UI, etc.).
   
   Overall it's a nice feature for someone who would like to get more insights on some Airflow internals.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org