You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/01 22:29:20 UTC

[GitHub] [airflow] smamessier opened a new issue #17975: Backfill blocks all tasks from being queued when a single pool is full.

smamessier opened a new issue #17975:
URL: https://github.com/apache/airflow/issues/17975


   ### Apache Airflow version
   
   2.0.1
   
   ### Operating System
   
   Linux
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   We are using pools with limited slots for various tasks.
   
   ### What happened
   
   - Scheduled tasks on the default pool are blocked from being queued because of unrelated pools being maxed out.
   
   ### What you expected to happen
   
   - Tasks scheduled on pools with free slots should keep getting queued and run. 
   
   ### How to reproduce
   
   This (wrong) behavior is logical given the implementation of the backfiller https://github.com/apache/airflow/blob/2aa443f8d5f0fe9b4b37b9029e9bac5176c563ce/airflow/jobs/backfill_job.py#L575
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] github-actions[bot] closed issue #17975: Backfill blocks all tasks from being queued when a single pool is full.

Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #17975:
URL: https://github.com/apache/airflow/issues/17975


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] github-actions[bot] commented on issue #17975: Backfill blocks all tasks from being queued when a single pool is full.

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #17975:
URL: https://github.com/apache/airflow/issues/17975#issuecomment-1066214696


   This issue has been automatically marked as stale because it has been open for 30 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17975: Backfill blocks all tasks from being queued when a single pool is full.

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #17975:
URL: https://github.com/apache/airflow/issues/17975#issuecomment-910838918


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] github-actions[bot] commented on issue #17975: Backfill blocks all tasks from being queued when a single pool is full.

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #17975:
URL: https://github.com/apache/airflow/issues/17975#issuecomment-1074545075


   This issue has been closed because it has not received response from the issue author.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] eladkal commented on issue #17975: Backfill blocks all tasks from being queued when a single pool is full.

Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #17975:
URL: https://github.com/apache/airflow/issues/17975#issuecomment-1035973808


   Can you please check if the issue still happens in latest airflow version?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org