[GitHub] [airflow] laurikoobas commented on issue #13542: Task stuck in "scheduled" or "queued" state, pool has all slots queued, nothing is executing

[GitBox <gi...@apache.org>]

laurikoobas commented on issue #13542:
URL: https://github.com/apache/airflow/issues/13542#issuecomment-817101896


   I ran into the same issue and it was none of these causes. What I figured out and what fixed it was that I ran the Celery Flower (it runs on port 5555, run it by "airflow celery flower" command). And from there I could see all the celery workers that were in the pool of workers. There was some there that I didn't expect - apparently I had a temporary/testing setup of Airflow running against the same celery backend and the worker there was also trying to pick up the queued tasks.
   But the task definitions were different between the scheduler and that errant worker, so it didn't run. Of course the errors were also produced not at the main worker and I just didn't see them.
   When I stopped that errant worker then everything resumed working.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org