[GitHub] [airflow] easontm commented on issue #21225: Tasks stuck in queued state

[GitBox <gi...@apache.org>]

easontm commented on issue #21225:
URL: https://github.com/apache/airflow/issues/21225#issuecomment-1031361404


   I'm getting the same message but different symptoms. For me, the task gets marked failed with no logs. Setup is similar, with CeleryKubernetesExecutor, RabbitMQ, and MySQL backend.
   
   A sensor in `reschedule` mode was doing it's periodic run-sleep-run pattern. On one of the later runs, I got the `could not queue task instance` message. I grabbed the `external_id` from the logs and searched for it in Flower, and it turns out the celery task actually succeeded (that is, performed its check -- the sensor itself didn't "succeed").
   
   I think some kind of desync between the states known by Airflow and the executor is causing this, but I'm not sure why the results of the successfully executed task weren't reported, even though Airflow thought it couldn't be queued (which it was).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org