You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/09/26 17:53:13 UTC
[GitHub] [airflow] hterik commented on issue #21225: Tasks stuck in queued state
hterik commented on issue #21225:
URL: https://github.com/apache/airflow/issues/21225#issuecomment-1258404240
We got similar issue (Airflow 2.3.3), it happened right after worker suffered connection loss to Redis who later did not consume any tasks for 3 days, despite showing up as healthy in Flower.
One thing i suspect is that reconnect attempt got stuck in an infinite timeout. Python sockets have default no timeout, same default applies in Celery and redis-py. (This would not explain why flower showed node as healthy though)
Discussed in https://github.com/redis/redis-py/issues/722 and https://github.com/redis/redis-py/issues/2243
In airflow, the celery_broker_transport_options option can be used to set the options discussed there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org