You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "dheerajturaga (via GitHub)" <gi...@apache.org> on 2026/04/24 21:12:32 UTC
[PR] Fix Celery workers not executing tasks when --celery-hostname is set [airflow]
dheerajturaga opened a new pull request, #65826:
URL: https://github.com/apache/airflow/pull/65826
Workers launched with --celery-hostname reserved tasks from the broker
but never dispatched them to pool workers, leaving tasks stuck with
acknowledged=False and worker_pid=None.
The duplicate-hostname check ran celery_app.control.inspect() on the
same app later handed to worker_main(). Inspect opens broker connections
and initializes kombu's process-global producer/connection pools; the
prefork worker's master-to-child dispatch path gets wedged by that
pre-warmed state after fork.
Run the inspect against a throwaway Celery app configured from the real
app's conf, then call kombu.pools.reset() so no pool state leaks into
the app that boots the worker.
closes: #59707
---
##### Was generative AI tooling used to co-author this PR?
<!--
If generative AI tooling has been used in the process of authoring this PR, please
change below checkbox to `[X]` followed by the name of the tool, uncomment the "Generated-by".
-->
- [ ] Yes (please specify the tool below)
ClaudeCode
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix Celery workers not executing tasks when --celery-hostname is set [airflow]
Posted by "dheerajturaga (via GitHub)" <gi...@apache.org>.
dheerajturaga merged PR #65826:
URL: https://github.com/apache/airflow/pull/65826
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix Celery workers not executing tasks when --celery-hostname is set [airflow]
Posted by "dheerajturaga (via GitHub)" <gi...@apache.org>.
dheerajturaga commented on PR #65826:
URL: https://github.com/apache/airflow/pull/65826#issuecomment-4317213078
cc: @shivaam
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org