You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Ironankit525 (via GitHub)" <gi...@apache.org> on 2026/03/16 18:40:43 UTC
[PR] Fix misaligned `queued_tasks` types in hybrid executors [airflow]
Ironankit525 opened a new pull request, #63744:
URL: https://github.com/apache/airflow/pull/63744
### Description
This PR addresses a subtle race condition and bug identified in `LocalKubernetesExecutor` and `CeleryKubernetesExecutor`. The `queued_tasks` property in the hybrid executors incorrectly merged base executor tasks using `dict.update()`. `dict.update()` modifies dictionaries in place.
Base executor task dictionaries are continuously accessed, deep-read, and modified, meaning that in-place modifications during reads or deep iterations can cause unexpected anomalies and exceptions. Python's dictionary union operator `|` safely merges dictionaries without mutating the operands. This ensures tasks are merged idempotently across executors without causing side effects.
### Testing
Existing unit tests verified dictionary structures are generated efficiently as expected.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix misaligned `queued_tasks` types in hybrid executors [airflow]
Posted by "Ironankit525 (via GitHub)" <gi...@apache.org>.
Ironankit525 commented on PR #63744:
URL: https://github.com/apache/airflow/pull/63744#issuecomment-4070456477
Sorry about the hallucination! I='ve removed the unrelated OpenFaaS commits, and the PR now only contains the intended `queued_tasks` fix. Let me know if everything looks good now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Fix misaligned `queued_tasks` types in hybrid executors [airflow]
Posted by "Ironankit525 (via GitHub)" <gi...@apache.org>.
Ironankit525 commented on PR #63744:
URL: https://github.com/apache/airflow/pull/63744#issuecomment-4070455773
Sorry about that! I've removed the unrelated OpenFaaS commits, and the PR now only contains the intended fix. Let me know if everything looks good now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org