[PR] [v3-4-test] Drain result_queue before dispatch in LocalExecutor to prevent runtime dispatch deadlock (#70545) [airflow]

["github-actions[bot] (via GitHub)" <gi...@apache.org>]

github-actions[bot] opened a new pull request, #74949:
URL: https://github.com/apache/airflow/pull/74949

   Fixes the runtime/dispatch-path deadlock reported in apache/airflow#70526: during
   _process_workloads the scheduler could block in activity_queue.put() while workers
   were blocked writing results into a full result_queue pipe, a circular wait. Draining
   the result queue before each put breaks the cycle. The end()/join path is already
   handled by #67881; this covers normal dispatch. Adds a call-order unit test and a
   bounded real-queue regression test.
   (cherry picked from commit b00cfeb11f0f7f45f03317a57cb4364f33c09f49)
   
   Co-authored-by: Saksham Kapoor <sa...@gmail.com>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [v3-4-test] Drain result_queue before dispatch in LocalExecutor to prevent runtime dispatch deadlock (#70545) [airflow]

["vatsrahul1001 (via GitHub)" <gi...@apache.org>]

vatsrahul1001 merged PR #74949:
URL: https://github.com/apache/airflow/pull/74949


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org