You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jobs@airflow.apache.org by GitBox <gi...@apache.org> on 2026/04/22 21:48:50 UTC

[GH] (airflow/fix/dag-processor-ipc-bottleneck): Workflow run "Tests" failed!

The GitHub Actions job "Tests" on airflow.git/fix/dag-processor-ipc-bottleneck has failed.
Run started by GitHub user rahulchheda (triggered by potiuk).

Head commit for run:
2366c5d3704f6595c03eddcbf87bb8eff15a2e15 / Rahul Chheda <ra...@coinbase.com>
fix: service IPC sockets during dag bundle refresh to prevent child blocking

Child parsing processes that call Variable.get() during DAG parsing
block on socket.recv() waiting for the parent DagFileProcessorManager
to service the IPC request. However, IPC is only serviced once per
main loop iteration in _service_processor_sockets(). During
_refresh_dag_bundles() and other main loop operations, child processes
are completely blocked — turning sub-second parses into multi-minute
waits.

This adds a background thread that continuously services IPC sockets
while _refresh_dag_bundles() runs, ensuring child processes get
immediate responses to Variable.get() and Connection.get() calls.

Closes #65369

Report URL: https://github.com/apache/airflow/actions/runs/24515061715

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: jobs-unsubscribe@airflow.apache.org
For additional commands, e-mail: jobs-help@airflow.apache.org