You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jobs@airflow.apache.org by GitBox <gi...@apache.org> on 2026/04/14 17:02:21 UTC
[GH] (airflow/refs/pull/65235/head): Workflow run "Copilot code review" is working again!
The GitHub Actions job "Copilot code review" on airflow.git/refs/pull/65235/head has succeeded.
Run started by GitHub user Copilot (triggered by Copilot).
Head commit for run:
30fa0cc15f8200cb1f8977ba9ab8e9f39452916e / Kaxil Naik <ka...@gmail.com>
Cache InProcessExecutionAPI in dag.test() for 6x speedup
dag.test() creates a new InProcessExecutionAPI for every task
execution. Each instance spins up a new FastAPI app, a2wsgi ASGI-to-WSGI
bridge with its own event loop thread, and DB connections. Profiling
shows the cold event loop thread dominates: 1.25s/task uncached vs
0.20s/task cached (6.2x speedup for a 10-task DAG).
Add @functools.lru_cache(maxsize=1) to in_process_api_server() so
the FastAPI app and warm event loop are reused across all tasks.
DagFileProcessorManager already uses this pattern (manager.py:269).
Also clean up stale dependency_overrides when _api_client(dag=None)
is called (e.g. from run_trigger_in_process), add a cache_clear
fixture in conftest.py, and add a test for the caching contract.
Report URL: https://github.com/apache/airflow/actions/runs/24411990391
With regards,
GitHub Actions via GitBox
---------------------------------------------------------------------
To unsubscribe, e-mail: jobs-unsubscribe@airflow.apache.org
For additional commands, e-mail: jobs-help@airflow.apache.org