You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jobs@airflow.apache.org by GitBox <gi...@apache.org> on 2026/06/12 20:00:27 UTC
[GH] (airflow/k8s-executor-async-pod-creation): Workflow run "Tests (AMD)" failed!
The GitHub Actions job "Tests (AMD)" on airflow.git/k8s-executor-async-pod-creation has failed.
Run started by GitHub user 1fanwang (triggered by 1fanwang).
Head commit for run:
353eee6540c88573f83a8cf2db38552a7b6e18eb / 1fanwang <1f...@gmail.com>
Add opt-in concurrent pod creation to KubernetesExecutor
The KubernetesExecutor creates worker pods one at a time within each scheduler
loop: run_next() issues a synchronous create_namespaced_pod and blocks on the
API response before starting the next. When per-create latency is high (API
round-trip, mutating admission webhooks), this serializes the scheduler loop and
caps pod-creation throughput per loop.
Add an opt-in concurrent path: when [kubernetes_executor] async_pod_creation is
True, the pods dequeued in a loop are built synchronously (pod-mutation hook and
reconciliation unchanged), then their create calls are issued concurrently via
the asynchronous Kubernetes client, bounded by pod_creation_max_concurrency. The
sequential path stays the default and is unchanged. A new pod_creation_batch_duration
metric (emitted by both paths) measures per-loop batch creation time.
Report URL: https://github.com/apache/airflow/actions/runs/27437194268
With regards,
GitHub Actions via GitBox
---------------------------------------------------------------------
To unsubscribe, e-mail: jobs-unsubscribe@airflow.apache.org
For additional commands, e-mail: jobs-help@airflow.apache.org