You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "aporwal17 (via GitHub)" <gi...@apache.org> on 2026/01/16 00:27:12 UTC
[I] Add REST API to Refresh / Reload DAG Bundle Without Restart [airflow]
aporwal17 opened a new issue, #60616:
URL: https://github.com/apache/airflow/issues/60616
### Description
Currently, refreshing a DAG bundle requires a dag processor service restart or relies on periodic refresh polling interval. This limits automation and makes it difficult for external systems (CI/CD pipelines, orchestration platforms, or UI actions) to trigger an immediate DAG refresh after deployment.
This issue proposes adding a REST API endpoint to explicitly refresh or reload a DAG bundle on demand.
### Use case/motivation
In environments where DAGs are deployed via automated CI/CD pipelines or managed as versioned bundles, DAG updates are not immediately reflected without restarting the service or waiting for the next scan interval. This introduces unnecessary delays and operational overhead.
Providing a REST API to refresh a DAG bundle enables:
- Immediate availability of newly deployed or updated DAGs after a deployment completes
- Automation-friendly workflows, allowing CI/CD pipelines and external orchestration systems to trigger DAG refresh programmatically
- Reduced service restarts, minimizing disruption to running workloads
- Improved developer experience, offering a deterministic and observable way to reload DAG definitions
Overall, this capability supports modern, API-driven operations and makes DAG lifecycle management more reliable, scalable, and automated.
Introduce a **REST API endpoint** that allows authorized clients to trigger a DAG bundle refresh.
`POST /api/v2/dag-bundles/{bundle_id}/refresh`
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add REST API to Refresh / Reload DAG Bundle Without Restart [airflow]
Posted by "Prajwal7842 (via GitHub)" <gi...@apache.org>.
Prajwal7842 commented on issue #60616:
URL: https://github.com/apache/airflow/issues/60616#issuecomment-3778390021
If there is a plan to implemen this, then I would like to work on this. This is something similar to triggering an on_demand serialization which can take dag_id as the input. If the dag_id is already present in DB, we can get additional info like driver path etc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add REST API to Refresh / Reload DAG Bundle Without Restart [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #60616:
URL: https://github.com/apache/airflow/issues/60616#issuecomment-3902143987
There is no need to wait for being assigned to work on things -> I assigned both of you now - up to you who will work on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add REST API to Refresh / Reload DAG Bundle Without Restart [airflow]
Posted by "shashbha14 (via GitHub)" <gi...@apache.org>.
shashbha14 commented on issue #60616:
URL: https://github.com/apache/airflow/issues/60616#issuecomment-3758691976
I would like to work on this issue.Please assign this to me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add REST API to Refresh / Reload DAG Bundle Without Restart [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #60616:
URL: https://github.com/apache/airflow/issues/60616#issuecomment-3986414083
@Prajwal7842 We are unassigning you from this issue as part of our updated [assignment policy](https://github.com/apache/airflow/blob/main/contributing-docs/04_how_to_contribute.rst#contribute-code-changes).
This is not meant to discourage your contribution — quite the opposite! You are still very welcome to work on this issue and submit a PR for it. Simply comment that you are working on it and open a PR when ready.
We found that formal assignments were not working well, as they often prevented others from contributing when the assignee was not actively working on the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add REST API to Refresh / Reload DAG Bundle Without Restart [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #60616:
URL: https://github.com/apache/airflow/issues/60616#issuecomment-3986414340
@shashbha14 We are unassigning you from this issue as part of our updated [assignment policy](https://github.com/apache/airflow/blob/main/contributing-docs/04_how_to_contribute.rst#contribute-code-changes).
This is not meant to discourage your contribution — quite the opposite! You are still very welcome to work on this issue and submit a PR for it. Simply comment that you are working on it and open a PR when ready.
We found that formal assignments were not working well, as they often prevented others from contributing when the assignee was not actively working on the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org