You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "nathadfield (via GitHub)" <gi...@apache.org> on 2026/01/21 16:38:53 UTC

[I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

nathadfield opened a new issue, #60887:
URL: https://github.com/apache/airflow/issues/60887

   ### Description
   
   Currently, clearing or rerunning a DAG defaults to using the original bundle version for reproducibility.
   
   While users can manually select `run with latest version` in the UI or pass `run_on_latest_version=True` via API, there is no configuration option to set an organization-wide default. This requires manual intervention on every rerun, which can be inconsistent across teams.                                                                                                                                                                                                                                                   
                                                                                                                                                                                                                                                                                                                            
   Add a configuration option (e.g., `[dag_processor] default_clear_run_on_latest_version = false`) to allow administrators to set their organization's preferred default behavior, while still allowing per-operation overrides via UI/API.
   
   ### Use case/motivation
   
   Different organizations have different philosophies:
   - Development/staging environments may prefer always using the latest code to catch issues early
   - Production environments may prefer reproducibility for debugging
   - Fast-moving teams may want bug fixes automatically included in reruns without manual selection
   
   Currently, teams must remember to check/uncheck the "run with latest version" box every time, leading to inconsistent behavior and potential for human error.
   
   A configurable default would align with organizational policy while maintaining flexibility for exceptions.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #60887:
URL: https://github.com/apache/airflow/issues/60887#issuecomment-3784415633

   Should also be configurable per dag 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #60887:
URL: https://github.com/apache/airflow/issues/60887#issuecomment-3986411706

   @nathadfield We are unassigning you from this issue as part of our updated [assignment policy](https://github.com/apache/airflow/blob/main/contributing-docs/04_how_to_contribute.rst#contribute-code-changes).
   
   This is not meant to discourage your contribution — quite the opposite! You are still very welcome to work on this issue and submit a PR for it. Simply comment that you are working on it and open a PR when ready.
   
   We found that formal assignments were not working well, as they often prevented others from contributing when the assignee was not actively working on the issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

Posted by "waltervillarreal (via GitHub)" <gi...@apache.org>.
waltervillarreal commented on issue #60887:
URL: https://github.com/apache/airflow/issues/60887#issuecomment-3861074751

   Would be great having this option


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

Posted by "bbovenzi (via GitHub)" <gi...@apache.org>.
bbovenzi closed issue #60887: Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns
URL: https://github.com/apache/airflow/issues/60887


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

Posted by "nathadfield (via GitHub)" <gi...@apache.org>.
nathadfield commented on issue #60887:
URL: https://github.com/apache/airflow/issues/60887#issuecomment-3861085697

   > Would be great having this option
   
   @waltervillarreal Working on it!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

Posted by "ephraimbuddy (via GitHub)" <gi...@apache.org>.
ephraimbuddy commented on issue #60887:
URL: https://github.com/apache/airflow/issues/60887#issuecomment-3784613931

   I don't think it should be a config in [dag_processor], maybe [core]. If configured, it should decide whether the run on latest version in the UI is checked or not


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

Posted by "nathadfield (via GitHub)" <gi...@apache.org>.
nathadfield commented on issue #60887:
URL: https://github.com/apache/airflow/issues/60887#issuecomment-3989879650

   Still very much working on this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add configuration option for default `run_on_latest_version` behavior on DAG clears/reruns [airflow]

Posted by "nathadfield (via GitHub)" <gi...@apache.org>.
nathadfield commented on issue #60887:
URL: https://github.com/apache/airflow/issues/60887#issuecomment-3804922467

   PR is now open for this and #60880.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org