[GitHub] [airflow] hussein-awala commented on issue #28402: Support of reading dags from database by task_runners

[GitBox <gi...@apache.org>]

hussein-awala commented on issue #28402:
URL: https://github.com/apache/airflow/issues/28402#issuecomment-1370366470

   I think this is a good feature especially for the static dags files, where there is no need to re-run the scripts to load these dags before running each task, we can directly use the serialized dags stored in the DB.
   
   To make it clean, I propose adding a Dag conf `load_from_db_to_run_tasks` to tell Airflow that this Dag doesn't need a new file processing to run its tasks, with a  scheduler conf `default_load_from_db_to_run_tasks` which is false by default.
   
   The scheduler dags files processor agent will be deactivated, and the standalone dag processor will be executed by the CI on each release, we need #28711 to avoid considering the dags as stale and cleaning them.
   
   Can someone assign the ticket to me?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org