You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "stephen-bracken (via GitHub)" <gi...@apache.org> on 2026/07/20 14:01:47 UTC

[I] Update config parser to Load json config settings from files [airflow]

stephen-bracken opened a new issue, #70133:
URL: https://github.com/apache/airflow/issues/70133

   ### Description
   
   Json config settings like `[core] dag_bundle_config_list` and `[secrets_backend] backend_kwargs` can become quite large and cumbersome. The linux kernel sets a maximum total size limit of 256MB for environment variables, so adding large json blobs to the environment variables risks running into these limits. To work around this, json files could be loaded into the config using the same technique as secrets by specifying a path to a json file in the config and reading the file at runtime using `json.load()`. 
   
   ### Use case/motivation
   
   Like with config settings tagged as secrets, update the `conf.getjson()` method to also attempt to load json config settings from a path specified using a suffix, e.g. `dag_bundle_config_list_file=/opt/airflow/config/dag_bundles.json` would read the setting `dag_bundle_config_list` from `/opt/airflow/config/dag_bundles.json`
   
   ### Related issues
   
   #65449
   
   ### Are you willing to submit a PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org