You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "sc250072 (via GitHub)" <gi...@apache.org> on 2025/10/01 11:26:47 UTC
[I] Breeze is not picking up the connections defined in environment file [airflow]
sc250072 opened a new issue, #56287:
URL: https://github.com/apache/airflow/issues/56287
### Apache Airflow version
main (development)
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
I have configured AIRFLOW_CONN_TERADATA_DEFAULT='teradata://login:password@host/schema' in `files/airflow-breeze-config/environment_variables.env` but when running system test using `breeze testing system-tests providers/teradata/tests/system/teradata/example_teradata.py`, breeze considering default connection values (defined as localhost as host in source code) and not considering connection details defined in environment file. But when I start airflow using `breeze start-airflow`, example_teradata.py dag is working successfully.
I tried to export AIRFLOW_CONN_TERADATA_DEFAULT='teradata://login:password@host/schema' at bash level and also tried at bash shell but both are not working.
I also tried to change connection name from teradata_default to teradata_normal at `teradata/tests/system/teradata/example_teradata.py` and defined AIRFLOW_CONN_TERADATA_NORMAL='teradata://login:password@host/schema' in `files/airflow-breeze-config/environment_variables.env` and breeze testing system-tests failing with _teradata_normal connection is not defined._
### What you think should happen instead?
- `breeze testing system-tests `should consider connections defined in environment variables and system tests should get success with provided connection details.
### How to reproduce
- `git clone https://github.com/apache/airflow.git`
- cd airflow
- `uv tool install -e ./dev/breeze`
- create directory under `files/airflow-breeze-config` and create `environment_variables.env`
- Define connection to Teradata database as `AIRFLOW_CONN_TERADATA_DEFAULT='teradata://login:password@host/schema'`
- Run `./scripts/ci/testing/run_system_tests.sh providers/teradata/tests/system/teradata/example_teradata.py`
New Teradata database instance can be set using following steps.
- Create a new ClearScape Analytics™ Experience account.
> If you don't already have one, sign up at:
>
> [Teradata ClearScape Analytics™ Experience](https://www.teradata.com/getting-started/demos/clearscape-analytics)
>
- Login
> Sign in with your new account at:
>
> [ClearScape Analytics™ Experience Login](https://clearscape.teradata.com/sign-in)
- Create new Teradata instance
> use option `Create new environment` to create new Teradata instance
> login: demo_user
> schema: demo_user
### Operating System
Ubuntu 22.04.5 LTS
### Versions of Apache Airflow Providers
apache-airflow-providers-teradata - 3.2.1
### Deployment
Docker-Compose
### Deployment details
docker Version 27.5.1
Docker Compose version v2.32.4
Python 3.10.12
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Breeze is not picking up the connections defined in environment file [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #56287:
URL: https://github.com/apache/airflow/issues/56287#issuecomment-3398469971
This is expected. Pytest common plugin we use, clears env variables when pytest is run (to make sure tests are reproducible - regardless of the env variables set accidentally in the environment). You can disable it by passing `--keep-env-variables` as exta argument:
<img width="2418" height="2892" alt="Image" src="https://github.com/user-attachments/assets/c66bed4f-b63c-49d3-a757-0eae254868f9" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Breeze is not picking up the connections defined in environment file [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #56287:
URL: https://github.com/apache/airflow/issues/56287#issuecomment-3355882001
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Breeze is not picking up the connections defined in environment file [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #56287:
URL: https://github.com/apache/airflow/issues/56287#issuecomment-3407672136
I think you should debig it @sc250072 . Just the usual way you debug things
1) print the variable after it is set in the init
2) check if environment variable is actually set where you want to read it in the Dag (simply printing it should work).
3) check if it is set before the "pytest" command (look and run_tests.py - there is a place where pytest command is run
4) Finally you can use `--verbose` to see the exact command that is executed by breeze (it's a copy-pesteable docker-compose command that is executed) and manually run the exact command that breeze runs
Maybe there are other conftetst.py rules that are removing the variable somewhere on your path - but only by this debugging you can find where it is likely - it's not a rocket science. It's just a docker-compose command that gets executed, so debugging it should be easy once you know `--verbose` and can follow it step-by-step.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Breeze is not picking up the connections defined in environment file [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #56287:
URL: https://github.com/apache/airflow/issues/56287#issuecomment-3407673659
That will be way more efficient rather than me trying to guess and starting another set of hypotheses
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Breeze is not picking up the connections defined in environment file [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #56287: Breeze is not picking up the connections defined in environment file
URL: https://github.com/apache/airflow/issues/56287
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Breeze is not picking up the connections defined in environment file [airflow]
Posted by "sc250072 (via GitHub)" <gi...@apache.org>.
sc250072 commented on issue #56287:
URL: https://github.com/apache/airflow/issues/56287#issuecomment-3407385969
@potiuk I already tried this option but still the same issue. Please find the screenshots of this configuration.
<img width="1569" height="832" alt="Image" src="https://github.com/user-attachments/assets/af9b755c-ac55-40ac-a0d8-3cb5106dadca" />
<img width="720" height="54" alt="Image" src="https://github.com/user-attachments/assets/e70a7d87-e8fc-46f2-abe2-34fc4db27a6d" />
Error log
<img width="1249" height="803" alt="Image" src="https://github.com/user-attachments/assets/17dab94f-27ef-477e-9e45-f29227049679" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org