You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "swasenius (via GitHub)" <gi...@apache.org> on 2024/05/31 10:14:29 UTC
[I] "Test" airflow connection does not work [airflow]
swasenius opened a new issue, #39968:
URL: https://github.com/apache/airflow/issues/39968
### Apache Airflow version
2.9.1
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
After migration 2.5.3 -> 2.9.1 we noticed that the connectivity "Test" in Airflow UI does not work for JDBC connections. We do have AIRFLOW__CORE__TEST_CONNECTION enabled.
It will give an error on the the UI such as: "`The conn_id `<random string>` isn't defined`".
The string here is always changing so it somehow does not pick up the connection_id right.
### What you think should happen instead?
Testing JDBC connectivity should work, if connection details are correct.
### How to reproduce
When testing JDBC connection in Airflow UI.
### Operating System
Debian 12
### Versions of Apache Airflow Providers
airflow@airflow-worker-0:/opt/airflow$ pip freeze |grep airflow-prov
apache-airflow-providers-amazon==7.4.1
apache-airflow-providers-celery==3.6.2
apache-airflow-providers-cncf-kubernetes==8.0.0
apache-airflow-providers-common-io==1.3.1
apache-airflow-providers-common-sql==1.12.0
apache-airflow-providers-docker==3.10.0
apache-airflow-providers-elasticsearch==5.3.4
apache-airflow-providers-fab==1.0.4
apache-airflow-providers-ftp==3.8.0
apache-airflow-providers-google==10.17.0
apache-airflow-providers-grpc==3.4.1
apache-airflow-providers-hashicorp==3.6.4
apache-airflow-providers-http==4.10.1
apache-airflow-providers-imap==3.5.0
apache-airflow-providers-jdbc==4.2.2
apache-airflow-providers-microsoft-azure==10.0.0
apache-airflow-providers-microsoft-mssql==3.6.1
apache-airflow-providers-mysql==5.5.4
apache-airflow-providers-odbc==4.5.0
apache-airflow-providers-openlineage==1.7.0
apache-airflow-providers-postgres==5.10.2
apache-airflow-providers-redis==3.6.1
apache-airflow-providers-sendgrid==3.4.0
apache-airflow-providers-sftp==4.9.1
apache-airflow-providers-slack==8.6.2
apache-airflow-providers-smtp==1.6.1
apache-airflow-providers-snowflake==5.4.0
apache-airflow-providers-sqlite==3.7.1
apache-airflow-providers-ssh==3.10.1
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "RNHTTR (via GitHub)" <gi...@apache.org>.
RNHTTR commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-2142137342
It's worth noting that this was disabled due to a [security vulnerability](https://airflow.apache.org/docs/apache-airflow/stable/howto/connection.html#testing-connections).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-2141704173
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "pateash (via GitHub)" <gi...@apache.org>.
pateash commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-2160018429
I can check this out, If no one else is picking this up.
Please assign this to me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "aritra24 (via GitHub)" <gi...@apache.org>.
aritra24 commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-2144413747
Had a quick look, My guess would be the connection url being put in might be malformed in some way, something like "jdbc:postgresql://host:port/database?properties" while what it want's is just the host:port form? because the logs have this error message `Invalid connection string: jdbc://jdbc:postgresql://admin@localhost%3A5432%2Fairflow/?__extra__=%7B%7D.` I believe the error message in the UI could probably be clearer?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-4090249360
There is an active discussion and proposal in the mailing list [[DISCUSS] Move connection testing to workers](https://lists.apache.org/thread/xd7zmyp95y77cw36mb5wjp17dyynz100)
Closing the issue as discussion should be on the mailing list
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "swasenius (via GitHub)" <gi...@apache.org>.
swasenius commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-2149436237
Here's an example:
jdbc:sqlserver://XXX.XXX.XX.XX:1433
and this looks like MS SQL server. User ie login is define in it's own field.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "swasenius (via GitHub)" <gi...@apache.org>.
swasenius commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-2149759965
If I remove the first part and use XXX.XXX.XX.XX:1433, I get:
Class com.microsoft.sqlserver.jdbc.SQLServerDriver is not found
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "bhatiazzz (via GitHub)" <gi...@apache.org>.
bhatiazzz commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-3005675301
Hi @pateash / @swasenius ,
I am also facing the same did we have any solution yet?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "aritra24 (via GitHub)" <gi...@apache.org>.
aritra24 commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-2149574922
Yes @swasenius , the field expects just the XXX.XXX.XX.XX:1433 part and appends the jdbc:// part on it's own. I assume for MSSQL we are expected to use the Microsoft SQL Server connection type.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-3986487239
@pateash We are unassigning you from this issue as part of our updated [assignment policy](https://github.com/apache/airflow/blob/main/contributing-docs/04_how_to_contribute.rst#contribute-code-changes).
This is not meant to discourage your contribution — quite the opposite! You are still very welcome to work on this issue and submit a PR for it. Simply comment that you are working on it and open a PR when ready.
We found that formal assignments were not working well, as they often prevented others from contributing when the assignee was not actively working on the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #39968: "Test" airflow connection does not work
URL: https://github.com/apache/airflow/issues/39968
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] "Test" airflow connection does not work [airflow]
Posted by "pateash (via GitHub)" <gi...@apache.org>.
pateash commented on issue #39968:
URL: https://github.com/apache/airflow/issues/39968#issuecomment-2238669702
Couple of things I found,
1. We can't provide jdbc: as it is automatically provided. => we need to add better documentation in UI and may be add a better error message.
<img width="1127" alt="image" src="https://github.com/user-attachments/assets/c10bd8e3-0871-4b50-9cb1-540ae9c71e3f">
2.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org