You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "shubham-arora-18 (via GitHub)" <gi...@apache.org> on 2024/07/19 09:33:24 UTC
[I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]
shubham-arora-18 opened a new issue, #40885:
URL: https://github.com/apache/airflow/issues/40885
### Apache Airflow version
Other Airflow 2 version (please specify below)
### If "Other Airflow 2 version" selected, which one?
2.5.1
### What happened?
I have been facing an issue with GCP airflow.
- Version of composer: composer-2.3.3
- Version of airflow: airflow-2.5.1
- Version of apache-airflow-providers-snowflake package: 5.1.2
Issue is:
1. The normal SnowflakeOperator(`airflow.providers.snowflake.operators.snowflake.SnowflakeOperator`) internally uses correct url for snowflake authentication (`https://<orgname>-<account_name>.[snowflakecomputing.com](http://snowflakecomputing.com/`).
2. But SnowflakeSqlApiOperator (`airflow.providers.snowflake.operators.snowflake.SnowflakeSqlApiOperator`) uses legacy url for snowflake authentication(`https://<accountlocator>.<region>.<cloud>.[snowflakecomputing.com](http://snowflakecomputing.com/`).
3. The use of legacy url is discouraged and support for the same will end soon, we confirmed this from snowflake.
4. I looked at the change log between 5.1.2 version to the latest version(5.6.0) but no log suggests this has been taken care of.
Related Links:
Apache Airflow Snowflake package documentation: [https://airflow.apache.org/docs/apache-airflow-providers-snowflake/5.1.2/_api/airflow/providers/snowflake/operators/snowflake/index.html#module-airflow.providers.snowflake.operators.snowflake]
Snowflake documentation for authentication: [https://docs.snowflake.com/en/user-guide/organizations-connect]
### What you think should happen instead?
The SnowflakeSqlApiOperator should use the same url for snowflake authentication as the SnowflakeOperator.
### How to reproduce
Try running a query with SnowflakeSqlApiOperator on your snowflake instance.
### Operating System
mac
### Versions of Apache Airflow Providers
_No response_
### Deployment
Google Cloud Composer
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]
Posted by "shubham-arora-18 (via GitHub)" <gi...@apache.org>.
shubham-arora-18 closed issue #40885: SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue
URL: https://github.com/apache/airflow/issues/40885
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #40885:
URL: https://github.com/apache/airflow/issues/40885#issuecomment-2238759649
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]
Posted by "shubham-arora-18 (via GitHub)" <gi...@apache.org>.
shubham-arora-18 closed issue #40885: SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue
URL: https://github.com/apache/airflow/issues/40885
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]
Posted by "shahar1 (via GitHub)" <gi...@apache.org>.
shahar1 commented on issue #40885:
URL: https://github.com/apache/airflow/issues/40885#issuecomment-2239179955
The Cloud Composer, AIrflow and snowflake versions seem outdated - have you tried upgrading to latest?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]
Posted by "shubham-arora-18 (via GitHub)" <gi...@apache.org>.
shubham-arora-18 commented on issue #40885:
URL: https://github.com/apache/airflow/issues/40885#issuecomment-2255655913
Yes, I just checked it and it is fixed. Closing the issue, thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]
Posted by "shubham-arora-18 (via GitHub)" <gi...@apache.org>.
shubham-arora-18 commented on issue #40885:
URL: https://github.com/apache/airflow/issues/40885#issuecomment-2242593699
> The Cloud Composer, AIrflow and snowflake versions seem outdated - have you tried upgrading each to the latest?
Updating composer is a taxing task. No point in upgrading the composer unless the issue has been resolved in the latest apache snowflake library. I don't see any such change in the changelog.
Please correct me if wrong.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SnowflakeSqlApiOperator's Snowflake Legacy Url Authentication Issue [airflow]
Posted by "shahar1 (via GitHub)" <gi...@apache.org>.
shahar1 commented on issue #40885:
URL: https://github.com/apache/airflow/issues/40885#issuecomment-2243661725
C
> > The Cloud Composer, AIrflow and snowflake versions seem outdated - have you tried upgrading each to the latest?
>
> Updating composer is a taxing task. No point in upgrading the composer unless the issue has been resolved in the latest apache snowflake library. I don't see any such change in the changelog.
>
> Please correct me if wrong.
Could you please take a look at #37922 and check if it should resolve the issue? (it exists in versions 5.4.0+ of the Snowflake provider)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org