You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/10/11 01:01:55 UTC
[GitHub] [airflow] stfines-clgx opened a new issue, #26978: google-cloud-dlp dependency is out of date
stfines-clgx opened a new issue, #26978:
URL: https://github.com/apache/airflow/issues/26978
### Apache Airflow Provider(s)
google
### Versions of Apache Airflow Providers
apache-airflow = "^2.4.1"
apache-airflow-providers-google = "^8.4.0"
### Apache Airflow version
2.4.1
### Operating System
Darwin C02CP187MD6R 21.6.0 Darwin Kernel Version 21.6.0: Mon Aug 22 20:17:10 PDT 2022; root:xnu-8020.140.49~2/RELEASE_X86_64 x86_64
### Deployment
Docker-Compose
### Deployment details
Development environment
### What happened
Latest apache beam cannot be installed because of the out of date google-cloud-dlp dependency:
```
Because apache-airflow-providers-google (8.4.0) depends on google-cloud-dlp (>=0.11.0,<2.0.0)
and no versions of apache-airflow-providers-google match >8.4.0,<9.0.0, apache-airflow-providers-google (>=8.4.0,<9.0.0) requires google-cloud-dlp (>=0.11.0,<2.0.0).
So, because python-template depends on both apache-airflow-providers-google (^8.4.0) and google-cloud-dlp (^3.9.2), version solving failed.
```
### What you think should happen instead
the apache beam google provider should install using a much more current version of google-cloud-dlp; as of the creation of the ticket it is 3.9.2
### How to reproduce
set up a project with the two providers above and attempt to install any beam with gcp extensions at the current version @2.42
I tested down to 2.40 with the same result
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #26978: google-cloud-dlp dependency is out of date
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #26978:
URL: https://github.com/apache/airflow/issues/26978#issuecomment-1287953684
And let me add to what @eladkal wrote - @stfines-clgx - upgrading some dependencies is one of the best contributions you might provide - if your organisation wants to upgrade a dependency in a free software that is mostly maintained by voluntaries, spending your company resources to upgrade those deps is one of the best ways your organisation pays back (and easy way to become a contributor).
This is easy - open a pr with updating a dependncy in provider.yaml of google provider (airflow/providers/google/provider.yaml that @eladkal added ) - and update it and fix all the problems in unit tests etc. that are result of it.
Happy to help to review and guide you on that. Looking forward to it!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on issue #26978: google-cloud-dlp dependency is out of date
Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #26978:
URL: https://github.com/apache/airflow/issues/26978#issuecomment-1275796880
This is not a bug.
Many of google packages are not up to date, updating was an effort started a while ago https://github.com/apache/airflow/issues/12116
we can make progress in such issues only if users of google (like yourself) will raise PRs.
Feel free to raise one. The list of dependencies can be found on:
https://github.com/apache/airflow/blob/40d19b9ab89701126653d24d28e477e677f2ea97/airflow/providers/google/provider.yaml#L56-L119
I'm closing this issue because we are not going to have separated issue per package.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #26978: google-cloud-dlp dependency is out of date
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #26978:
URL: https://github.com/apache/airflow/issues/26978#issuecomment-1273958775
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal closed issue #26978: google-cloud-dlp dependency is out of date
Posted by GitBox <gi...@apache.org>.
eladkal closed issue #26978: google-cloud-dlp dependency is out of date
URL: https://github.com/apache/airflow/issues/26978
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org