You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "hterik (via GitHub)" <gi...@apache.org> on 2024/02/20 12:16:22 UTC
[I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
hterik opened a new issue, #37560:
URL: https://github.com/apache/airflow/issues/37560
### Apache Airflow version
main (development)
### If "Other Airflow 2 version" selected, which one?
_No response_
### What happened?
1. git clone airflow
2. Create and enter new virtualenv
3. `pip install -e .[devel-all] --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-3.11.txt`
4. Output:
```
ERROR: Cannot install apache-airflow[cncf-kubernetes]==2.9.0.dev0 because these package versions have conflicting dependencies.
The conflict is caused by:
apache-airflow[cncf-kubernetes] 2.9.0.dev0 depends on kubernetes-asyncio<=29.0.0 and >=28.1.0; extra == "cncf-kubernetes"
The user requested (constraint) kubernetes-asyncio==24.2.3
```
* Looking in `pyproject.toml`, it requires `"kubernetes_asyncio>=28.1.0,<=29.0.0",` (It was updated few weeks ago in https://github.com/apache/airflow/pull/37040)
* Whereas in downloaded constraints-3.11.txt it is pinned as `kubernetes-asyncio==24.2.3`
There is also a difference in dash vs underscore, don't know if this is significant.
### What you think should happen instead?
Constraints listed under https://raw.githubusercontent.com/apache/airflow/constraints-main/ should be compatible with head of main branch.
### How to reproduce
see above
### Operating System
Ubuntu 23.10
### Versions of Apache Airflow Providers
_No response_
### Deployment
Other
### Deployment details
_No response_
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "hterik (via GitHub)" <gi...@apache.org>.
hterik commented on issue #37560:
URL: https://github.com/apache/airflow/issues/37560#issuecomment-1954251136
Hi, the link you provided give exactly the same instructions:
https://github.com/apache/airflow/blob/main/contributing-docs/07_local_virtualenv.rst#installing-recommended-version-of-dependencies
`pip install -e ".[devel,google]"" \
--constraint "https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-3.8.txt"`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #37560:
URL: https://github.com/apache/airflow/issues/37560#issuecomment-1955155450
PR with fix.
@hterik - since you are on it - it would be great if you pay close attentiion to those kind of issues in the docs. The docs were recently refactored and ther are likely a number of mistakes, broken links etc. Any simple ones (like broken links) can be fixed immediately - PRs are most welcome, but if you see an issue liike that, it would be great you report it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis commented on issue #37560:
URL: https://github.com/apache/airflow/issues/37560#issuecomment-1954277552
Nice catch! Never scroll down below the `hatch` instruction since it introduced.
Guess it was some outdated information, need to track all changes in the original file (this one created by splitting previous instruction). That is also section about constraints and extras for development: https://github.com/apache/airflow/blob/main/contributing-docs/12_airflow_dependencies_and_extras.rst
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis commented on issue #37560:
URL: https://github.com/apache/airflow/issues/37560#issuecomment-1954313646
I reopen for visibility that it should be changed into the contributors documentation
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "hterik (via GitHub)" <gi...@apache.org>.
hterik commented on issue #37560:
URL: https://github.com/apache/airflow/issues/37560#issuecomment-1954154299
Manually bypassing `kubernetes-asyncio` shows there are more inconsistencies:
```
ERROR: Cannot install apache-airflow, jsonschema and openapi-spec-validator because these package versions have conflicting dependencies.
The conflict is caused by:
jsonschema 4.21.1 depends on referencing>=0.28.4
jsonschema-specifications 2023.12.1 depends on referencing>=0.31.0
jsonschema-path 0.3.2 depends on referencing<0.32.0 and >=0.28.0
The user requested (constraint) referencing==0.33.0
```
All those versions are currently the same in https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-3.11.txt,
```
# This constraints file was automatically generated on 2024-02-20T10:14:41.212613
# via "eager-upgrade" mechanism of PIP. For the "main" branch of Airflow.
jsonschema-path==0.3.2
jsonschema-specifications==2023.12.1
jsonschema==4.21.1
referencing==0.33.0
```
Reaching this constraints-file should not have been possible.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis commented on issue #37560:
URL: https://github.com/apache/airflow/issues/37560#issuecomment-1954245908
Your link about released version of airflow and providers but you tried to install dev version of airflow. For create venv for development we have [Local Virtual Environment (virtualenv)](https://github.com/apache/airflow/blob/main/contributing-docs/07_local_virtualenv.rst) instruction.
k8s provider with this changes not released yet, rc3 at this moment, as soon as it released and CI step pass it will be reflected in this constraint file
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis commented on issue #37560:
URL: https://github.com/apache/airflow/issues/37560#issuecomment-1954220829
Just wondering where did you find information that you have to use `https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-3.11.txt` ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #37560: ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main`
URL: https://github.com/apache/airflow/issues/37560
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "hterik (via GitHub)" <gi...@apache.org>.
hterik commented on issue #37560:
URL: https://github.com/apache/airflow/issues/37560#issuecomment-1954236347
> Just wondering where did you find information that you have to use `https://raw.githubusercontent.com/apache/airflow/constraints-main/constraints-3.11.txt` ?
https://airflow.apache.org/docs/apache-airflow/2.8.1/installation/installing-from-pypi.html#reproducible-airflow-installation
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main` [airflow]
Posted by "Taragolis (via GitHub)" <gi...@apache.org>.
Taragolis closed issue #37560: ResolutionImpossible conflict when installing `devel-all` on head of main branch using `conststraints-main`
URL: https://github.com/apache/airflow/issues/37560
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org