You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/08 01:29:27 UTC
[GitHub] [airflow] edgarrmondragon opened a new issue #18075: Airflow installation fails when with latest `setuptools`
edgarrmondragon opened a new issue #18075:
URL: https://github.com/apache/airflow/issues/18075
### Apache Airflow version
2.1.2
### Operating System
Ubuntu 20.04
### Versions of Apache Airflow Providers
NA
### Deployment
Other Docker-based deployment
### Deployment details
Ubuntu Docker image, Airflow installed inside a `virtualenv` in the image.
### What happened
Trying to pip-install Airflow in a virtualenv where `setuptools` is `>=58.0.2` fails:
```
Orchestrator 'airflow' could not be installed: failed to install plugin 'airflow'.
ERROR: Command errored out with exit status 1:
command: /project/.meltano/orchestrators/airflow/venv/bin/python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-g8rc5i_t/flask-openid_b02636d256a1457daa8e5d35116652ca/setup.py'"'"'; __file__='"'"'/tmp/pip-install-g8rc5i_t/flask-openid_b02636d256a1457daa8e5d35116652ca/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-r8lhwbha
cwd: /tmp/pip-install-g8rc5i_t/flask-openid_b02636d256a1457daa8e5d35116652ca/
Complete output (1 lines):
error in Flask-OpenID setup command: use_2to3 is invalid.
```
The `setuptools` team deprecated `use_2to3` (see https://github.com/pypa/setuptools/issues/2086) recently and this is breaking installation of packages which rely on that legacy key. In the case of Airflow, `Flask-OpenID`, required by `Flask-AppBuilder`, is the offending dependency. See https://github.com/mitsuhiko/flask-openid/blob/v1.2.5/setup.py#L32.
This should probably be fixed by that project's maintainers, but we (Meltano) thought it was a good idea to file this issue here in case Airflow users run into the problem. Just removing `use_2to3` seems to work π.
### What you expected to happen
Airflow's dependencies should be prepared for new versions of `setuptools` and Python (`3.10`).
### How to reproduce
```console
$ python -m venv venv
$ source venv/bin/activate
(venv) $ pip install "setuptools==58.0.2"
(venv) $ pip install apache-airflow
...
Collecting Flask-OpenID<2,>=1.2.5
Using cached Flask-OpenID-1.2.5.tar.gz (43 kB)
ERROR: Command errored out with exit status 1:
command: python -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/8b/z9sdckf92_g3hgnh6nv0yhbh0000gn/T/pip-install-wazcqi5t/flask-openid_d71a670325d74cf6b46f7347ab3e06f4/setup.py'"
'"'; __file__='"'"'/private/var/folders/8b/z9sdckf92_g3hgnh6nv0yhbh0000gn/T/pip-install-wazcqi5t/flask-openid_d71a670325d74cf6b46f7347ab3e06f4/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringI
O('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /private/var/folders/8b/z9sdckf92_g3hgnh6nv0yhbh0000gn/T/pip-pip-egg-inf
o-on8iyf31
cwd: /private/var/folders/8b/z9sdckf92_g3hgnh6nv0yhbh0000gn/T/pip-install-wazcqi5t/flask-openid_d71a670325d74cf6b46f7347ab3e06f4/
Complete output (1 lines):
error in Flask-OpenID setup command: use_2to3 is invalid
```
### Anything else
The current workaround it to make sure a version of `setuptools` prior to `58.0.0` is installed in the active Python environment.
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915145181
Fr those curious ones - I'we built Flask-OpenId 1.2.6 with removed 2_to_3, we host it here: https://github.com/apache/airflow-flask-openid-fork/releases/tag/v1.2.6 and our constraints have been updated to install it from there:
https://github.com/apache/airflow/commit/64508c7c974f56ac05a919deca0b69ad1b9df19e
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915357833
> `pip` version is 21.0.1, can also provide `requirements.txt` if it's helpful, but I don't think it's relevant.
You should upgrade to newer PIP version.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915185167
All right. Patched all released constraints.
For the record and keeping track:
* 2.1.3: https://github.com/apache/airflow/commit/64508c7c974f56ac05a919deca0b69ad1b9df19e
* 2.1.2: https://github.com/apache/airflow/commit/641d6cad2b7221e58fdc117a0faa3d12652a10b2
* 2.1.1: https://github.com/apache/airflow/commit/cf0834b1da66ad8424ecb6344c799a1e9a6abe2e
* 2.1.0: https://github.com/apache/airflow/commit/1e52c69c608c417c9466dd512e4cd46a65dbad68
* 2.0.2: https://github.com/apache/airflow/commit/82cc57b5f96f08f6d5976b3e6a3ea33b3b5459d0
* 2.0.1: https://github.com/apache/airflow/commit/2984d415c1fd9cf535cacf26b57666acadf24706
* 2.0.0: https://github.com/apache/airflow/commit/dd3e88fd6414ca9fda7108088a959e709b45037f
I will close the issue where we also solve it in the "main" and apply to upcoming 2.1.4 (we still need to automate that as it was manual)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] uranusjr commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
uranusjr commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915228611
You can apply this line to your requirements yourself:
```
Flask-OpenID @ https://github.com/apache/airflow-flask-openid-fork/releases/download/v1.2.6/Flask-OpenID-1.2.6.tar.gz
```
A recent pip version should pick up the line automatically. If youβre stuck on an old pip version, `pip install` the line separately before installing Airflow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] RafayAK commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
RafayAK commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915151609
@potiuk just tried building my dockerfile again with the following:
```bash
# install Airflow with constraints file for compatibility
ARG AIRFLOW_VERSION=2.0.1
ARG PYTHON_VER=3.7
ARG CONSTRAINT_URL="https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VER}.txt"
RUN pip3 install --upgrade pip && \
pip install -U pip setuptools wheel \
&& pip install "apache-airflow[statsd]==${AIRFLOW_VERSION}" --constraint "${CONSTRAINT_URL}" \
&& pip install pyOpenSSL \
&& pip install ffmpeg-python
```
It results in the following error:
```
Downloading Flask_SQLAlchemy-2.4.4-py2.py3-none-any.whl (17 kB)
Collecting Flask-OpenID<2,>=1.2.5
Downloading Flask-OpenID-1.2.5.tar.gz (43 kB)
ERROR: Command errored out with exit status 1:
command: /usr/local/bin/python3.7 -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-m76ljhex/flask-openid_ea4f1905c75b4a29824cae4d51521afd/setup.py'"'"'; __file__='"'"'/tmp/pip-install-m76ljhex/flask-openid_ea4f1905c75b4a29824cae4d51521afd/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-ccsz9_u0
cwd: /tmp/pip-install-m76ljhex/flask-openid_ea4f1905c75b4a29824cae4d51521afd/
Complete output (1 lines):
error in Flask-OpenID setup command: use_2to3 is invalid.
----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/d1/a2/9d1fba3287a65f81b9d1c09c4f7cb16f8ea4988b1bc97ffea0d60983338f/Flask-OpenID-1.2.5.tar.gz#sha256=5a8ffe1c8c0ad1cc1f5030e1223ea27f8861ee0215a2a58a528cc61379e5ccab (from https://pypi.org/simple/flask-openid/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
INFO: pip is looking at multiple versions of flask to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of dill to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of cffi to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of cryptography to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of croniter to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of click to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of clickclick to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of connexion[flask,swagger-ui] to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of commonmark to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of colorlog to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of colorama to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of cattrs to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of cached-property to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of attrs to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of argcomplete to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of alembic to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of <Python from Requires-Python> to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of rich to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of apache-airflow[statsd] to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install apache-airflow because these package versions have conflicting dependencies.
The conflict is caused by:
flask-appbuilder 3.1.1 depends on Flask-OpenID<2 and >=1.2.5
The user requested (constraint) flask-openid==1.2.5
To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/user_guide/#fixing-conflicting-dependencies
The command '/bin/sh -c pip3 install --upgrade pip && pip install -U pip setuptools wheel && pip install "apache-airflow[statsd]==${AIRFLOW_VERSION}" --constraint "${CONSTRAINT_URL}" && pip install pyOpenSSL && pip install ffmpeg-python' returned a non-zero code: 1
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] agrounds edited a comment on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
agrounds edited a comment on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915318171
@potiuk Airflow installation via `pip` is now failing for us. We're running this:
```
pip install -r requirements.txt --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VERSION}.txt"
```
with `AIRFLOW_VERSION=2.1.3` and `PYTHON_VERSION=3.8`, and we're getting this error:
> DEPRECATION: Constraints are only allowed to take the form of a package name and a version specifier. Other forms were originally permitted as an accident of the implementation, but were undocumented. The new implementation of the resolver no longer supports these forms. A possible replacement is replacing the constraint with a requirement.. You can find discussion regarding this at https://github.com/pypa/pip/issues/8210.
ERROR: Links are not allowed as constraints
`pip` version is 21.0.1, can also provide `requirements.txt` if it's helpful, but I don't think it's relevant.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915357833
> `pip` version is 21.0.1, can also provide `requirements.txt` if it's helpful, but I don't think it's relevant.
You should upgrade to newer PIP version.
``pip install --upgrade pip`` will do
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] RafayAK commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
RafayAK commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915106585
@potiuk looking forward to this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] venkaa6 commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
venkaa6 commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915219952
hey team I am using airflow 1.10.10 and just faced this error on build can we apply to lower versions as well? @potiuk π
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] RafayAK commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
RafayAK commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915130883
My current workaround in my dockerfile:
```bash
# install Airflow with constraints file for compatibility
ARG AIRFLOW_VERSION=2.0.1
ARG PYTHON_VER=3.7
ARG CONSTRAINT_URL="https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VER}.txt"
RUN pip3 install --upgrade pip && \
pip install -U pip setuptools==58.0.1 wheel \
&& pip install "apache-airflow[statsd]==${AIRFLOW_VERSION}" --constraint "${CONSTRAINT_URL}" \
&& pip install pyOpenSSL \
&& pip install ffmpeg-python
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915073288
For now - workaround is to use setuptools < 58.0.2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915154838
2.0.1 is not yet fixed (Only 2.1.3). I can fix it in 2.0.1 for your tests now
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915293446
BTW. I am also discussing with other people affected and we tapped into our network to possibly fix the problem by releasing updated Flask-OpenID, In which case we will be able to fix it "permanently" and not as workaround.
π€
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915154838
2.0.1 is not yet fixed (Only 2.1.3). I can fi it in 2.0.1 for your tests now
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-914780147
Thanks for opening your first issue here! Be sure to follow the issue template!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915158673
try now @RafayAK - it should be ok for 2.0.1 as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk closed issue #18075:
URL: https://github.com/apache/airflow/issues/18075
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915233571
Yep. With 1.10 you are pretty much on your own. 1.10 reached end-of-life and we are not going to make any workaronds or even critical security fixes there. As @uranusjr wrote - you have to workaround it yourself with the patch, or (might be simpler) run `pip install setuptools== 58.0.1` before installing Airflow 1.10.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915616655
This has been fixed now. Thanks to @mitsuhiko I became maintainer of the Flask-OpenID and I released new 1.3.0 version, Python3 - only with removed 2to3 configuration. It should nicely install now with the new setuptools !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] uranusjr commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
uranusjr commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-914789476
Looks like this should be submitted to https://github.com/mitsuhiko/flask-openid/issues/59 instead.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915143441
All right - 2.1.3 should now work when you install it with constraints with latest setuptools:
``pip install "apache-airflow==2.1.3" --constraint https://raw.githubusercontent.com/apache/airflow/constraints-2.1.3/constraints-3.6.txt``
Can someone confirm it ? then I will apply the same fix to other released versions and carry on with fixing it for main as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915617004
https://pypi.org/project/Flask-OpenID/1.3.0/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915072965
Unfortunately this is one of the things that is not possible to handle in Airflow in already released versions, as the right version of setuptools need to be installed before airflow installation and related packages are attempted to be installed.
However if @mitsuhiko fixes it and release flask-openid without 2_to_3, we will be able to re-pin our constraints to use that new version of flask-openid in our constraints for all released versions of Airflow.
So we really depend on this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] graingert commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
graingert commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915850377
> This has been fixed now. Thanks to @mitsuhiko I became maintainer of the Flask-OpenID and I released new 1.3.0 version, Python3 - only with removed 2to3 configuration. It should nicely install now with the new setuptools !
thanks, can confirm:
```
pip install flask-openid
Collecting flask-openid
Downloading Flask_OpenID-1.3.0-py3-none-any.whl (9.3 kB)
Collecting python3-openid>=2.0
Downloading python3_openid-3.2.0-py3-none-any.whl (133 kB)
|ββββββββββββββββββββββββββββββββ| 133 kB 1.1 MB/s
Collecting Flask>=0.10.1
Using cached Flask-2.0.1-py3-none-any.whl (94 kB)
```
and there's a wheel so no setuptools needed!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] agrounds commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
agrounds commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915318171
@potiuk Airflow installation via `pip` is now failing for us. We're running this:
```
pip install -r requirements.txt --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-${AIRFLOW_VERSION}/constraints-${PYTHON_VERSION}.txt"
```
with `AIRFLOW_VERSION=2.1.3` and `PYTHON_VERSION=3.8`, and we're getting this error:
```
DEPRECATION: Constraints are only allowed to take the form of a package name and a version specifier. Other forms were originally permitted as an accident of the implementation, but were undocumented. The new implementation of the resolver no longer supports these forms. A possible replacement is replacing the constraint with a requirement.. You can find discussion regarding this at https://github.com/pypa/pip/issues/8210.
ERROR: Links are not allowed as constraints
```
`pip` version is 21.0.1, can also provide `requirements.txt` if it's helpful, but I don't think it's relevant.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915134306
Yep. For Dockerfile it's easy. But we have a better workaround. Just tested and it works. the problem is that it also broke all Airflow 2 installations which people already use and any attempt to install those, will fail. We have a fix that will make the "official installation method" works for all Airflow 2 releases.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] RafayAK commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
RafayAK commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915144613
> All right - 2.1.3 should now work when you install it with constraints with latest setuptools:
>
> `pip install "apache-airflow==2.1.3" --constraint https://raw.githubusercontent.com/apache/airflow/constraints-2.1.3/constraints-3.6.txt`
>
> Can someone confirm it ? then I will apply the same fix to other released versions and carry on with fixing it for main as well
let me try this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915081457
We've figured a possible automated workaround with @uranusjr . Stay tuned.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk edited a comment on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915233571
Yep. With 1.10 you are pretty much on your own. 1.10 reached end-of-life and we are not going to make any workaronds or even critical security fixes there. As @uranusjr wrote - you have to workaround it yourself with the patch, or (might be simpler) run `pip install setuptools==58.0.1` before installing Airflow 1.10.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915171304
No problem with that warning - it's just yanked because of wrong setup information, but that's not an issue.
Thanks for verification!
I proceed with applying the fix then :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915072965
Unfortunately this is one of the things that is nnot possible to handle in Airflow in already released versions, as the right version of setuptools need to be installed before airflow installation and related packages are attempted to be installed.
However if @mitsuhiko fixes it and release flask-openid without 2_to_3, we will be able to re-pin our constraints to use that new version of flask-openid in our constraints for all released versions of Airflow.
So we really depend on this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] RafayAK commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
RafayAK commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915169766
@potiuk Got it built thanks!
I do get this warning though:
```
Collecting certifi>=2017.4.17
Downloading certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
WARNING: The candidate selected for download or install is a yanked version: 'sqlalchemy-utils' candidate (version 0.36.8 at https://files.pythonhosted.org/packages/14/68/e5301c4c960c79a32333b8805e52cb69d3d237aa869a773b4157ccb3eb26/SQLAlchemy-Utils-0.36.8.tar.gz#sha256=fb66e9956e41340011b70b80f898fde6064ec1817af77199ee21ace71d7d6ab0 (from https://pypi.org/simple/sqlalchemy-utils/))
Reason for being yanked: Wrong required python
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] venkaa6 commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
venkaa6 commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915237821
ah cool. yes thanks @uranusjr that worked!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915874099
Yeah. I also released wheel on request of @uranusjr and @kaxil :).
Glad we could solve it that quickly.
I am going to delete https://github.com/apache/airflow-flask-openid-fork today.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #18075: Airflow installation fails when with latest `setuptools`
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #18075:
URL: https://github.com/apache/airflow/issues/18075#issuecomment-915159594
(I need to manually apply the fix for all versions, so I want to confirm it works :) )
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org