You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "Jamie (Jira)" <ji...@apache.org> on 2020/03/09 15:41:00 UTC
[jira] [Commented] (AIRFLOW-6468) fix install on python 3.7
[ https://issues.apache.org/jira/browse/AIRFLOW-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17055100#comment-17055100 ]
Jamie commented on AIRFLOW-6468:
--------------------------------
I can confirm I'm hitting this same issue. I'm installing the following packages:
{code:java}
'apache-airflow[crypto,postgres,hive,ssh,gcp]' = "==1.10.9"
google-api-core = "*"
google-api-python-client = "*"
google-auth = "*"
google-auth-httplib2 = "*"
google-cloud-core = "*"
google-cloud-storage = "*"
google-resumable-media = "*"
googleapis-common-protos = "*"
mysqlclient = "==1.4.4"
ndg-httpsclient = "==0.5.1"
oauth2client = "==4.1.3"
paramiko = "==2.6.0"
psycopg2-binary = "==2.8.4"
pyOpenSSL = "==19.0.0"
pytz = "==2019.3"
PyYAML = "==5.1.2"
redis = "==3.3.11"
requests = "==2.22.0"
sh = "==1.12.14"
sshtunnel = "==0.1.5"
{code}
on Python 3.7. I'm using `pipenv` so my error is a little different:
{quote}Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
Could not find a version that matches grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3
Tried: 0.9.0, 0.10.0, 0.10.1, 0.11.1, 0.11.3, 0.11.4, 0.12.0, 0.12.1, 0.12.2, 0.12.3
{quote}
My dependencies were installing OK until I added the "gcp" option to apache-airflow, after that I hit the issue above.
I did as suggested and ran with the `--skip-lock` option then running `pipenv graph`. The pertinent portions of the graph are displayed at the bottom of this message, you'll see `grpc-google-iam-v1` appears three times:
{noformat}
- grpc-google-iam-v1 [required: <0.12dev,>=0.11.4, installed: 0.11.4]
- grpc-google-iam-v1 [required: <0.13dev,>=0.12.3, installed: 0.11.4]
- grpc-google-iam-v1 [required: <0.12dev,>=0.11.4, installed: 0.11.4]
{noformat}
The conflict seems to be between:
* google-cloud-container which requires grpc-google-iam-v1 >=0.12.3
* google-cloud-bigtable & google-cloud-spanner which require grpc-google-iam-v1 <0.12dev
(I'm presuming that 0.12dev is considered lower than 0.12.3)
I'm not comfortable keeping the `--skip-lock` in my Dockerfile so won't be doing that.
{noformat}
google-cloud-bigtable==0.33.0
- google-api-core [required: >=1.6.0,<2.0.0dev, installed: 1.16.0]
- google-auth [required: >=0.4.0,<2.0dev, installed: 1.11.2]
- cachetools [required: <5.0,>=2.0.0, installed: 4.0.0]
- pyasn1-modules [required: >=0.2.1, installed: 0.2.8]
- pyasn1 [required: >=0.4.6,<0.5.0, installed: 0.4.8]
- rsa [required: >=3.1.4,<4.1, installed: 4.0]
- pyasn1 [required: >=0.1.3, installed: 0.4.8]
- setuptools [required: >=40.3.0, installed: 46.0.0]
- six [required: >=1.9.0, installed: 1.14.0]
- googleapis-common-protos [required: >=1.6.0,<2.0dev, installed: 1.51.0]
- protobuf [required: >=3.6.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- protobuf [required: >=3.4.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- pytz [required: Any, installed: 2019.3]
- requests [required: >=2.18.0,<3.0.0dev, installed: 2.22.0]
- certifi [required: >=2017.4.17, installed: 2019.11.28]
- chardet [required: <3.1.0,>=3.0.2, installed: 3.0.4]
- idna [required: <2.9,>=2.5, installed: 2.8]
- urllib3 [required: !=1.25.1,>=1.21.1,<1.26,!=1.25.0, installed: 1.25.8]
- setuptools [required: >=34.0.0, installed: 46.0.0]
- six [required: >=1.10.0, installed: 1.14.0]
- google-cloud-core [required: >=1.0.0,<2.0dev, installed: 1.3.0]
- google-api-core [required: <2.0.0dev,>=1.16.0, installed: 1.16.0]
- google-auth [required: >=0.4.0,<2.0dev, installed: 1.11.2]
- cachetools [required: <5.0,>=2.0.0, installed: 4.0.0]
- pyasn1-modules [required: >=0.2.1, installed: 0.2.8]
- pyasn1 [required: >=0.4.6,<0.5.0, installed: 0.4.8]
- rsa [required: >=3.1.4,<4.1, installed: 4.0]
- pyasn1 [required: >=0.1.3, installed: 0.4.8]
- setuptools [required: >=40.3.0, installed: 46.0.0]
- six [required: >=1.9.0, installed: 1.14.0]
- googleapis-common-protos [required: >=1.6.0,<2.0dev, installed: 1.51.0]
- protobuf [required: >=3.6.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- protobuf [required: >=3.4.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- pytz [required: Any, installed: 2019.3]
- requests [required: >=2.18.0,<3.0.0dev, installed: 2.22.0]
- certifi [required: >=2017.4.17, installed: 2019.11.28]
- chardet [required: <3.1.0,>=3.0.2, installed: 3.0.4]
- idna [required: <2.9,>=2.5, installed: 2.8]
- urllib3 [required: !=1.25.1,>=1.21.1,<1.26,!=1.25.0, installed: 1.25.8]
- setuptools [required: >=34.0.0, installed: 46.0.0]
- six [required: >=1.10.0, installed: 1.14.0]
- grpc-google-iam-v1 [required: >=0.11.4,<0.12dev, installed: 0.11.4]
google-cloud-container==0.4.0
- google-api-core [required: >=1.14.0,<2.0.0dev, installed: 1.16.0]
- google-auth [required: >=0.4.0,<2.0dev, installed: 1.11.2]
- cachetools [required: <5.0,>=2.0.0, installed: 4.0.0]
- pyasn1-modules [required: >=0.2.1, installed: 0.2.8]
- pyasn1 [required: >=0.4.6,<0.5.0, installed: 0.4.8]
- rsa [required: >=3.1.4,<4.1, installed: 4.0]
- pyasn1 [required: >=0.1.3, installed: 0.4.8]
- setuptools [required: >=40.3.0, installed: 46.0.0]
- six [required: >=1.9.0, installed: 1.14.0]
- googleapis-common-protos [required: >=1.6.0,<2.0dev, installed: 1.51.0]
- protobuf [required: >=3.6.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- protobuf [required: >=3.4.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- pytz [required: Any, installed: 2019.3]
- requests [required: >=2.18.0,<3.0.0dev, installed: 2.22.0]
- certifi [required: >=2017.4.17, installed: 2019.11.28]
- chardet [required: <3.1.0,>=3.0.2, installed: 3.0.4]
- idna [required: <2.9,>=2.5, installed: 2.8]
- urllib3 [required: !=1.25.1,>=1.21.1,<1.26,!=1.25.0, installed: 1.25.8]
- setuptools [required: >=34.0.0, installed: 46.0.0]
- six [required: >=1.10.0, installed: 1.14.0]
- grpc-google-iam-v1 [required: >=0.12.3,<0.13dev, installed: 0.11.4]
google-cloud-spanner==1.9.0
- google-api-core [required: >=1.4.1,<2.0.0dev, installed: 1.16.0]
- google-auth [required: >=0.4.0,<2.0dev, installed: 1.11.2]
- cachetools [required: <5.0,>=2.0.0, installed: 4.0.0]
- pyasn1-modules [required: >=0.2.1, installed: 0.2.8]
- pyasn1 [required: >=0.4.6,<0.5.0, installed: 0.4.8]
- rsa [required: >=3.1.4,<4.1, installed: 4.0]
- pyasn1 [required: >=0.1.3, installed: 0.4.8]
- setuptools [required: >=40.3.0, installed: 46.0.0]
- six [required: >=1.9.0, installed: 1.14.0]
- googleapis-common-protos [required: >=1.6.0,<2.0dev, installed: 1.51.0]
- protobuf [required: >=3.6.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- protobuf [required: >=3.4.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- pytz [required: Any, installed: 2019.3]
- requests [required: >=2.18.0,<3.0.0dev, installed: 2.22.0]
- certifi [required: >=2017.4.17, installed: 2019.11.28]
- chardet [required: <3.1.0,>=3.0.2, installed: 3.0.4]
- idna [required: <2.9,>=2.5, installed: 2.8]
- urllib3 [required: !=1.25.1,>=1.21.1,<1.26,!=1.25.0, installed: 1.25.8]
- setuptools [required: >=34.0.0, installed: 46.0.0]
- six [required: >=1.10.0, installed: 1.14.0]
- google-cloud-core [required: >=1.0.0,<2.0dev, installed: 1.3.0]
- google-api-core [required: <2.0.0dev,>=1.16.0, installed: 1.16.0]
- google-auth [required: >=0.4.0,<2.0dev, installed: 1.11.2]
- cachetools [required: <5.0,>=2.0.0, installed: 4.0.0]
- pyasn1-modules [required: >=0.2.1, installed: 0.2.8]
- pyasn1 [required: >=0.4.6,<0.5.0, installed: 0.4.8]
- rsa [required: >=3.1.4,<4.1, installed: 4.0]
- pyasn1 [required: >=0.1.3, installed: 0.4.8]
- setuptools [required: >=40.3.0, installed: 46.0.0]
- six [required: >=1.9.0, installed: 1.14.0]
- googleapis-common-protos [required: >=1.6.0,<2.0dev, installed: 1.51.0]
- protobuf [required: >=3.6.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- protobuf [required: >=3.4.0, installed: 3.11.3]
- setuptools [required: Any, installed: 46.0.0]
- six [required: >=1.9, installed: 1.14.0]
- pytz [required: Any, installed: 2019.3]
- requests [required: >=2.18.0,<3.0.0dev, installed: 2.22.0]
- certifi [required: >=2017.4.17, installed: 2019.11.28]
- chardet [required: <3.1.0,>=3.0.2, installed: 3.0.4]
- idna [required: <2.9,>=2.5, installed: 2.8]
- urllib3 [required: !=1.25.1,>=1.21.1,<1.26,!=1.25.0, installed: 1.25.8]
- setuptools [required: >=34.0.0, installed: 46.0.0]
- six [required: >=1.10.0, installed: 1.14.0]
- grpc-google-iam-v1 [required: >=0.11.4,<0.12dev, installed: 0.11.4]
{noformat}
> fix install on python 3.7
> -------------------------
>
> Key: AIRFLOW-6468
> URL: https://issues.apache.org/jira/browse/AIRFLOW-6468
> Project: Apache Airflow
> Issue Type: New Feature
> Components: core
> Affects Versions: 1.10.7
> Reporter: t oo
> Priority: Major
>
> Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
> Collecting grpc-google-iam-v1<0.12dev,>=0.11.4
> Collecting google-cloud-container>=0.1.1; extra == "gcp".
> ERROR: google-cloud-container 0.3.0 has requirement grpc-google-iam-v1<0.13dev,>=0.12.3, but you'll have grpc-google-iam-v1 0.11.4 which is incompatible. ERROR: google-cloud-spanner 1.9.0 has requirement grpc-google-iam-v1<0.12dev,>=0.11.4, but you'll have grpc-google-iam-v1 0.12.3 which is incompatible.
> ERROR: google-cloud-bigtable 0.33.0 has requirement grpc-google-iam-v1<0.12dev,>=0.11.4, but you'll have grpc-google-iam-v1 0.12.3 which is incompatible.
> anyone facing that error with
> pip install apache-airflow[postgres,gcp]. maybe due to using py3.7
--
This message was sent by Atlassian Jira
(v8.3.4#803005)