[jira] [Commented] (AIRFLOW-5167) Dependancy conflict with grpc-google-iam-v1

["Eric G (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968795#comment-16968795 ] 

Eric G commented on AIRFLOW-5167:
---------------------------------

+1 I have this issue as well

> Dependancy conflict with grpc-google-iam-v1
> -------------------------------------------
>
>                 Key: AIRFLOW-5167
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5167
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: gcp
>    Affects Versions: 1.10.4
>            Reporter: Sujay Mansingh
>            Priority: Trivial
>
> If we use a tool that does script requirements checking (e.g. {{pip-compile}}) then an erroe is thrown when handling the dependencies for {{apache-airflow[gcp_api]}}
> {code:java}
> $ pip-compile --version
> pip-compile, version 3.7.0
> $ cat requirements.in
> apache-airflow[gcp_api]
> $ pip-compile -o requirements.txt requirements.in
> Could not find a version that matches grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3
> Tried: 0.9.0, 0.10.0, 0.10.1, 0.11.1, 0.11.3, 0.11.4, 0.12.0, 0.12.1, 0.12.2, 0.12.3
> There are incompatible versions in the resolved dependencies.
> {code}
> Looks like a set of inconsistent dependencies in the google libs :/
> {code:java}
> $ pip-compile -v -o requirements.txt requirements.in | grep -i grpc-google-iam
>   google-cloud-container==0.3.0 requires google-api-core[grpc]<2.0.0dev,>=1.14.0, grpc-google-iam-v1<0.13dev,>=0.12.3
>   google-cloud-bigtable==0.33.0 requires google-api-core[grpc]<2.0.0dev,>=1.6.0, google-cloud-core<2.0dev,>=1.0.0, grpc-google-iam-v1<0.12dev,>=0.11.4
>   google-cloud-spanner==1.9.0 requires google-api-core[grpc,grpcgcp]<2.0.0dev,>=1.4.1, google-cloud-core<2.0dev,>=1.0.0, grpc-google-iam-v1<0.12dev,>=0.11.4
>   adding ['grpc-google-iam-v1', '<0.12dev,<0.13dev,>=0.11.4,>=0.12.3', '[]']
>   grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3
> Could not find a version that matches grpc-google-iam-v1<0.12dev,<0.13dev,>=0.11.4,>=0.12.3
> Tried: 0.9.0, 0.10.0, 0.10.1, 0.11.1, 0.11.3, 0.11.4, 0.12.0, 0.12.1, 0.12.2, 0.12.3
> There are incompatible versions in the resolved dependencies.
> {code}
> So it looks like {{google-cloud-bigtable==0.33.0}} and {{google-cloud-spanner==1.9.0}} require a version that is {{>=0.11.4}} and {{<0.12dev}}
> {{google-cloud-container==0.3.0}} upsets everything though by specifying version {{>=0.12.3}} and {{<0.13dev}}
> For now, we can work around issue by not checking any conflicts when installing {{apache_airflow[gcp]}}.
> That isn't ideal
>  - All it means is that the version of {{grpc-google-iam-v1}} that is specified last will be installed
>  - I'm assuming that there are no major api changes in {{grpc-google-iam}} between {{<0.12dev}} and {{<0.13dev}}. If there are then I imagine tests would fail, but it still feels a little wrong to allow use of a lib that doesn't match the version required
>  - Relaxing the check just means that we could have a conflict elsewhere that isn't reported
> I understand this is not an issue with airflow, but more to do with the google python libraries.
>  However it does affect us when we try to use airflow and be strict with python requirements.
> Any ideas on what to do?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)