You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/05/12 05:22:06 UTC

[GitHub] [airflow] msk-psp opened a new issue #15790: Failed to build Docker image using Dockerfile in master branch 

msk-psp opened a new issue #15790:
URL: https://github.com/apache/airflow/issues/15790


   I Can't build a docker image using Dockerfile in master branch 
   
   
   The python package dependency error occurred while building a image
   
   <img width="1871" alt="스크린샷 2021-05-12 오후 2 16 16" src="https://user-images.githubusercontent.com/23733661/117922125-f416cd00-b32c-11eb-84e2-40bfec7c16f0.png">
   
   The conflict is caused by:
       connexion[flask,swagger-ui] 2.6.0 depends on connexion 2.6.0 (from https://files.pythonhosted.org/packages/a7/27/d8258c073989776014d49bbc8049a9b0842aaf776f462158d8a885f8c6a2/connexion-2.6.0-py2.py3-none-any.whl#sha256=c568e579f84be808e387dcb8570bb00a536891be1318718a0dad3ba90f034191 (from https://pypi.org/simple/connexion/) (requires-python:>=3.6))
       The user requested (constraint) connexion==2.7.0
   
   
   I think there a version mismatching between connexion[flask, swagger-ui] and connexion.. 
   
   ![스크린샷 2021-05-12 오후 2 19 43](https://user-images.githubusercontent.com/23733661/117922342-4526c100-b32d-11eb-9d47-4257bca1efb0.png)
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839450349


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] msk-psp removed a comment on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
msk-psp removed a comment on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839571179


   > I can reproduce it but it is really strange. I will have to take a closer look at it. Seems that all is legit and "airflow 2.0.2" installs properly with the 2.0.2 constraints but for some reason it falls back to connexion 2.6.0 in our image where it should (and it's been like that for quite a while) use 2.0.7.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839768807


   Aaaargh ... I thought we will be good with pyarrow.  Ithe problem is I think only with Py21 then and it i gone for master/upcoming 2.1 i will check if specifying PIP version helps 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] uranusjr commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
uranusjr commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839711402


   Pip’s conflict reporting doesn’t work very well when the conflict involves extras, unfortunately. When you see a conflict with extras, it’s usually not the package itself that’s causing the conflict 😞 I do have plan to improve it if I have the time. I’ll try to dig deeper what exactly is the cause.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] uranusjr commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
uranusjr commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839744901


   I think I’ve got it.
   
   ```
   distribution                              dependency
   ====================================================================================================
   (root)                                    apache[...]
   apache[google]==2.0.2                     pandas-gbq<0.15.0
   pandas-gbq==0.14.1                        google-cloud-bigquery[bqstorage,pandas]<3.0.0dev,>=1.11.1
   google-cloud-bigquery[bqstorage]==1.28.0  google-cloud-bigquery-storage<2.0.0dev,>=1.0.0
                                             pyarrow<2.0dev,>=1.0.0
   ```
   
   But the constraints have
   
   ```
   google-cloud-bigquery-storage==2.4.0
   pyarrow==2.0.0
   ```
   
   Completely unrelated to `connextion` 😓


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk edited a comment on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839838214


   OK. I fixed in the upcoming #15802 - I added automated fallback to PIP 20.2.4 when pre-2.1 version of Airflow is built using the newer image (both 1.10* and 2.0.*). Once this is merged you will not have to specify the AIRFLOW_PIP_VERSION @msk-psp 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] uranusjr edited a comment on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
uranusjr edited a comment on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839744901


   I think I’ve got it.
   
   ```
   distribution                              dependency
   ====================================================================================================
   (root)                                    apache[...]==2.0.2
   apache[google]==2.0.2                     pandas-gbq<0.15.0
   pandas-gbq==0.14.1                        google-cloud-bigquery[bqstorage,pandas]<3.0.0dev,>=1.11.1
   google-cloud-bigquery[bqstorage]==1.28.0  google-cloud-bigquery-storage<2.0.0dev,>=1.0.0
                                             pyarrow<2.0dev,>=1.0.0
   ```
   
   But the constraints have
   
   ```
   google-cloud-bigquery-storage==2.4.0
   pyarrow==2.0.0
   ```
   
   Completely unrelated to `connextion` 😓


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] msk-psp edited a comment on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
msk-psp edited a comment on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839851004


   @potiuk thank you for your fast responding and quick fixing
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839838967


   And thanks @uranusjr for help !


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839579379


   @uranusjr - maybe you can have some ideas before I dig deeper ?
   
   It's easy reproducible with `docker build --build-arg AIRFLOW_VERSION="2.0.2" -t airflow-with-browser .` . Seems that the right (2.0.2) constraints are used, and they contain connexion 2.7.0 but for some reason in the middle of installation PIP downloads and starts looking for matching versions of packages for `connexion 2.6.0`  - really, really strange.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] msk-psp commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
msk-psp commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839571179


   > I can reproduce it but it is really strange. I will have to take a closer look at it. Seems that all is legit and "airflow 2.0.2" installs properly with the 2.0.2 constraints but for some reason it falls back to connexion 2.6.0 in our image where it should (and it's been like that for quite a while) use 2.0.7.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] msk-psp commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
msk-psp commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839851004


   @potiuk thank you for your fast responding ^^*


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839484139


   I think master constraints are not refreshed recently. Let me do that now.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839774840


   Confirmed. It works when you switch to PIP 20.2.4
   
   ```
   docker build --build-arg AIRFLOW_VERSION="2.0.2" --build-arg AIRFLOW_PIP_VERSION=20.2.4 -t airflow-with-browser .
   ``` 
   
   I will update the documentation to make it clear that you need to add the build arg when build pre-2.1 images.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839580647


   And constraints SHOULD contain all package with fixed versions (including provider packages). The only reason that comes to my mind - if some package version was removed from PyPI, then PIP could start looking for another version and this could cause a "chain reaction"? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839560605


   I can reproduce it but it is really strange. I will have to take a closer look at it. Seems that all is legit and "airflow 2.0.2" installs properly with the 2.0.2 constraints but for some reason it falls back to connexion 2.6.0 in our image where it should (and it's been like that for quite a while) use 2.0.7. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839838214


   OK. I fixed in the upcoming #15802 - I added automated fallback to PIP 20.2.4 when pre-2.1 version of Airflow is built using the newer image (both 1.10* and 2.0.*). Once this is merged you will not have to specify the PIP_VERSION @msk-psp 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk closed issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk closed issue #15790:
URL: https://github.com/apache/airflow/issues/15790


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] uranusjr edited a comment on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
uranusjr edited a comment on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839744901


   I think I’ve got it.
   
   ```
   distribution                              dependency
   ====================================================================================================
   (root)                                    apache[...]==2.0.2
   apache[google]==2.0.2                     pandas-gbq<0.15.0
   pandas-gbq==0.14.1                        google-cloud-bigquery[bqstorage,pandas]<3.0.0dev,>=1.11.1
   google-cloud-bigquery[bqstorage]==1.28.0  google-cloud-bigquery-storage<2.0.0dev,>=1.0.0
                                             pyarrow<2.0dev,>=1.0.0
   ```
   
   But the constraints have
   
   ```
   google-cloud-bigquery-storage==2.4.0
   pyarrow==2.0.0
   ```
   
   Completely unrelated to `connexion` 😓


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk edited a comment on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk edited a comment on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839838594


   Thanks for reporting it @msk-psp !


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839838594


   Thanks for reporting in @msk-psp !


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] msk-psp closed issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
msk-psp closed issue #15790:
URL: https://github.com/apache/airflow/issues/15790


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] msk-psp edited a comment on issue #15790: Failed to build Docker image using Dockerfile in master branch

Posted by GitBox <gi...@apache.org>.
msk-psp edited a comment on issue #15790:
URL: https://github.com/apache/airflow/issues/15790#issuecomment-839851004


   @potiuk thank you for your fast responding and quick fixing ^^*
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org