[jira] [Commented] (AIRFLOW-5093) The apache/airflow image has been removed from DockerHub

["Jarek Potiuk (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16898596#comment-16898596 ] 

Jarek Potiuk commented on AIRFLOW-5093:
---------------------------------------

This is result of implementing AIP-10 ([https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-10+Multi-layered+and+multi-stage+official+Airflow+CI+image|https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-10+Multi-layered+and+multi-stage+official+Airflow+CI+image#AIP-10Multi-layeredandmulti-stageofficialAirflowCIimage-ProposedsetupoftheDockerHubandTravisCI]) . It's been discussed at length in the apache airflow devlist ([https://lists.apache.org/thread.html/7af1a4faa4baa119a124cec0920c2d6e4b7b6c91d7fa5b7ce0d1c1d6@%3Cdev.airflow.apache.org%3E)] and over half a year in the making. In the discussion we decided to get rid of the old images and many tags (spefically "latest" tag which is often misleading - that's why your pull does not work - you have to specify the exact tag that you are interested in).

You can see the implemented list of tags in this chapter: [https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-10+Multi-layered+and+multi-stage+official+Airflow+CI+image#AIP-10Multi-layeredandmulti-stageofficialAirflowCIimage-ProposedsetupoftheDockerHubandTravisCI] .Note that the images are CI-specific images, there is no official "production" image yet. It will be implemented as part of 2.0.0 works. It is planned in the Roadmap.  You can use the CI images for your own purposes but they are not recommended for production use (as it is stated in the Dockerfile). For now our advice for production image is to use the puckel image that is maintained by one of the community members ([https://github.com/puckel/docker-airflow]) 

Sorry for the trouble, but the images in DockerHub were never officially supported nor endorsed in any way (until now) and we want to make sure that we can officially support whatever we publish there before we officially endorse it.

 

> The apache/airflow image has been removed from DockerHub
> --------------------------------------------------------
>
>                 Key: AIRFLOW-5093
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-5093
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: ci
>    Affects Versions: 1.10.3
>            Reporter: A
>            Priority: Major
>
> Pulling the image from the official Apache Airflow repo ([https://hub.docker.com/r/apache/airflow]) fails.
> {{docker pull apache/airflow}}
> {{Using default tag: latest}}
> {{Error response from daemon: manifest for apache/airflow:latest not found}}
> Looks like many tags and images were purged from the repo recently.
> We've also pinned an exact airflow image version in one of our workflows (
>  apache/airflow@sha256:7f60cbef6bf92b1f3a5b4e46044911ced39736a8c3858284d3c5a961b3ba8735). It now fails because the image was purged.
>  I looked at the tags and I see that the tag list is small and all tags were updated just several hours ago. The tags and releases of other projects are usually more stable.
>   
>  How can we use the images from the official Airflow Docker repo in a reliable way?



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)