You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Jarek Potiuk <Ja...@polidea.com> on 2019/07/02 06:34:46 UTC
Re: [VOTE] Labelling scheme for the upcoming official docker images
of Airflow
Just to remind - the vote is up till Thursday 7am CEST. W have so far +3
binding +5 non-binding votes so for now the status is PASS.
Thanks for all who participated :). I encourage others as well.
Anticipating positive vote I already implemented the scheme in the upcoming
final commit from AIP-10: https://github.com/apache/airflow/pull/4938 (but
still can change it before we merge - if we come to different conclusions)
J.
On Fri, Jun 28, 2019 at 4:21 AM Philippe Gagnon <ph...@gmail.com>
wrote:
> +1 (non-binding)
>
> On Thu, Jun 27, 2019 at 8:58 PM Gerardo Curiel <ge...@gerar.do> wrote:
>
> > +1 (non-binding)
> >
> > On 27 June 2019 at 2:57:47 pm, Jarek Potiuk (jarek.potiuk@polidea.com)
> > wrote:
> >
> > Hello Airflow community,
> >
> > This email call for a vote on "Labelling scheme" for the docker images we
> > are going to publish at
> > https://cloud.docker.com/u/apache/repository/docker/apache/airflow. The
> > vote will lats for at least 1 week (July 4th, 7am CEST) and at least
> > three +1 (binding) votes have been cast.
> >
> > This is my +1 (binding) vote.
> >
> > The current proposal applies to three types of images we are going to
> have:
> >
> > - *CI slim image* - an image used during CI build containing only
> > Airflow with basic dependencies. It's main use is to run
> > pylint/mypy/flake8/doc steps during the build. It also allows you to run
> > airflow standalone directly from the docker image.
> > - *CI full image* - an image used to run full suite of tests on CI (and
> > very soon easily reproducible locally). This image contains dependencies
> > needed to run all tests of Airflow including some "end-2-end" tests with
> > kerberos/hive/hadoop etc.
> > - *Production optimised image (future)* - an image that will aim to
> > replace Puckel image for production-ready use of Airflow. Proposal for
> that
> > one will be discussed soon.
> >
> > This is the current proposal:
> >
> > *Versions from master (development use only):*
> >
> > - CI slim image *: airflow:master-python3.5-ci-slim,
> > airflow:**master-python3.6-ci-slim,
> > airflow:master-ci-slim*==airflow:master-python3.6-ci-slim
> > - CI full image *: airflow:master-python3.5-ci,
> > airflow:**master-python3.6-ci,
> > airflow:master-ci*==airflow:master-python3.6-ci
> > - Production optimised images: (future): *airflow:master-python3.5,
> > airflow:**master-python3.6, airflow:master*==airflow:master-python3.6
> >
> > *Release versions:*
> >
> > - CI slim image: *airflow:1.10.4-python3.5-ci-slim,
> > **airflow:1.10.4-**python3.6-ci-slim,
> > airflow:latest-ci-slim*==airflow:1.10.4-python3.6-ci-slim
> > - CI full image: *airflow:1.10.4-python3.5-ci,
> > **airflow:1.10.4**-python3.6-ci,
> > airflow:latest-ci*==airflow:1.10.4-python3.6-ci
> > - Production optimised images (future): *airflow:1.10.4-python3.5, *
> > *airflow:1.10.4**-python3.6, airflow:latest*==airflow:1.10.4-python3.6
> >
> > J.
> >
> >
> > --
> >
> > Jarek Potiuk
> > Polidea <https://www.polidea.com/> | Principal Software Engineer
> >
> > M: +48 660 796 129 <+48660796129>
> > [image: Polidea] <https://www.polidea.com/>
> >
> > --
> > Gerardo Curiel // https://gerar.do
> >
>
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>
Re: [VOTE] Labelling scheme for the upcoming official docker images
of Airflow
Posted by Jarek Potiuk <Ja...@polidea.com>.
The vote has concluded. The status is PASS. I updated the AIP-10 document
https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-10+Multi-layered+and+multi-stage+official+Airflow+CI+image
to
reflect this.
Felix - I think keeping python is a bit better. We are using the official
"python:3.6-slim" as base image so I prefer to keep the same python prefix
:).
J
On Wed, Jul 3, 2019 at 10:46 PM Felix Uellendall <fe...@pm.me.invalid>
wrote:
> +1 (non-binding) from my side. I really like the naming. The only thing I
> can think of would be to change python to py to have a slightly shorter
> name.
>
> -feluelle
>
> -------- Original Message --------
> On Jul 2, 2019, 08:34, Jarek Potiuk wrote:
>
> > Just to remind - the vote is up till Thursday 7am CEST. W have so far +3
> > binding +5 non-binding votes so for now the status is PASS.
> >
> > Thanks for all who participated :). I encourage others as well.
> >
> > Anticipating positive vote I already implemented the scheme in the
> upcoming
> > final commit from AIP-10: https://github.com/apache/airflow/pull/4938
> (but
> > still can change it before we merge - if we come to different
> conclusions)
> >
> > J.
> >
> > On Fri, Jun 28, [2019](tel:2019) at 4:21 AM Philippe Gagnon <
> philgagnon1@gmail.com>
> > wrote:
> >
> >> +1 (non-binding)
> >>
> >> On Thu, Jun 27, [2019](tel:2019) at 8:58 PM Gerardo Curiel
> <ge...@gerar.do> wrote:
> >>
> >> > +1 (non-binding)
> >> >
> >> > On 27 June [2019](tel:2019) at 2:57:47 pm, Jarek Potiuk (
> jarek.potiuk@polidea.com)
> >> > wrote:
> >> >
> >> > Hello Airflow community,
> >> >
> >> > This email call for a vote on "Labelling scheme" for the docker
> images we
> >> > are going to publish at
> >> > https://cloud.docker.com/u/apache/repository/docker/apache/airflow.
> The
> >> > vote will lats for at least 1 week (July 4th, 7am CEST) and at least
> >> > three +1 (binding) votes have been cast.
> >> >
> >> > This is my +1 (binding) vote.
> >> >
> >> > The current proposal applies to three types of images we are going to
> >> have:
> >> >
> >> > - *CI slim image* - an image used during CI build containing only
> >> > Airflow with basic dependencies. It's main use is to run
> >> > pylint/mypy/flake8/doc steps during the build. It also allows you to
> run
> >> > airflow standalone directly from the docker image.
> >> > - *CI full image* - an image used to run full suite of tests on CI
> (and
> >> > very soon easily reproducible locally). This image contains
> dependencies
> >> > needed to run all tests of Airflow including some "end-2-end" tests
> with
> >> > kerberos/hive/hadoop etc.
> >> > - *Production optimised image (future)* - an image that will aim to
> >> > replace Puckel image for production-ready use of Airflow. Proposal for
> >> that
> >> > one will be discussed soon.
> >> >
> >> > This is the current proposal:
> >> >
> >> > *Versions from master (development use only):*
> >> >
> >> > - CI slim image *: airflow:master-python3.5-ci-slim,
> >> > airflow:**master-python3.6-ci-slim,
> >> > airflow:master-ci-slim*==airflow:master-python3.6-ci-slim
> >> > - CI full image *: airflow:master-python3.5-ci,
> >> > airflow:**master-python3.6-ci,
> >> > airflow:master-ci*==airflow:master-python3.6-ci
> >> > - Production optimised images: (future): *airflow:master-python3.5,
> >> > airflow:**master-python3.6, airflow:master*==airflow:master-python3.6
> >> >
> >> > *Release versions:*
> >> >
> >> > - CI slim image: *airflow:[1.10.4](tel:1104)-python3.5-ci-slim,
> >> > **airflow:[1.10.4](tel:1104)-**python3.6-ci-slim,
> >> > airflow:latest-ci-slim*==airflow:[1.10.4](tel:1104)-python3.6-ci-slim
> >> > - CI full image: *airflow:[1.10.4](tel:1104)-python3.5-ci,
> >> > **airflow:[1.10.4](tel:1104)**-python3.6-ci,
> >> > airflow:latest-ci*==airflow:[1.10.4](tel:1104)-python3.6-ci
> >> > - Production optimised images (future):
> *airflow:[1.10.4](tel:1104)-python3.5, *
> >> > *airflow:[1.10.4](tel:1104)**-python3.6,
> airflow:latest*==airflow:[1.10.4](tel:1104)-python3.6
> >> >
> >> > J.
> >> >
> >> >
> >> > --
> >> >
> >> > Jarek Potiuk
> >> > Polidea <https://www.polidea.com/> | Principal Software Engineer
> >> >
> >> > M: [+48 660 796 129](tel:+48660796129)
> <[+48660796129](tel:+48660796129)>
> >> > [image: Polidea] <https://www.polidea.com/>
> >> >
> >> > --
> >> > Gerardo Curiel // https://gerar.do
> >> >
> >>
> >
> > --
> >
> > Jarek Potiuk
> > Polidea <https://www.polidea.com/> | Principal Software Engineer
> >
> > M: [+48 660 796 129](tel:+48660796129) <[+48660796129](tel:+48660796129)>
> > [image: Polidea] <https://www.polidea.com/>
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>
Re: [VOTE] Labelling scheme for the upcoming official docker images of Airflow
Posted by Felix Uellendall <fe...@pm.me.INVALID>.
+1 (non-binding) from my side. I really like the naming. The only thing I can think of would be to change python to py to have a slightly shorter name.
-feluelle
-------- Original Message --------
On Jul 2, 2019, 08:34, Jarek Potiuk wrote:
> Just to remind - the vote is up till Thursday 7am CEST. W have so far +3
> binding +5 non-binding votes so for now the status is PASS.
>
> Thanks for all who participated :). I encourage others as well.
>
> Anticipating positive vote I already implemented the scheme in the upcoming
> final commit from AIP-10: https://github.com/apache/airflow/pull/4938 (but
> still can change it before we merge - if we come to different conclusions)
>
> J.
>
> On Fri, Jun 28, [2019](tel:2019) at 4:21 AM Philippe Gagnon <ph...@gmail.com>
> wrote:
>
>> +1 (non-binding)
>>
>> On Thu, Jun 27, [2019](tel:2019) at 8:58 PM Gerardo Curiel <ge...@gerar.do> wrote:
>>
>> > +1 (non-binding)
>> >
>> > On 27 June [2019](tel:2019) at 2:57:47 pm, Jarek Potiuk (jarek.potiuk@polidea.com)
>> > wrote:
>> >
>> > Hello Airflow community,
>> >
>> > This email call for a vote on "Labelling scheme" for the docker images we
>> > are going to publish at
>> > https://cloud.docker.com/u/apache/repository/docker/apache/airflow. The
>> > vote will lats for at least 1 week (July 4th, 7am CEST) and at least
>> > three +1 (binding) votes have been cast.
>> >
>> > This is my +1 (binding) vote.
>> >
>> > The current proposal applies to three types of images we are going to
>> have:
>> >
>> > - *CI slim image* - an image used during CI build containing only
>> > Airflow with basic dependencies. It's main use is to run
>> > pylint/mypy/flake8/doc steps during the build. It also allows you to run
>> > airflow standalone directly from the docker image.
>> > - *CI full image* - an image used to run full suite of tests on CI (and
>> > very soon easily reproducible locally). This image contains dependencies
>> > needed to run all tests of Airflow including some "end-2-end" tests with
>> > kerberos/hive/hadoop etc.
>> > - *Production optimised image (future)* - an image that will aim to
>> > replace Puckel image for production-ready use of Airflow. Proposal for
>> that
>> > one will be discussed soon.
>> >
>> > This is the current proposal:
>> >
>> > *Versions from master (development use only):*
>> >
>> > - CI slim image *: airflow:master-python3.5-ci-slim,
>> > airflow:**master-python3.6-ci-slim,
>> > airflow:master-ci-slim*==airflow:master-python3.6-ci-slim
>> > - CI full image *: airflow:master-python3.5-ci,
>> > airflow:**master-python3.6-ci,
>> > airflow:master-ci*==airflow:master-python3.6-ci
>> > - Production optimised images: (future): *airflow:master-python3.5,
>> > airflow:**master-python3.6, airflow:master*==airflow:master-python3.6
>> >
>> > *Release versions:*
>> >
>> > - CI slim image: *airflow:[1.10.4](tel:1104)-python3.5-ci-slim,
>> > **airflow:[1.10.4](tel:1104)-**python3.6-ci-slim,
>> > airflow:latest-ci-slim*==airflow:[1.10.4](tel:1104)-python3.6-ci-slim
>> > - CI full image: *airflow:[1.10.4](tel:1104)-python3.5-ci,
>> > **airflow:[1.10.4](tel:1104)**-python3.6-ci,
>> > airflow:latest-ci*==airflow:[1.10.4](tel:1104)-python3.6-ci
>> > - Production optimised images (future): *airflow:[1.10.4](tel:1104)-python3.5, *
>> > *airflow:[1.10.4](tel:1104)**-python3.6, airflow:latest*==airflow:[1.10.4](tel:1104)-python3.6
>> >
>> > J.
>> >
>> >
>> > --
>> >
>> > Jarek Potiuk
>> > Polidea <https://www.polidea.com/> | Principal Software Engineer
>> >
>> > M: [+48 660 796 129](tel:+48660796129) <[+48660796129](tel:+48660796129)>
>> > [image: Polidea] <https://www.polidea.com/>
>> >
>> > --
>> > Gerardo Curiel // https://gerar.do
>> >
>>
>
> --
>
> Jarek Potiuk
> Polidea <https://www.polidea.com/> | Principal Software Engineer
>
> M: [+48 660 796 129](tel:+48660796129) <[+48660796129](tel:+48660796129)>
> [image: Polidea] <https://www.polidea.com/>