You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Kaxil Naik <ka...@gmail.com> on 2020/03/16 11:16:09 UTC
[VOTE] AIP-33 Secrets Backend
Hey all,
This email calls for a vote on the scope described in
https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend and
the PR: https://github.com/apache/airflow/pull/6376
*Note*: The PR is already merged but if this vote does not pass we will
revert it.
Documentation on the pluggable secrets backend:
https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
*Details*
- This PR is backwards-compatible
- Provides a pluggable mechanism where a developer can use their own
backend
- When looking up a connection, by default airflow will search the
Secrets Backend, followed by environment variables first and Metadata DB.
- Support for AWS SSM as Secret backend
Regards,
Kaxil
[VOTE] AIP-33 Secrets Backend
Posted by Kaxil Naik <ka...@gmail.com>.
This vote has passed with 12 +6 votes and 0 -1 votes and all PRs merged.
Regards,
Kaxil Naik
On Mon, Mar 16, 2020 at 12:58 PM Tomasz Urbaszek <tu...@apache.org>
wrote:
> +1 binding
>
> On Mon, Mar 16, 2020 at 1:16 PM Driesprong, Fokko <fo...@driesprong.frl>
> wrote:
>
> > +1
> >
> > Op ma 16 mrt. 2020 om 12:53 schreef Bas Harenslak
> > <ba...@godatadriven.com.invalid>:
> >
> > > +1
> > >
> > > > On 16 Mar 2020, at 12:27, Ash Berlin-Taylor <as...@apache.org> wrote:
> > > >
> > > > +1 binding
> > > >
> > > > On Mar 16 2020, at 11:20 am, Kaxil Naik <ka...@gmail.com> wrote:
> > > >
> > > >> +1 (binding)
> > > >>
> > > >> On Mon, Mar 16, 2020 at 11:19 AM Jarek Potiuk <
> > Jarek.Potiuk@polidea.com
> > > >
> > > >> wrote:
> > > >>
> > > >>> Clarify: +1 (binding)
> > > >>>
> > > >>> On Mon, Mar 16, 2020 at 12:19 PM Jarek Potiuk <
> > > Jarek.Potiuk@polidea.com>
> > > >>> wrote:
> > > >>>
> > > >>>> +1
> > > >>>>
> > > >>>> On Mon, Mar 16, 2020 at 12:16 PM Kaxil Naik <ka...@gmail.com>
> > > wrote:
> > > >>>>
> > > >>>>> Hey all,
> > > >>>>>
> > > >>>>> This email calls for a vote on the scope described in
> > > >>>>>
> > > >>>
> > >
> >
> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend
> > > >>>>> and
> > > >>>>> the PR: https://github.com/apache/airflow/pull/6376
> > > >>>>>
> > > >>>>> *Note*: The PR is already merged but if this vote does not pass
> we
> > > will
> > > >>>>> revert it.
> > > >>>>>
> > > >>>>> Documentation on the pluggable secrets backend:
> > > >>>>>
> > > >>>>>
> > > >>>
> > >
> >
> https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
> > > >>>>>
> > > >>>>> *Details*
> > > >>>>>
> > > >>>>> - This PR is backwards-compatible
> > > >>>>> - Provides a pluggable mechanism where a developer can use
> > > >>> their own
> > > >>>>> backend
> > > >>>>> - When looking up a connection, by default airflow will search
> > the
> > > >>>>> Secrets Backend, followed by environment variables first and
> > > Metadata
> > > >>>>> DB.
> > > >>>>> - Support for AWS SSM as Secret backend
> > > >>>>>
> > > >>>>>
> > > >>>>> Regards,
> > > >>>>> Kaxil
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>> --
> > > >>>>
> > > >>>> Jarek Potiuk
> > > >>>> Polidea <https://www.polidea.com/> | Principal Software Engineer
> > > >>>>
> > > >>>> M: +48 660 796 129 <+48660796129>
> > > >>>> [image: Polidea] <https://www.polidea.com/>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>> --
> > > >>>
> > > >>> Jarek Potiuk
> > > >>> Polidea <https://www.polidea.com/> | Principal Software Engineer
> > > >>>
> > > >>> M: +48 660 796 129 <+48660796129>
> > > >>> [image: Polidea] <https://www.polidea.com/>
> > > >>>
> > > >>
> > >
> > >
> >
>
Re: [VOTE] AIP-33 Secrets Backend
Posted by Tomasz Urbaszek <tu...@apache.org>.
+1 binding
On Mon, Mar 16, 2020 at 1:16 PM Driesprong, Fokko <fo...@driesprong.frl>
wrote:
> +1
>
> Op ma 16 mrt. 2020 om 12:53 schreef Bas Harenslak
> <ba...@godatadriven.com.invalid>:
>
> > +1
> >
> > > On 16 Mar 2020, at 12:27, Ash Berlin-Taylor <as...@apache.org> wrote:
> > >
> > > +1 binding
> > >
> > > On Mar 16 2020, at 11:20 am, Kaxil Naik <ka...@gmail.com> wrote:
> > >
> > >> +1 (binding)
> > >>
> > >> On Mon, Mar 16, 2020 at 11:19 AM Jarek Potiuk <
> Jarek.Potiuk@polidea.com
> > >
> > >> wrote:
> > >>
> > >>> Clarify: +1 (binding)
> > >>>
> > >>> On Mon, Mar 16, 2020 at 12:19 PM Jarek Potiuk <
> > Jarek.Potiuk@polidea.com>
> > >>> wrote:
> > >>>
> > >>>> +1
> > >>>>
> > >>>> On Mon, Mar 16, 2020 at 12:16 PM Kaxil Naik <ka...@gmail.com>
> > wrote:
> > >>>>
> > >>>>> Hey all,
> > >>>>>
> > >>>>> This email calls for a vote on the scope described in
> > >>>>>
> > >>>
> >
> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend
> > >>>>> and
> > >>>>> the PR: https://github.com/apache/airflow/pull/6376
> > >>>>>
> > >>>>> *Note*: The PR is already merged but if this vote does not pass we
> > will
> > >>>>> revert it.
> > >>>>>
> > >>>>> Documentation on the pluggable secrets backend:
> > >>>>>
> > >>>>>
> > >>>
> >
> https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
> > >>>>>
> > >>>>> *Details*
> > >>>>>
> > >>>>> - This PR is backwards-compatible
> > >>>>> - Provides a pluggable mechanism where a developer can use
> > >>> their own
> > >>>>> backend
> > >>>>> - When looking up a connection, by default airflow will search
> the
> > >>>>> Secrets Backend, followed by environment variables first and
> > Metadata
> > >>>>> DB.
> > >>>>> - Support for AWS SSM as Secret backend
> > >>>>>
> > >>>>>
> > >>>>> Regards,
> > >>>>> Kaxil
> > >>>>>
> > >>>>
> > >>>>
> > >>>> --
> > >>>>
> > >>>> Jarek Potiuk
> > >>>> Polidea <https://www.polidea.com/> | Principal Software Engineer
> > >>>>
> > >>>> M: +48 660 796 129 <+48660796129>
> > >>>> [image: Polidea] <https://www.polidea.com/>
> > >>>>
> > >>>>
> > >>>
> > >>> --
> > >>>
> > >>> Jarek Potiuk
> > >>> Polidea <https://www.polidea.com/> | Principal Software Engineer
> > >>>
> > >>> M: +48 660 796 129 <+48660796129>
> > >>> [image: Polidea] <https://www.polidea.com/>
> > >>>
> > >>
> >
> >
>
Re: [VOTE] AIP-33 Secrets Backend
Posted by "Driesprong, Fokko" <fo...@driesprong.frl>.
+1
Op ma 16 mrt. 2020 om 12:53 schreef Bas Harenslak
<ba...@godatadriven.com.invalid>:
> +1
>
> > On 16 Mar 2020, at 12:27, Ash Berlin-Taylor <as...@apache.org> wrote:
> >
> > +1 binding
> >
> > On Mar 16 2020, at 11:20 am, Kaxil Naik <ka...@gmail.com> wrote:
> >
> >> +1 (binding)
> >>
> >> On Mon, Mar 16, 2020 at 11:19 AM Jarek Potiuk <Jarek.Potiuk@polidea.com
> >
> >> wrote:
> >>
> >>> Clarify: +1 (binding)
> >>>
> >>> On Mon, Mar 16, 2020 at 12:19 PM Jarek Potiuk <
> Jarek.Potiuk@polidea.com>
> >>> wrote:
> >>>
> >>>> +1
> >>>>
> >>>> On Mon, Mar 16, 2020 at 12:16 PM Kaxil Naik <ka...@gmail.com>
> wrote:
> >>>>
> >>>>> Hey all,
> >>>>>
> >>>>> This email calls for a vote on the scope described in
> >>>>>
> >>>
> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend
> >>>>> and
> >>>>> the PR: https://github.com/apache/airflow/pull/6376
> >>>>>
> >>>>> *Note*: The PR is already merged but if this vote does not pass we
> will
> >>>>> revert it.
> >>>>>
> >>>>> Documentation on the pluggable secrets backend:
> >>>>>
> >>>>>
> >>>
> https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
> >>>>>
> >>>>> *Details*
> >>>>>
> >>>>> - This PR is backwards-compatible
> >>>>> - Provides a pluggable mechanism where a developer can use
> >>> their own
> >>>>> backend
> >>>>> - When looking up a connection, by default airflow will search the
> >>>>> Secrets Backend, followed by environment variables first and
> Metadata
> >>>>> DB.
> >>>>> - Support for AWS SSM as Secret backend
> >>>>>
> >>>>>
> >>>>> Regards,
> >>>>> Kaxil
> >>>>>
> >>>>
> >>>>
> >>>> --
> >>>>
> >>>> Jarek Potiuk
> >>>> Polidea <https://www.polidea.com/> | Principal Software Engineer
> >>>>
> >>>> M: +48 660 796 129 <+48660796129>
> >>>> [image: Polidea] <https://www.polidea.com/>
> >>>>
> >>>>
> >>>
> >>> --
> >>>
> >>> Jarek Potiuk
> >>> Polidea <https://www.polidea.com/> | Principal Software Engineer
> >>>
> >>> M: +48 660 796 129 <+48660796129>
> >>> [image: Polidea] <https://www.polidea.com/>
> >>>
> >>
>
>
Re: [VOTE] AIP-33 Secrets Backend
Posted by Bas Harenslak <ba...@godatadriven.com.INVALID>.
+1
> On 16 Mar 2020, at 12:27, Ash Berlin-Taylor <as...@apache.org> wrote:
>
> +1 binding
>
> On Mar 16 2020, at 11:20 am, Kaxil Naik <ka...@gmail.com> wrote:
>
>> +1 (binding)
>>
>> On Mon, Mar 16, 2020 at 11:19 AM Jarek Potiuk <Ja...@polidea.com>
>> wrote:
>>
>>> Clarify: +1 (binding)
>>>
>>> On Mon, Mar 16, 2020 at 12:19 PM Jarek Potiuk <Ja...@polidea.com>
>>> wrote:
>>>
>>>> +1
>>>>
>>>> On Mon, Mar 16, 2020 at 12:16 PM Kaxil Naik <ka...@gmail.com> wrote:
>>>>
>>>>> Hey all,
>>>>>
>>>>> This email calls for a vote on the scope described in
>>>>>
>>> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend
>>>>> and
>>>>> the PR: https://github.com/apache/airflow/pull/6376
>>>>>
>>>>> *Note*: The PR is already merged but if this vote does not pass we will
>>>>> revert it.
>>>>>
>>>>> Documentation on the pluggable secrets backend:
>>>>>
>>>>>
>>> https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
>>>>>
>>>>> *Details*
>>>>>
>>>>> - This PR is backwards-compatible
>>>>> - Provides a pluggable mechanism where a developer can use
>>> their own
>>>>> backend
>>>>> - When looking up a connection, by default airflow will search the
>>>>> Secrets Backend, followed by environment variables first and Metadata
>>>>> DB.
>>>>> - Support for AWS SSM as Secret backend
>>>>>
>>>>>
>>>>> Regards,
>>>>> Kaxil
>>>>>
>>>>
>>>>
>>>> --
>>>>
>>>> Jarek Potiuk
>>>> Polidea <https://www.polidea.com/> | Principal Software Engineer
>>>>
>>>> M: +48 660 796 129 <+48660796129>
>>>> [image: Polidea] <https://www.polidea.com/>
>>>>
>>>>
>>>
>>> --
>>>
>>> Jarek Potiuk
>>> Polidea <https://www.polidea.com/> | Principal Software Engineer
>>>
>>> M: +48 660 796 129 <+48660796129>
>>> [image: Polidea] <https://www.polidea.com/>
>>>
>>
Re: [VOTE] AIP-33 Secrets Backend
Posted by Ash Berlin-Taylor <as...@apache.org>.
+1 binding
On Mar 16 2020, at 11:20 am, Kaxil Naik <ka...@gmail.com> wrote:
> +1 (binding)
>
> On Mon, Mar 16, 2020 at 11:19 AM Jarek Potiuk <Ja...@polidea.com>
> wrote:
>
>> Clarify: +1 (binding)
>>
>> On Mon, Mar 16, 2020 at 12:19 PM Jarek Potiuk <Ja...@polidea.com>
>> wrote:
>>
>> > +1
>> >
>> > On Mon, Mar 16, 2020 at 12:16 PM Kaxil Naik <ka...@gmail.com> wrote:
>> >
>> >> Hey all,
>> >>
>> >> This email calls for a vote on the scope described in
>> >>
>> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend
>> >> and
>> >> the PR: https://github.com/apache/airflow/pull/6376
>> >>
>> >> *Note*: The PR is already merged but if this vote does not pass we will
>> >> revert it.
>> >>
>> >> Documentation on the pluggable secrets backend:
>> >>
>> >>
>> https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
>> >>
>> >> *Details*
>> >>
>> >> - This PR is backwards-compatible
>> >> - Provides a pluggable mechanism where a developer can use
>> their own
>> >> backend
>> >> - When looking up a connection, by default airflow will search the
>> >> Secrets Backend, followed by environment variables first and Metadata
>> >> DB.
>> >> - Support for AWS SSM as Secret backend
>> >>
>> >>
>> >> Regards,
>> >> Kaxil
>> >>
>> >
>> >
>> > --
>> >
>> > Jarek Potiuk
>> > Polidea <https://www.polidea.com/> | Principal Software Engineer
>> >
>> > M: +48 660 796 129 <+48660796129>
>> > [image: Polidea] <https://www.polidea.com/>
>> >
>> >
>>
>> --
>>
>> Jarek Potiuk
>> Polidea <https://www.polidea.com/> | Principal Software Engineer
>>
>> M: +48 660 796 129 <+48660796129>
>> [image: Polidea] <https://www.polidea.com/>
>>
>
Re: [VOTE] AIP-33 Secrets Backend
Posted by Kaxil Naik <ka...@gmail.com>.
+1 (binding)
On Mon, Mar 16, 2020 at 11:19 AM Jarek Potiuk <Ja...@polidea.com>
wrote:
> Clarify: +1 (binding)
>
> On Mon, Mar 16, 2020 at 12:19 PM Jarek Potiuk <Ja...@polidea.com>
> wrote:
>
> > +1
> >
> > On Mon, Mar 16, 2020 at 12:16 PM Kaxil Naik <ka...@gmail.com> wrote:
> >
> >> Hey all,
> >>
> >> This email calls for a vote on the scope described in
> >>
> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend
> >> and
> >> the PR: https://github.com/apache/airflow/pull/6376
> >>
> >> *Note*: The PR is already merged but if this vote does not pass we will
> >> revert it.
> >>
> >> Documentation on the pluggable secrets backend:
> >>
> >>
> https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
> >>
> >> *Details*
> >>
> >> - This PR is backwards-compatible
> >> - Provides a pluggable mechanism where a developer can use their own
> >> backend
> >> - When looking up a connection, by default airflow will search the
> >> Secrets Backend, followed by environment variables first and Metadata
> >> DB.
> >> - Support for AWS SSM as Secret backend
> >>
> >>
> >> Regards,
> >> Kaxil
> >>
> >
> >
> > --
> >
> > Jarek Potiuk
> > Polidea <https://www.polidea.com/> | Principal Software Engineer
> >
> > M: +48 660 796 129 <+48660796129>
> > [image: Polidea] <https://www.polidea.com/>
> >
> >
>
> --
>
> Jarek Potiuk
> Polidea <https://www.polidea.com/> | Principal Software Engineer
>
> M: +48 660 796 129 <+48660796129>
> [image: Polidea] <https://www.polidea.com/>
>
Re: [VOTE] AIP-33 Secrets Backend
Posted by Jarek Potiuk <Ja...@polidea.com>.
Clarify: +1 (binding)
On Mon, Mar 16, 2020 at 12:19 PM Jarek Potiuk <Ja...@polidea.com>
wrote:
> +1
>
> On Mon, Mar 16, 2020 at 12:16 PM Kaxil Naik <ka...@gmail.com> wrote:
>
>> Hey all,
>>
>> This email calls for a vote on the scope described in
>> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend
>> and
>> the PR: https://github.com/apache/airflow/pull/6376
>>
>> *Note*: The PR is already merged but if this vote does not pass we will
>> revert it.
>>
>> Documentation on the pluggable secrets backend:
>>
>> https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
>>
>> *Details*
>>
>> - This PR is backwards-compatible
>> - Provides a pluggable mechanism where a developer can use their own
>> backend
>> - When looking up a connection, by default airflow will search the
>> Secrets Backend, followed by environment variables first and Metadata
>> DB.
>> - Support for AWS SSM as Secret backend
>>
>>
>> Regards,
>> Kaxil
>>
>
>
> --
>
> Jarek Potiuk
> Polidea <https://www.polidea.com/> | Principal Software Engineer
>
> M: +48 660 796 129 <+48660796129>
> [image: Polidea] <https://www.polidea.com/>
>
>
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>
Re: [VOTE] AIP-33 Secrets Backend
Posted by Jarek Potiuk <Ja...@polidea.com>.
+1
On Mon, Mar 16, 2020 at 12:16 PM Kaxil Naik <ka...@gmail.com> wrote:
> Hey all,
>
> This email calls for a vote on the scope described in
> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-33+Secrets+backend
> and
> the PR: https://github.com/apache/airflow/pull/6376
>
> *Note*: The PR is already merged but if this vote does not pass we will
> revert it.
>
> Documentation on the pluggable secrets backend:
>
> https://airflow.readthedocs.io/en/latest/howto/connection/index.html#alternative-secrets-backend
>
> *Details*
>
> - This PR is backwards-compatible
> - Provides a pluggable mechanism where a developer can use their own
> backend
> - When looking up a connection, by default airflow will search the
> Secrets Backend, followed by environment variables first and Metadata
> DB.
> - Support for AWS SSM as Secret backend
>
>
> Regards,
> Kaxil
>
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>