[DISCUSS] Donating Airflow k8s Operator

[Aizhamal Nurmamat kyzy <ai...@apache.org>]

Hello Airflow community,

Over the last year, an engineer at Google developed, and open sourced a
Kubernetes operator to run Airflow[1]. Anyone can use it to deploy Airflow
on their k8s cluster freely.

There have been discussions among community members that it would be great
to donate the operator to Apache to be part of Airflow. That way it is easy
to accept contributions from the community, improve and maintain it
collectively and transparently, along with the Airflow-k8s integration.

This idea has been discussed at Google, and we have obtained all necessary
approvals to donate the operator.

This discussion is to gather opinions from the community whether you all
think that it is a good idea. I personally think that this would be a great
addition to Airflow.

Please express your thoughts or concerns if you have any.

The discussion will run for 72 hours, and if there is consensus on
accepting the donation, we will move the code under the Apache
organization, to be owned by the Airflow community. If consensus is not
evident, we can have a vote after this discussion.

Thanks,
Aizhamal

[1] https://github.com/GoogleCloudPlatform/airflow-operator

Re: [DISCUSS] Donating Airflow k8s Operator

[Kaxil Naik <ka...@gmail.com>]

@Barni Seetharaman <ba...@google.com> - Github Issues have been enabled.
Feel free to create/use them.

Regards,
Kaxil

On Fri, Jan 24, 2020 at 1:49 PM Kaxil Naik <ka...@gmail.com> wrote:

> Oh yes forgot about that, thanks Kamil
>
> On Fri, Jan 24, 2020 at 1:34 PM Kamil Breguła <ka...@polidea.com>
> wrote:
>
>> Here is guide - how to enable issues on GitHub:
>> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=127405038
>>
>> On Fri, Jan 24, 2020, 5:45 AM Kaxil Naik <ka...@gmail.com> wrote:
>>
>> > We can ask the INFRA team to enable "ISSUES" on this repo. So that we
>> don't
>> > mix it with Airflow Jira board.
>> >
>> > I will ask that and let you all know when it is enabled.
>> >
>> > On Fri, Jan 24, 2020, 10:09 Tao Feng <fe...@gmail.com> wrote:
>> >
>> > > Yes, that's it. I am +1 on adding a new label or component for k8s
>> > > operator.
>> > >
>> > >
>> > > On Thu, Jan 23, 2020 at 2:30 PM Barni Seetharaman <ba...@google.com>
>> > > wrote:
>> > >
>> > > > Is this the j
>> > > > <
>> > >
>> >
>> https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6567?filter=allopenissues
>> > > >
>> > > > ira: https://issues.apache.org/jira/projects/AIRFLOW/summary
>> > > > Do we need to add a new component for "Airflow-on-k8s-operator"  ?
>> > > >
>> > > > regs
>> > > > Barni
>> > > >
>> > > > On Thu, Jan 23, 2020 at 2:12 PM Tao Feng <fe...@gmail.com>
>> wrote:
>> > > >
>> > > >> I don't think Airflow is using github issues. I am a committer and
>> > can't
>> > > >> create issue on the repo as well. I assume it is disabled by Apache
>> > > infra.
>> > > >> We could always file a jira for the issue :) .
>> > > >>
>> > > >> On Thu, Jan 23, 2020 at 1:54 PM Barni Seetharaman
>> > > >> <ba...@google.com.invalid> wrote:
>> > > >>
>> > > >>> Over the last few days we merged a few changes to get the repo to
>> be
>> > > >>> functional.
>> > > >>>
>> > > >>> I dont see the ability to create Issues on this repo.
>> > > >>> Can only commiters create an issue ?
>> > > >>>
>> > > >>> On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy <
>> > > >>> aizhamal@apache.org>
>> > > >>> wrote:
>> > > >>>
>> > > >>> > Indeed. I have previously requested +Barni Seetharaman <
>> > > >>> barni@google.com> (the
>> > > >>> > author of the operator) to write up a post about how and when to
>> > use
>> > > >>> this
>> > > >>> > operator with examples. If Barni's bandwidth doesn't allow him
>> to
>> > > work
>> > > >>> on
>> > > >>> > it at the moment, maybe we can have other volunteers who know
>> the
>> > > code
>> > > >>> to
>> > > >>> > contribute the documentation? +Pablo Estrada <
>> pabloem@google.com>
>> > I
>> > > >>> know
>> > > >>> > you worked with Barni, would you be able to do it?
>> > > >>> >
>> > > >>> >
>> > > >>> > On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <
>> > bin.huangxb@gmail.com>
>> > > >>> > wrote:
>> > > >>> >
>> > > >>> >> Some doc or content about what is it and potential use cases
>> and
>> > why
>> > > >>> we
>> > > >>> >> should use this would be great.
>> > > >>> >>
>> > > >>> >> Thanks for everything!
>> > > >>> >>
>> > > >>> >> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <
>> > > >>> zhongjiajie955@hotmail.com>
>> > > >>> >> wrote:
>> > > >>> >>
>> > > >>> >> > It’s great for community, I can see the repo in
>> > > >>> >> > https://github.com/apache/airflow-on-k8s-operator <
>> > > >>> >> > https://github.com/apache/airflow-on-k8s-operator>
>> > > >>> >> >
>> > > >>> >> > One more thing: should we add some content in our document to
>> > > >>> attract
>> > > >>> >> > attention for users?
>> > > >>> >> >
>> > > >>> >> > Best Wish
>> > > >>> >> > — Jiajie
>> > > >>> >> >
>> > > >>> >> >
>> > > >>> >>
>> > > >>> >
>> > > >>>
>> > > >>
>> > >
>> >
>>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Kaxil Naik <ka...@gmail.com>]

Oh yes forgot about that, thanks Kamil

On Fri, Jan 24, 2020 at 1:34 PM Kamil Breguła <ka...@polidea.com>
wrote:

> Here is guide - how to enable issues on GitHub:
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=127405038
>
> On Fri, Jan 24, 2020, 5:45 AM Kaxil Naik <ka...@gmail.com> wrote:
>
> > We can ask the INFRA team to enable "ISSUES" on this repo. So that we
> don't
> > mix it with Airflow Jira board.
> >
> > I will ask that and let you all know when it is enabled.
> >
> > On Fri, Jan 24, 2020, 10:09 Tao Feng <fe...@gmail.com> wrote:
> >
> > > Yes, that's it. I am +1 on adding a new label or component for k8s
> > > operator.
> > >
> > >
> > > On Thu, Jan 23, 2020 at 2:30 PM Barni Seetharaman <ba...@google.com>
> > > wrote:
> > >
> > > > Is this the j
> > > > <
> > >
> >
> https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6567?filter=allopenissues
> > > >
> > > > ira: https://issues.apache.org/jira/projects/AIRFLOW/summary
> > > > Do we need to add a new component for "Airflow-on-k8s-operator"  ?
> > > >
> > > > regs
> > > > Barni
> > > >
> > > > On Thu, Jan 23, 2020 at 2:12 PM Tao Feng <fe...@gmail.com>
> wrote:
> > > >
> > > >> I don't think Airflow is using github issues. I am a committer and
> > can't
> > > >> create issue on the repo as well. I assume it is disabled by Apache
> > > infra.
> > > >> We could always file a jira for the issue :) .
> > > >>
> > > >> On Thu, Jan 23, 2020 at 1:54 PM Barni Seetharaman
> > > >> <ba...@google.com.invalid> wrote:
> > > >>
> > > >>> Over the last few days we merged a few changes to get the repo to
> be
> > > >>> functional.
> > > >>>
> > > >>> I dont see the ability to create Issues on this repo.
> > > >>> Can only commiters create an issue ?
> > > >>>
> > > >>> On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy <
> > > >>> aizhamal@apache.org>
> > > >>> wrote:
> > > >>>
> > > >>> > Indeed. I have previously requested +Barni Seetharaman <
> > > >>> barni@google.com> (the
> > > >>> > author of the operator) to write up a post about how and when to
> > use
> > > >>> this
> > > >>> > operator with examples. If Barni's bandwidth doesn't allow him to
> > > work
> > > >>> on
> > > >>> > it at the moment, maybe we can have other volunteers who know the
> > > code
> > > >>> to
> > > >>> > contribute the documentation? +Pablo Estrada <pabloem@google.com
> >
> > I
> > > >>> know
> > > >>> > you worked with Barni, would you be able to do it?
> > > >>> >
> > > >>> >
> > > >>> > On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <
> > bin.huangxb@gmail.com>
> > > >>> > wrote:
> > > >>> >
> > > >>> >> Some doc or content about what is it and potential use cases and
> > why
> > > >>> we
> > > >>> >> should use this would be great.
> > > >>> >>
> > > >>> >> Thanks for everything!
> > > >>> >>
> > > >>> >> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <
> > > >>> zhongjiajie955@hotmail.com>
> > > >>> >> wrote:
> > > >>> >>
> > > >>> >> > It’s great for community, I can see the repo in
> > > >>> >> > https://github.com/apache/airflow-on-k8s-operator <
> > > >>> >> > https://github.com/apache/airflow-on-k8s-operator>
> > > >>> >> >
> > > >>> >> > One more thing: should we add some content in our document to
> > > >>> attract
> > > >>> >> > attention for users?
> > > >>> >> >
> > > >>> >> > Best Wish
> > > >>> >> > — Jiajie
> > > >>> >> >
> > > >>> >> >
> > > >>> >>
> > > >>> >
> > > >>>
> > > >>
> > >
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Kamil Breguła <ka...@polidea.com>]

Here is guide - how to enable issues on GitHub:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=127405038

On Fri, Jan 24, 2020, 5:45 AM Kaxil Naik <ka...@gmail.com> wrote:

> We can ask the INFRA team to enable "ISSUES" on this repo. So that we don't
> mix it with Airflow Jira board.
>
> I will ask that and let you all know when it is enabled.
>
> On Fri, Jan 24, 2020, 10:09 Tao Feng <fe...@gmail.com> wrote:
>
> > Yes, that's it. I am +1 on adding a new label or component for k8s
> > operator.
> >
> >
> > On Thu, Jan 23, 2020 at 2:30 PM Barni Seetharaman <ba...@google.com>
> > wrote:
> >
> > > Is this the j
> > > <
> >
> https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6567?filter=allopenissues
> > >
> > > ira: https://issues.apache.org/jira/projects/AIRFLOW/summary
> > > Do we need to add a new component for "Airflow-on-k8s-operator"  ?
> > >
> > > regs
> > > Barni
> > >
> > > On Thu, Jan 23, 2020 at 2:12 PM Tao Feng <fe...@gmail.com> wrote:
> > >
> > >> I don't think Airflow is using github issues. I am a committer and
> can't
> > >> create issue on the repo as well. I assume it is disabled by Apache
> > infra.
> > >> We could always file a jira for the issue :) .
> > >>
> > >> On Thu, Jan 23, 2020 at 1:54 PM Barni Seetharaman
> > >> <ba...@google.com.invalid> wrote:
> > >>
> > >>> Over the last few days we merged a few changes to get the repo to be
> > >>> functional.
> > >>>
> > >>> I dont see the ability to create Issues on this repo.
> > >>> Can only commiters create an issue ?
> > >>>
> > >>> On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy <
> > >>> aizhamal@apache.org>
> > >>> wrote:
> > >>>
> > >>> > Indeed. I have previously requested +Barni Seetharaman <
> > >>> barni@google.com> (the
> > >>> > author of the operator) to write up a post about how and when to
> use
> > >>> this
> > >>> > operator with examples. If Barni's bandwidth doesn't allow him to
> > work
> > >>> on
> > >>> > it at the moment, maybe we can have other volunteers who know the
> > code
> > >>> to
> > >>> > contribute the documentation? +Pablo Estrada <pa...@google.com>
> I
> > >>> know
> > >>> > you worked with Barni, would you be able to do it?
> > >>> >
> > >>> >
> > >>> > On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <
> bin.huangxb@gmail.com>
> > >>> > wrote:
> > >>> >
> > >>> >> Some doc or content about what is it and potential use cases and
> why
> > >>> we
> > >>> >> should use this would be great.
> > >>> >>
> > >>> >> Thanks for everything!
> > >>> >>
> > >>> >> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <
> > >>> zhongjiajie955@hotmail.com>
> > >>> >> wrote:
> > >>> >>
> > >>> >> > It’s great for community, I can see the repo in
> > >>> >> > https://github.com/apache/airflow-on-k8s-operator <
> > >>> >> > https://github.com/apache/airflow-on-k8s-operator>
> > >>> >> >
> > >>> >> > One more thing: should we add some content in our document to
> > >>> attract
> > >>> >> > attention for users?
> > >>> >> >
> > >>> >> > Best Wish
> > >>> >> > — Jiajie
> > >>> >> >
> > >>> >> >
> > >>> >>
> > >>> >
> > >>>
> > >>
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Kaxil Naik <ka...@gmail.com>]

We can ask the INFRA team to enable "ISSUES" on this repo. So that we don't
mix it with Airflow Jira board.

I will ask that and let you all know when it is enabled.

On Fri, Jan 24, 2020, 10:09 Tao Feng <fe...@gmail.com> wrote:

> Yes, that's it. I am +1 on adding a new label or component for k8s
> operator.
>
>
> On Thu, Jan 23, 2020 at 2:30 PM Barni Seetharaman <ba...@google.com>
> wrote:
>
> > Is this the j
> > <
> https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6567?filter=allopenissues
> >
> > ira: https://issues.apache.org/jira/projects/AIRFLOW/summary
> > Do we need to add a new component for "Airflow-on-k8s-operator"  ?
> >
> > regs
> > Barni
> >
> > On Thu, Jan 23, 2020 at 2:12 PM Tao Feng <fe...@gmail.com> wrote:
> >
> >> I don't think Airflow is using github issues. I am a committer and can't
> >> create issue on the repo as well. I assume it is disabled by Apache
> infra.
> >> We could always file a jira for the issue :) .
> >>
> >> On Thu, Jan 23, 2020 at 1:54 PM Barni Seetharaman
> >> <ba...@google.com.invalid> wrote:
> >>
> >>> Over the last few days we merged a few changes to get the repo to be
> >>> functional.
> >>>
> >>> I dont see the ability to create Issues on this repo.
> >>> Can only commiters create an issue ?
> >>>
> >>> On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy <
> >>> aizhamal@apache.org>
> >>> wrote:
> >>>
> >>> > Indeed. I have previously requested +Barni Seetharaman <
> >>> barni@google.com> (the
> >>> > author of the operator) to write up a post about how and when to use
> >>> this
> >>> > operator with examples. If Barni's bandwidth doesn't allow him to
> work
> >>> on
> >>> > it at the moment, maybe we can have other volunteers who know the
> code
> >>> to
> >>> > contribute the documentation? +Pablo Estrada <pa...@google.com> I
> >>> know
> >>> > you worked with Barni, would you be able to do it?
> >>> >
> >>> >
> >>> > On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <bi...@gmail.com>
> >>> > wrote:
> >>> >
> >>> >> Some doc or content about what is it and potential use cases and why
> >>> we
> >>> >> should use this would be great.
> >>> >>
> >>> >> Thanks for everything!
> >>> >>
> >>> >> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <
> >>> zhongjiajie955@hotmail.com>
> >>> >> wrote:
> >>> >>
> >>> >> > It’s great for community, I can see the repo in
> >>> >> > https://github.com/apache/airflow-on-k8s-operator <
> >>> >> > https://github.com/apache/airflow-on-k8s-operator>
> >>> >> >
> >>> >> > One more thing: should we add some content in our document to
> >>> attract
> >>> >> > attention for users?
> >>> >> >
> >>> >> > Best Wish
> >>> >> > — Jiajie
> >>> >> >
> >>> >> >
> >>> >>
> >>> >
> >>>
> >>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Tao Feng <fe...@gmail.com>]

Yes, that's it. I am +1 on adding a new label or component for k8s operator.


On Thu, Jan 23, 2020 at 2:30 PM Barni Seetharaman <ba...@google.com> wrote:

> Is this the j
> <https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6567?filter=allopenissues>
> ira: https://issues.apache.org/jira/projects/AIRFLOW/summary
> Do we need to add a new component for "Airflow-on-k8s-operator"  ?
>
> regs
> Barni
>
> On Thu, Jan 23, 2020 at 2:12 PM Tao Feng <fe...@gmail.com> wrote:
>
>> I don't think Airflow is using github issues. I am a committer and can't
>> create issue on the repo as well. I assume it is disabled by Apache infra.
>> We could always file a jira for the issue :) .
>>
>> On Thu, Jan 23, 2020 at 1:54 PM Barni Seetharaman
>> <ba...@google.com.invalid> wrote:
>>
>>> Over the last few days we merged a few changes to get the repo to be
>>> functional.
>>>
>>> I dont see the ability to create Issues on this repo.
>>> Can only commiters create an issue ?
>>>
>>> On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy <
>>> aizhamal@apache.org>
>>> wrote:
>>>
>>> > Indeed. I have previously requested +Barni Seetharaman <
>>> barni@google.com> (the
>>> > author of the operator) to write up a post about how and when to use
>>> this
>>> > operator with examples. If Barni's bandwidth doesn't allow him to work
>>> on
>>> > it at the moment, maybe we can have other volunteers who know the code
>>> to
>>> > contribute the documentation? +Pablo Estrada <pa...@google.com> I
>>> know
>>> > you worked with Barni, would you be able to do it?
>>> >
>>> >
>>> > On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <bi...@gmail.com>
>>> > wrote:
>>> >
>>> >> Some doc or content about what is it and potential use cases and why
>>> we
>>> >> should use this would be great.
>>> >>
>>> >> Thanks for everything!
>>> >>
>>> >> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <
>>> zhongjiajie955@hotmail.com>
>>> >> wrote:
>>> >>
>>> >> > It’s great for community, I can see the repo in
>>> >> > https://github.com/apache/airflow-on-k8s-operator <
>>> >> > https://github.com/apache/airflow-on-k8s-operator>
>>> >> >
>>> >> > One more thing: should we add some content in our document to
>>> attract
>>> >> > attention for users?
>>> >> >
>>> >> > Best Wish
>>> >> > — Jiajie
>>> >> >
>>> >> >
>>> >>
>>> >
>>>
>>

Re: [DISCUSS] Donating Airflow k8s Operator

[Barni Seetharaman <ba...@google.com.INVALID>]

Is this the j
<https://issues.apache.org/jira/projects/AIRFLOW/issues/AIRFLOW-6567?filter=allopenissues>
ira: https://issues.apache.org/jira/projects/AIRFLOW/summary
Do we need to add a new component for "Airflow-on-k8s-operator"  ?

regs
Barni

On Thu, Jan 23, 2020 at 2:12 PM Tao Feng <fe...@gmail.com> wrote:

> I don't think Airflow is using github issues. I am a committer and can't
> create issue on the repo as well. I assume it is disabled by Apache infra.
> We could always file a jira for the issue :) .
>
> On Thu, Jan 23, 2020 at 1:54 PM Barni Seetharaman <ba...@google.com.invalid>
> wrote:
>
>> Over the last few days we merged a few changes to get the repo to be
>> functional.
>>
>> I dont see the ability to create Issues on this repo.
>> Can only commiters create an issue ?
>>
>> On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy <
>> aizhamal@apache.org>
>> wrote:
>>
>> > Indeed. I have previously requested +Barni Seetharaman <
>> barni@google.com> (the
>> > author of the operator) to write up a post about how and when to use
>> this
>> > operator with examples. If Barni's bandwidth doesn't allow him to work
>> on
>> > it at the moment, maybe we can have other volunteers who know the code
>> to
>> > contribute the documentation? +Pablo Estrada <pa...@google.com> I
>> know
>> > you worked with Barni, would you be able to do it?
>> >
>> >
>> > On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <bi...@gmail.com>
>> > wrote:
>> >
>> >> Some doc or content about what is it and potential use cases and why we
>> >> should use this would be great.
>> >>
>> >> Thanks for everything!
>> >>
>> >> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <
>> zhongjiajie955@hotmail.com>
>> >> wrote:
>> >>
>> >> > It’s great for community, I can see the repo in
>> >> > https://github.com/apache/airflow-on-k8s-operator <
>> >> > https://github.com/apache/airflow-on-k8s-operator>
>> >> >
>> >> > One more thing: should we add some content in our document to attract
>> >> > attention for users?
>> >> >
>> >> > Best Wish
>> >> > — Jiajie
>> >> >
>> >> >
>> >>
>> >
>>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Tao Feng <fe...@gmail.com>]

I don't think Airflow is using github issues. I am a committer and can't
create issue on the repo as well. I assume it is disabled by Apache infra.
We could always file a jira for the issue :) .

On Thu, Jan 23, 2020 at 1:54 PM Barni Seetharaman <ba...@google.com.invalid>
wrote:

> Over the last few days we merged a few changes to get the repo to be
> functional.
>
> I dont see the ability to create Issues on this repo.
> Can only commiters create an issue ?
>
> On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy <
> aizhamal@apache.org>
> wrote:
>
> > Indeed. I have previously requested +Barni Seetharaman <ba...@google.com>
> (the
> > author of the operator) to write up a post about how and when to use this
> > operator with examples. If Barni's bandwidth doesn't allow him to work on
> > it at the moment, maybe we can have other volunteers who know the code to
> > contribute the documentation? +Pablo Estrada <pa...@google.com> I know
> > you worked with Barni, would you be able to do it?
> >
> >
> > On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <bi...@gmail.com>
> > wrote:
> >
> >> Some doc or content about what is it and potential use cases and why we
> >> should use this would be great.
> >>
> >> Thanks for everything!
> >>
> >> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <
> zhongjiajie955@hotmail.com>
> >> wrote:
> >>
> >> > It’s great for community, I can see the repo in
> >> > https://github.com/apache/airflow-on-k8s-operator <
> >> > https://github.com/apache/airflow-on-k8s-operator>
> >> >
> >> > One more thing: should we add some content in our document to attract
> >> > attention for users?
> >> >
> >> > Best Wish
> >> > — Jiajie
> >> >
> >> >
> >>
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Barni Seetharaman <ba...@google.com.INVALID>]

Over the last few days we merged a few changes to get the repo to be
functional.

I dont see the ability to create Issues on this repo.
Can only commiters create an issue ?

On Mon, Jan 20, 2020 at 12:36 PM Aizhamal Nurmamat kyzy <ai...@apache.org>
wrote:

> Indeed. I have previously requested +Barni Seetharaman <ba...@google.com> (the
> author of the operator) to write up a post about how and when to use this
> operator with examples. If Barni's bandwidth doesn't allow him to work on
> it at the moment, maybe we can have other volunteers who know the code to
> contribute the documentation? +Pablo Estrada <pa...@google.com> I know
> you worked with Barni, would you be able to do it?
>
>
> On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <bi...@gmail.com>
> wrote:
>
>> Some doc or content about what is it and potential use cases and why we
>> should use this would be great.
>>
>> Thanks for everything!
>>
>> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <zh...@hotmail.com>
>> wrote:
>>
>> > It’s great for community, I can see the repo in
>> > https://github.com/apache/airflow-on-k8s-operator <
>> > https://github.com/apache/airflow-on-k8s-operator>
>> >
>> > One more thing: should we add some content in our document to attract
>> > attention for users?
>> >
>> > Best Wish
>> > — Jiajie
>> >
>> >
>>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Aizhamal Nurmamat kyzy <ai...@apache.org>]

Indeed. I have previously requested +Barni Seetharaman <ba...@google.com> (the
author of the operator) to write up a post about how and when to use this
operator with examples. If Barni's bandwidth doesn't allow him to work on
it at the moment, maybe we can have other volunteers who know the code to
contribute the documentation? +Pablo Estrada <pa...@google.com> I know
you worked with Barni, would you be able to do it?


On Sun, Jan 19, 2020 at 4:37 PM Xinbin Huang <bi...@gmail.com> wrote:

> Some doc or content about what is it and potential use cases and why we
> should use this would be great.
>
> Thanks for everything!
>
> On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <zh...@hotmail.com>
> wrote:
>
> > It’s great for community, I can see the repo in
> > https://github.com/apache/airflow-on-k8s-operator <
> > https://github.com/apache/airflow-on-k8s-operator>
> >
> > One more thing: should we add some content in our document to attract
> > attention for users?
> >
> > Best Wish
> > — Jiajie
> >
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Xinbin Huang <bi...@gmail.com>]

Some doc or content about what is it and potential use cases and why we
should use this would be great.

Thanks for everything!

On Fri, Jan 17, 2020 at 1:04 AM Jiajie Zhong <zh...@hotmail.com>
wrote:

> It’s great for community, I can see the repo in
> https://github.com/apache/airflow-on-k8s-operator <
> https://github.com/apache/airflow-on-k8s-operator>
>
> One more thing: should we add some content in our document to attract
> attention for users?
>
> Best Wish
> — Jiajie
>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Jiajie Zhong <zh...@hotmail.com>]

It’s great for community, I can see the repo in https://github.com/apache/airflow-on-k8s-operator <https://github.com/apache/airflow-on-k8s-operator>

One more thing: should we add some content in our document to attract attention for users?

Best Wish
— Jiajie

Re: [DISCUSS] Donating Airflow k8s Operator

[Tao Feng <fe...@gmail.com>]

great!!!

On Wed, Jan 15, 2020 at 4:41 PM Pablo Estrada <pa...@google.com.invalid>
wrote:

> Very cool : )
>
> On Wed, Jan 15, 2020 at 1:04 PM Jarek Potiuk <Ja...@polidea.com>
> wrote:
>
> > Awesome!
> >
> > On Wed, Jan 15, 2020 at 10:01 PM Kaxil Naik <ka...@gmail.com> wrote:
> >
> > > Awesome, thanks Aizhamal, Jakob and everyone involved.
> > >
> > > On Wed, Jan 15, 2020 at 6:15 PM Aizhamal Nurmamat kyzy <
> > > aizhamal@apache.org>
> > > wrote:
> > >
> > > > Forgot to clarify that I will create the repo :) Thanks
> > > >
> > > > On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy <
> > > > aizhamal@apache.org>
> > > > wrote:
> > > >
> > > > > Hi everyone,,
> > > > >
> > > > > We have finally pushed through the process of getting the IP
> > clearance
> > > > for
> > > > > this donation. Thanks for driving a lot of the effort, Jakob!
> > > > >
> > > > > As per Apache Infra response [1], we now can create a new
> > > > > 'airflow-on-k8s-operator' repo under apache/airflow and move the
> > code.
> > > > >
> > > > >
> > > > > [1]
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/browse/INFRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel
> > > > >
> > > > > On Fri, Nov 15, 2019 at 10:46 AM Aizhamal Nurmamat kyzy <
> > > > > aizhamal@apache.org> wrote:
> > > > >
> > > > >> Hi Tao and everyone,
> > > > >>
> > > > >> Sorry that we haven't updated you in a while. We have just changed
> > the
> > > > >> licenses into appropriate ones and currently still dealing with
> its
> > > > >> dependencies. But it is moving now. +Jakob Homan <
> jghoman@gmail.com
> > >
> > > I
> > > > >> think was about to start a vote soon.
> > > > >>
> > > > >> On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fe...@gmail.com>
> > > wrote:
> > > > >>
> > > > >>> Hey,
> > > > >>>
> > > > >>> Is the Airflow k8s Operator project now part of airflow code base
> > > now?
> > > > Or
> > > > >>> still waiting for IP clearance?
> > > > >>>
> > > > >>> Thanks,
> > > > >>> -Tao
> > > > >>>
> > > > >>> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy <
> > > > >>> aizhamal@apache.org>
> > > > >>> wrote:
> > > > >>>
> > > > >>> > Thanks everyone for participating in the discussion! I see
> there
> > > is a
> > > > >>> > consensus among the community on this regard, therefore we will
> > > move
> > > > >>> > forward with the process.
> > > > >>> >
> > > > >>> > Next step is to get IP clearance as described here [1]. This
> step
> > > is
> > > > >>> done
> > > > >>> > by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has
> > > > agreed
> > > > >>> to
> > > > >>> > help. Thank you!
> > > > >>> >
> > > > >>> > I am closing this thread now, and Jakob will start a new one
> when
> > > it
> > > > is
> > > > >>> > time to vote.
> > > > >>> >
> > > > >>> > Thanks everyone,
> > > > >>> > Aizhamal
> > > > >>> >
> > > > >>> > [1] http://incubator.apache.org/ip-clearance/index.html
> > > > >>> >
> > > > >>> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <
> > > > >>> kamil.bregula@polidea.com>
> > > > >>> > wrote:
> > > > >>> >
> > > > >>> > > +1
> > > > >>> > >
> > > > >>> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <
> > > > >>> Jarek.Potiuk@polidea.com>
> > > > >>> > > wrote:
> > > > >>> > > >
> > > > >>> > > > +1 for aieflow-on-k8s-operator. Good enough :)
> > > > >>> > > >
> > > > >>> > > > J.
> > > > >>> > > >
> > > > >>> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <
> > > fengtao04@gmail.com
> > > > >
> > > > >>> > > napisał:
> > > > >>> > > >
> > > > >>> > > > > +1 on `airflow-on-k8s-operator` as well
> > > > >>> > > > >
> > > > >>> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <
> > ry@rywalker.com>
> > > > >>> wrote:
> > > > >>> > > > >
> > > > >>> > > > > > +1 from me for sure. Thanks for pushing this through
> > > > Aizhamal.
> > > > >>> > > > > >
> > > > >>> > > > > > GCP just named their flink operator (
> > > > >>> > > > > >
> > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> > > > >>> > > > > > ) *flink-on-k8s-operator.*
> > > > >>> > > > > >
> > > > >>> > > > > > So  for name, I prefer either
> *k8s-operator-for-airflow*
> > or
> > > > >>> > > > > > *airflow-on-k8s-operator*. I sort of like the latter
> > better
> > > > >>> because
> > > > >>> > > > > > *airflow* is the first word rather than the last.
> > > > >>> > > > > >
> > > > >>> > > > > > -Ry
> > > > >>> > > > > >
> > > > >>> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk <
> Jarek.
> > > > >>> Potiuk@
> > > > >>> > > > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > > >>> > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > > Fantastic! Strong +1 from me.
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > > To alleviate some of the concerns - we @Polidea are
> > just
> > > > >>> > starting a
> > > > >>> > > > > > > project for big and serious customer where we will
> most
> > > > >>> likely
> > > > >>> > use
> > > > >>> > > and
> > > > >>> > > > > > > extend Kubernetes Operator.
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > > We have 3 people that could become contributors and
> > > > >>> commiters day
> > > > >>> > > one,
> > > > >>> > > > > so
> > > > >>> > > > > > > we can already help building community for it.
> Looking
> > > > >>> forward to
> > > > >>> > > > > > > following the Apache way in this case !
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > > J.
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@
> > > > gmail.
> > > > >>> > com (
> > > > >>> > > > > > > fengtao04@gmail.com ) > wrote:
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> +1 as well. One question: does the original author
> > still
> > > > >>> > actively
> > > > >>> > > > > > maintain
> > > > >>> > > > > > >> or would like to continue maintaining the code base
> > > after
> > > > >>> the
> > > > >>> > > repo is
> > > > >>> > > > > > >> moved
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> to Airflow?
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> > > > sumeet.
> > > > >>> > manit@
> > > > >>> > > > > > gmail. com
> > > > >>> > > > > > >> ( sumeet.manit@gmail.com )
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> wrote:
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> Strong +1
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat
> > kyzy
> > > <
> > > > >>> > > aizhamal@
> > > > >>> > > > > > apache.
> > > > >>> > > > > > >>> org ( aizhamal@apache.org ) >
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> wrote:
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> Hello Airflow community,
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> Over the last year, an engineer at Google
> developed,
> > > and
> > > > >>> open
> > > > >>> > > > > sourced
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> a
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can
> > use
> > > it
> > > > >>> to
> > > > >>> > > deploy
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> Airflow
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> on their k8s cluster freely.
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> There have been discussions among community
> members
> > > that
> > > > >>> it
> > > > >>> > > would be
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> great
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> to donate the operator to Apache to be part of
> > > Airflow.
> > > > >>> That
> > > > >>> > > way it
> > > > >>> > > > > is
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> easy
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> to accept contributions from the community,
> improve
> > > and
> > > > >>> > > maintain it
> > > > >>> > > > > > >>>> collectively and transparently, along with the
> > > > Airflow-k8s
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> integration.
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> This idea has been discussed at Google, and we
> have
> > > > >>> obtained
> > > > >>> > all
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> necessary
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> approvals to donate the operator.
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> This discussion is to gather opinions from the
> > > community
> > > > >>> > > whether you
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> all
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> think that it is a good idea. I personally think
> > that
> > > > this
> > > > >>> > > would be
> > > > >>> > > > > a
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> great
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> addition to Airflow.
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> Please express your thoughts or concerns if you
> have
> > > > any.
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> The discussion will run for 72 hours, and if there
> > is
> > > > >>> > consensus
> > > > >>> > > on
> > > > >>> > > > > > >>>> accepting the donation, we will move the code
> under
> > > the
> > > > >>> Apache
> > > > >>> > > > > > >>>> organization, to be owned by the Airflow
> community.
> > If
> > > > >>> > > consensus is
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> not
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> evident, we can have a vote after this discussion.
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> Thanks,
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> Aizhamal
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > >
> > > > >>> > > > > > Sent via Superhuman (
> > https://sprh.mn/?vip=ry@rywalker.com
> > > )
> > > > >>> > > > > >
> > > > >>> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> > > > >>> > > > > Jarek.Potiuk@polidea.com
> > > > >>> > > > > > > wrote:
> > > > >>> > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > > The name is indeed misleading. My proposal would be
> > > > >>> > > > > > > k8s-operator-for-airflow - this might make it
> > > unambiguous .
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk <
> > Jarek.
> > > > >>> Potiuk@
> > > > >>> > > > > > polidea.
> > > > >>> > > > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> Fantastic! Strong +1 from me.
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> To alleviate some of the concerns - we @Polidea are
> > just
> > > > >>> > starting
> > > > >>> > > a
> > > > >>> > > > > > >> project for big and serious customer where we will
> > most
> > > > >>> likely
> > > > >>> > > use and
> > > > >>> > > > > > >> extend Kubernetes Operator.
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> We have 3 people that could become contributors and
> > > > >>> commiters
> > > > >>> > day
> > > > >>> > > one,
> > > > >>> > > > > > so
> > > > >>> > > > > > >> we can already help building community for it.
> Looking
> > > > >>> forward
> > > > >>> > to
> > > > >>> > > > > > >> following the Apache way in this case !
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> J.
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng <
> fengtao04@
> > > > >>> gmail.
> > > > >>> > com
> > > > >>> > > (
> > > > >>> > > > > > >> fengtao04@gmail.com ) > wrote:
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> +1 as well. One question: does the original author
> > > still
> > > > >>> > actively
> > > > >>> > > > > > maintain
> > > > >>> > > > > > >>> or would like to continue maintaining the code base
> > > after
> > > > >>> the
> > > > >>> > > repo is
> > > > >>> > > > > > >>> moved
> > > > >>> > > > > > >>> to Airflow?
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> > > > sumeet.
> > > > >>> > > manit@
> > > > >>> > > > > > gmail. com
> > > > >>> > > > > > >>> ( sumeet.manit@gmail.com )
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> wrote:
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> Strong +1
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat
> > > kyzy <
> > > > >>> > > aizhamal@
> > > > >>> > > > > > apache.
> > > > >>> > > > > > >>>> org ( aizhamal@apache.org ) >
> > > > >>> > > > > > >>>> wrote:
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> Hello Airflow community,
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> Over the last year, an engineer at Google
> > developed,
> > > > and
> > > > >>> open
> > > > >>> > > > > sourced
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> a
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can
> > use
> > > > it
> > > > >>> to
> > > > >>> > > deploy
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> Airflow
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> on their k8s cluster freely.
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> There have been discussions among community
> members
> > > > that
> > > > >>> it
> > > > >>> > > would
> > > > >>> > > > > be
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> great
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> to donate the operator to Apache to be part of
> > > Airflow.
> > > > >>> That
> > > > >>> > > way it
> > > > >>> > > > > > is
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> easy
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> to accept contributions from the community,
> improve
> > > and
> > > > >>> > > maintain it
> > > > >>> > > > > > >>>>> collectively and transparently, along with the
> > > > >>> Airflow-k8s
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> integration.
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> This idea has been discussed at Google, and we
> have
> > > > >>> obtained
> > > > >>> > > all
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> necessary
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> approvals to donate the operator.
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> This discussion is to gather opinions from the
> > > > community
> > > > >>> > > whether
> > > > >>> > > > > you
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> all
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> think that it is a good idea. I personally think
> > that
> > > > >>> this
> > > > >>> > > would
> > > > >>> > > > > be a
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>> great
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> addition to Airflow.
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> Please express your thoughts or concerns if you
> > have
> > > > any.
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> The discussion will run for 72 hours, and if
> there
> > is
> > > > >>> > > consensus on
> > > > >>> > > > > > >>>>> accepting the donation, we will move the code
> under
> > > the
> > > > >>> > Apache
> > > > >>> > > > > > >>>>> organization, to be owned by the Airflow
> community.
> > > If
> > > > >>> > > consensus is
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>> not
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> evident, we can have a vote after this
> discussion.
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> Thanks,
> > > > >>> > > > > > >>>>> Aizhamal
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
> > > > >>> > > airflow-operator (
> > > > >>> > > > > > >>>>>
> > > > https://github.com/GoogleCloudPlatform/airflow-operator
> > > > >>> )
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >>
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > > > >
> > > > >>> > > > >
> > > > >>> > >
> > > > >>> >
> > > > >>>
> > > > >>
> > > >
> > >
> >
> >
> > --
> >
> > Jarek Potiuk
> > Polidea <https://www.polidea.com/> | Principal Software Engineer
> >
> > M: +48 660 796 129 <+48%20660%20796%20129> <+48660796129
> > <+48%20660%20796%20129>>
> > [image: Polidea] <https://www.polidea.com/>
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Pablo Estrada <pa...@google.com.INVALID>]

Very cool : )

On Wed, Jan 15, 2020 at 1:04 PM Jarek Potiuk <Ja...@polidea.com>
wrote:

> Awesome!
>
> On Wed, Jan 15, 2020 at 10:01 PM Kaxil Naik <ka...@gmail.com> wrote:
>
> > Awesome, thanks Aizhamal, Jakob and everyone involved.
> >
> > On Wed, Jan 15, 2020 at 6:15 PM Aizhamal Nurmamat kyzy <
> > aizhamal@apache.org>
> > wrote:
> >
> > > Forgot to clarify that I will create the repo :) Thanks
> > >
> > > On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy <
> > > aizhamal@apache.org>
> > > wrote:
> > >
> > > > Hi everyone,,
> > > >
> > > > We have finally pushed through the process of getting the IP
> clearance
> > > for
> > > > this donation. Thanks for driving a lot of the effort, Jakob!
> > > >
> > > > As per Apache Infra response [1], we now can create a new
> > > > 'airflow-on-k8s-operator' repo under apache/airflow and move the
> code.
> > > >
> > > >
> > > > [1]
> > > >
> > >
> >
> https://issues.apache.org/jira/browse/INFRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel
> > > >
> > > > On Fri, Nov 15, 2019 at 10:46 AM Aizhamal Nurmamat kyzy <
> > > > aizhamal@apache.org> wrote:
> > > >
> > > >> Hi Tao and everyone,
> > > >>
> > > >> Sorry that we haven't updated you in a while. We have just changed
> the
> > > >> licenses into appropriate ones and currently still dealing with its
> > > >> dependencies. But it is moving now. +Jakob Homan <jghoman@gmail.com
> >
> > I
> > > >> think was about to start a vote soon.
> > > >>
> > > >> On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fe...@gmail.com>
> > wrote:
> > > >>
> > > >>> Hey,
> > > >>>
> > > >>> Is the Airflow k8s Operator project now part of airflow code base
> > now?
> > > Or
> > > >>> still waiting for IP clearance?
> > > >>>
> > > >>> Thanks,
> > > >>> -Tao
> > > >>>
> > > >>> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy <
> > > >>> aizhamal@apache.org>
> > > >>> wrote:
> > > >>>
> > > >>> > Thanks everyone for participating in the discussion! I see there
> > is a
> > > >>> > consensus among the community on this regard, therefore we will
> > move
> > > >>> > forward with the process.
> > > >>> >
> > > >>> > Next step is to get IP clearance as described here [1]. This step
> > is
> > > >>> done
> > > >>> > by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has
> > > agreed
> > > >>> to
> > > >>> > help. Thank you!
> > > >>> >
> > > >>> > I am closing this thread now, and Jakob will start a new one when
> > it
> > > is
> > > >>> > time to vote.
> > > >>> >
> > > >>> > Thanks everyone,
> > > >>> > Aizhamal
> > > >>> >
> > > >>> > [1] http://incubator.apache.org/ip-clearance/index.html
> > > >>> >
> > > >>> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <
> > > >>> kamil.bregula@polidea.com>
> > > >>> > wrote:
> > > >>> >
> > > >>> > > +1
> > > >>> > >
> > > >>> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <
> > > >>> Jarek.Potiuk@polidea.com>
> > > >>> > > wrote:
> > > >>> > > >
> > > >>> > > > +1 for aieflow-on-k8s-operator. Good enough :)
> > > >>> > > >
> > > >>> > > > J.
> > > >>> > > >
> > > >>> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <
> > fengtao04@gmail.com
> > > >
> > > >>> > > napisał:
> > > >>> > > >
> > > >>> > > > > +1 on `airflow-on-k8s-operator` as well
> > > >>> > > > >
> > > >>> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <
> ry@rywalker.com>
> > > >>> wrote:
> > > >>> > > > >
> > > >>> > > > > > +1 from me for sure. Thanks for pushing this through
> > > Aizhamal.
> > > >>> > > > > >
> > > >>> > > > > > GCP just named their flink operator (
> > > >>> > > > > >
> > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> > > >>> > > > > > ) *flink-on-k8s-operator.*
> > > >>> > > > > >
> > > >>> > > > > > So  for name, I prefer either *k8s-operator-for-airflow*
> or
> > > >>> > > > > > *airflow-on-k8s-operator*. I sort of like the latter
> better
> > > >>> because
> > > >>> > > > > > *airflow* is the first word rather than the last.
> > > >>> > > > > >
> > > >>> > > > > > -Ry
> > > >>> > > > > >
> > > >>> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
> > > >>> Potiuk@
> > > >>> > > > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > >>> > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > > Fantastic! Strong +1 from me.
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > > To alleviate some of the concerns - we @Polidea are
> just
> > > >>> > starting a
> > > >>> > > > > > > project for big and serious customer where we will most
> > > >>> likely
> > > >>> > use
> > > >>> > > and
> > > >>> > > > > > > extend Kubernetes Operator.
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > > We have 3 people that could become contributors and
> > > >>> commiters day
> > > >>> > > one,
> > > >>> > > > > so
> > > >>> > > > > > > we can already help building community for it. Looking
> > > >>> forward to
> > > >>> > > > > > > following the Apache way in this case !
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > > J.
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@
> > > gmail.
> > > >>> > com (
> > > >>> > > > > > > fengtao04@gmail.com ) > wrote:
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> +1 as well. One question: does the original author
> still
> > > >>> > actively
> > > >>> > > > > > maintain
> > > >>> > > > > > >> or would like to continue maintaining the code base
> > after
> > > >>> the
> > > >>> > > repo is
> > > >>> > > > > > >> moved
> > > >>> > > > > > >>
> > > >>> > > > > > >> to Airflow?
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> > > sumeet.
> > > >>> > manit@
> > > >>> > > > > > gmail. com
> > > >>> > > > > > >> ( sumeet.manit@gmail.com )
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> wrote:
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> Strong +1
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat
> kyzy
> > <
> > > >>> > > aizhamal@
> > > >>> > > > > > apache.
> > > >>> > > > > > >>> org ( aizhamal@apache.org ) >
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> wrote:
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> Hello Airflow community,
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> Over the last year, an engineer at Google developed,
> > and
> > > >>> open
> > > >>> > > > > sourced
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> a
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can
> use
> > it
> > > >>> to
> > > >>> > > deploy
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> Airflow
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> on their k8s cluster freely.
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> There have been discussions among community members
> > that
> > > >>> it
> > > >>> > > would be
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> great
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> to donate the operator to Apache to be part of
> > Airflow.
> > > >>> That
> > > >>> > > way it
> > > >>> > > > > is
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> easy
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> to accept contributions from the community, improve
> > and
> > > >>> > > maintain it
> > > >>> > > > > > >>>> collectively and transparently, along with the
> > > Airflow-k8s
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> integration.
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> This idea has been discussed at Google, and we have
> > > >>> obtained
> > > >>> > all
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> necessary
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> approvals to donate the operator.
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> This discussion is to gather opinions from the
> > community
> > > >>> > > whether you
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> all
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> think that it is a good idea. I personally think
> that
> > > this
> > > >>> > > would be
> > > >>> > > > > a
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> great
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> addition to Airflow.
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> Please express your thoughts or concerns if you have
> > > any.
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> The discussion will run for 72 hours, and if there
> is
> > > >>> > consensus
> > > >>> > > on
> > > >>> > > > > > >>>> accepting the donation, we will move the code under
> > the
> > > >>> Apache
> > > >>> > > > > > >>>> organization, to be owned by the Airflow community.
> If
> > > >>> > > consensus is
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> not
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> evident, we can have a vote after this discussion.
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> Thanks,
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> Aizhamal
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > >
> > > >>> > > > > > Sent via Superhuman (
> https://sprh.mn/?vip=ry@rywalker.com
> > )
> > > >>> > > > > >
> > > >>> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> > > >>> > > > > Jarek.Potiuk@polidea.com
> > > >>> > > > > > > wrote:
> > > >>> > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > > The name is indeed misleading. My proposal would be
> > > >>> > > > > > > k8s-operator-for-airflow - this might make it
> > unambiguous .
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk <
> Jarek.
> > > >>> Potiuk@
> > > >>> > > > > > polidea.
> > > >>> > > > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> Fantastic! Strong +1 from me.
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> To alleviate some of the concerns - we @Polidea are
> just
> > > >>> > starting
> > > >>> > > a
> > > >>> > > > > > >> project for big and serious customer where we will
> most
> > > >>> likely
> > > >>> > > use and
> > > >>> > > > > > >> extend Kubernetes Operator.
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> We have 3 people that could become contributors and
> > > >>> commiters
> > > >>> > day
> > > >>> > > one,
> > > >>> > > > > > so
> > > >>> > > > > > >> we can already help building community for it. Looking
> > > >>> forward
> > > >>> > to
> > > >>> > > > > > >> following the Apache way in this case !
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> J.
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@
> > > >>> gmail.
> > > >>> > com
> > > >>> > > (
> > > >>> > > > > > >> fengtao04@gmail.com ) > wrote:
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> +1 as well. One question: does the original author
> > still
> > > >>> > actively
> > > >>> > > > > > maintain
> > > >>> > > > > > >>> or would like to continue maintaining the code base
> > after
> > > >>> the
> > > >>> > > repo is
> > > >>> > > > > > >>> moved
> > > >>> > > > > > >>> to Airflow?
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> > > sumeet.
> > > >>> > > manit@
> > > >>> > > > > > gmail. com
> > > >>> > > > > > >>> ( sumeet.manit@gmail.com )
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> wrote:
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> Strong +1
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat
> > kyzy <
> > > >>> > > aizhamal@
> > > >>> > > > > > apache.
> > > >>> > > > > > >>>> org ( aizhamal@apache.org ) >
> > > >>> > > > > > >>>> wrote:
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> Hello Airflow community,
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> Over the last year, an engineer at Google
> developed,
> > > and
> > > >>> open
> > > >>> > > > > sourced
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> a
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can
> use
> > > it
> > > >>> to
> > > >>> > > deploy
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> Airflow
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> on their k8s cluster freely.
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> There have been discussions among community members
> > > that
> > > >>> it
> > > >>> > > would
> > > >>> > > > > be
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> great
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> to donate the operator to Apache to be part of
> > Airflow.
> > > >>> That
> > > >>> > > way it
> > > >>> > > > > > is
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> easy
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> to accept contributions from the community, improve
> > and
> > > >>> > > maintain it
> > > >>> > > > > > >>>>> collectively and transparently, along with the
> > > >>> Airflow-k8s
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> integration.
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> This idea has been discussed at Google, and we have
> > > >>> obtained
> > > >>> > > all
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> necessary
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> approvals to donate the operator.
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> This discussion is to gather opinions from the
> > > community
> > > >>> > > whether
> > > >>> > > > > you
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> all
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> think that it is a good idea. I personally think
> that
> > > >>> this
> > > >>> > > would
> > > >>> > > > > be a
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>> great
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> addition to Airflow.
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> Please express your thoughts or concerns if you
> have
> > > any.
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> The discussion will run for 72 hours, and if there
> is
> > > >>> > > consensus on
> > > >>> > > > > > >>>>> accepting the donation, we will move the code under
> > the
> > > >>> > Apache
> > > >>> > > > > > >>>>> organization, to be owned by the Airflow community.
> > If
> > > >>> > > consensus is
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>> not
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> evident, we can have a vote after this discussion.
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> Thanks,
> > > >>> > > > > > >>>>> Aizhamal
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
> > > >>> > > airflow-operator (
> > > >>> > > > > > >>>>>
> > > https://github.com/GoogleCloudPlatform/airflow-operator
> > > >>> )
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>>
> > > >>> > > > > > >>
> > > >>> > > > > > >>
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > > > >
> > > >>> > > > >
> > > >>> > >
> > > >>> >
> > > >>>
> > > >>
> > >
> >
>
>
> --
>
> Jarek Potiuk
> Polidea <https://www.polidea.com/> | Principal Software Engineer
>
> M: +48 660 796 129 <+48%20660%20796%20129> <+48660796129
> <+48%20660%20796%20129>>
> [image: Polidea] <https://www.polidea.com/>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Jarek Potiuk <Ja...@polidea.com>]

Awesome!

On Wed, Jan 15, 2020 at 10:01 PM Kaxil Naik <ka...@gmail.com> wrote:

> Awesome, thanks Aizhamal, Jakob and everyone involved.
>
> On Wed, Jan 15, 2020 at 6:15 PM Aizhamal Nurmamat kyzy <
> aizhamal@apache.org>
> wrote:
>
> > Forgot to clarify that I will create the repo :) Thanks
> >
> > On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy <
> > aizhamal@apache.org>
> > wrote:
> >
> > > Hi everyone,,
> > >
> > > We have finally pushed through the process of getting the IP clearance
> > for
> > > this donation. Thanks for driving a lot of the effort, Jakob!
> > >
> > > As per Apache Infra response [1], we now can create a new
> > > 'airflow-on-k8s-operator' repo under apache/airflow and move the code.
> > >
> > >
> > > [1]
> > >
> >
> https://issues.apache.org/jira/browse/INFRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel
> > >
> > > On Fri, Nov 15, 2019 at 10:46 AM Aizhamal Nurmamat kyzy <
> > > aizhamal@apache.org> wrote:
> > >
> > >> Hi Tao and everyone,
> > >>
> > >> Sorry that we haven't updated you in a while. We have just changed the
> > >> licenses into appropriate ones and currently still dealing with its
> > >> dependencies. But it is moving now. +Jakob Homan <jg...@gmail.com>
> I
> > >> think was about to start a vote soon.
> > >>
> > >> On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fe...@gmail.com>
> wrote:
> > >>
> > >>> Hey,
> > >>>
> > >>> Is the Airflow k8s Operator project now part of airflow code base
> now?
> > Or
> > >>> still waiting for IP clearance?
> > >>>
> > >>> Thanks,
> > >>> -Tao
> > >>>
> > >>> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy <
> > >>> aizhamal@apache.org>
> > >>> wrote:
> > >>>
> > >>> > Thanks everyone for participating in the discussion! I see there
> is a
> > >>> > consensus among the community on this regard, therefore we will
> move
> > >>> > forward with the process.
> > >>> >
> > >>> > Next step is to get IP clearance as described here [1]. This step
> is
> > >>> done
> > >>> > by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has
> > agreed
> > >>> to
> > >>> > help. Thank you!
> > >>> >
> > >>> > I am closing this thread now, and Jakob will start a new one when
> it
> > is
> > >>> > time to vote.
> > >>> >
> > >>> > Thanks everyone,
> > >>> > Aizhamal
> > >>> >
> > >>> > [1] http://incubator.apache.org/ip-clearance/index.html
> > >>> >
> > >>> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <
> > >>> kamil.bregula@polidea.com>
> > >>> > wrote:
> > >>> >
> > >>> > > +1
> > >>> > >
> > >>> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <
> > >>> Jarek.Potiuk@polidea.com>
> > >>> > > wrote:
> > >>> > > >
> > >>> > > > +1 for aieflow-on-k8s-operator. Good enough :)
> > >>> > > >
> > >>> > > > J.
> > >>> > > >
> > >>> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <
> fengtao04@gmail.com
> > >
> > >>> > > napisał:
> > >>> > > >
> > >>> > > > > +1 on `airflow-on-k8s-operator` as well
> > >>> > > > >
> > >>> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com>
> > >>> wrote:
> > >>> > > > >
> > >>> > > > > > +1 from me for sure. Thanks for pushing this through
> > Aizhamal.
> > >>> > > > > >
> > >>> > > > > > GCP just named their flink operator (
> > >>> > > > > >
> https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> > >>> > > > > > ) *flink-on-k8s-operator.*
> > >>> > > > > >
> > >>> > > > > > So  for name, I prefer either *k8s-operator-for-airflow* or
> > >>> > > > > > *airflow-on-k8s-operator*. I sort of like the latter better
> > >>> because
> > >>> > > > > > *airflow* is the first word rather than the last.
> > >>> > > > > >
> > >>> > > > > > -Ry
> > >>> > > > > >
> > >>> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
> > >>> Potiuk@
> > >>> > > > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> > >>> > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > > Fantastic! Strong +1 from me.
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > > To alleviate some of the concerns - we @Polidea are just
> > >>> > starting a
> > >>> > > > > > > project for big and serious customer where we will most
> > >>> likely
> > >>> > use
> > >>> > > and
> > >>> > > > > > > extend Kubernetes Operator.
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > > We have 3 people that could become contributors and
> > >>> commiters day
> > >>> > > one,
> > >>> > > > > so
> > >>> > > > > > > we can already help building community for it. Looking
> > >>> forward to
> > >>> > > > > > > following the Apache way in this case !
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > > J.
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@
> > gmail.
> > >>> > com (
> > >>> > > > > > > fengtao04@gmail.com ) > wrote:
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> +1 as well. One question: does the original author still
> > >>> > actively
> > >>> > > > > > maintain
> > >>> > > > > > >> or would like to continue maintaining the code base
> after
> > >>> the
> > >>> > > repo is
> > >>> > > > > > >> moved
> > >>> > > > > > >>
> > >>> > > > > > >> to Airflow?
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> > sumeet.
> > >>> > manit@
> > >>> > > > > > gmail. com
> > >>> > > > > > >> ( sumeet.manit@gmail.com )
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> wrote:
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> Strong +1
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy
> <
> > >>> > > aizhamal@
> > >>> > > > > > apache.
> > >>> > > > > > >>> org ( aizhamal@apache.org ) >
> > >>> > > > > > >>>
> > >>> > > > > > >>> wrote:
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> Hello Airflow community,
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> Over the last year, an engineer at Google developed,
> and
> > >>> open
> > >>> > > > > sourced
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> a
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use
> it
> > >>> to
> > >>> > > deploy
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> Airflow
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> on their k8s cluster freely.
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> There have been discussions among community members
> that
> > >>> it
> > >>> > > would be
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> great
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> to donate the operator to Apache to be part of
> Airflow.
> > >>> That
> > >>> > > way it
> > >>> > > > > is
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> easy
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> to accept contributions from the community, improve
> and
> > >>> > > maintain it
> > >>> > > > > > >>>> collectively and transparently, along with the
> > Airflow-k8s
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> integration.
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> This idea has been discussed at Google, and we have
> > >>> obtained
> > >>> > all
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> necessary
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> approvals to donate the operator.
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> This discussion is to gather opinions from the
> community
> > >>> > > whether you
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> all
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> think that it is a good idea. I personally think that
> > this
> > >>> > > would be
> > >>> > > > > a
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> great
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> addition to Airflow.
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> Please express your thoughts or concerns if you have
> > any.
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> The discussion will run for 72 hours, and if there is
> > >>> > consensus
> > >>> > > on
> > >>> > > > > > >>>> accepting the donation, we will move the code under
> the
> > >>> Apache
> > >>> > > > > > >>>> organization, to be owned by the Airflow community. If
> > >>> > > consensus is
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> not
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> evident, we can have a vote after this discussion.
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> Thanks,
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> Aizhamal
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > >
> > >>> > > > > > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com
> )
> > >>> > > > > >
> > >>> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> > >>> > > > > Jarek.Potiuk@polidea.com
> > >>> > > > > > > wrote:
> > >>> > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > > The name is indeed misleading. My proposal would be
> > >>> > > > > > > k8s-operator-for-airflow - this might make it
> unambiguous .
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
> > >>> Potiuk@
> > >>> > > > > > polidea.
> > >>> > > > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> Fantastic! Strong +1 from me.
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> To alleviate some of the concerns - we @Polidea are just
> > >>> > starting
> > >>> > > a
> > >>> > > > > > >> project for big and serious customer where we will most
> > >>> likely
> > >>> > > use and
> > >>> > > > > > >> extend Kubernetes Operator.
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> We have 3 people that could become contributors and
> > >>> commiters
> > >>> > day
> > >>> > > one,
> > >>> > > > > > so
> > >>> > > > > > >> we can already help building community for it. Looking
> > >>> forward
> > >>> > to
> > >>> > > > > > >> following the Apache way in this case !
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> J.
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@
> > >>> gmail.
> > >>> > com
> > >>> > > (
> > >>> > > > > > >> fengtao04@gmail.com ) > wrote:
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> +1 as well. One question: does the original author
> still
> > >>> > actively
> > >>> > > > > > maintain
> > >>> > > > > > >>> or would like to continue maintaining the code base
> after
> > >>> the
> > >>> > > repo is
> > >>> > > > > > >>> moved
> > >>> > > > > > >>> to Airflow?
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> > sumeet.
> > >>> > > manit@
> > >>> > > > > > gmail. com
> > >>> > > > > > >>> ( sumeet.manit@gmail.com )
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> wrote:
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> Strong +1
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat
> kyzy <
> > >>> > > aizhamal@
> > >>> > > > > > apache.
> > >>> > > > > > >>>> org ( aizhamal@apache.org ) >
> > >>> > > > > > >>>> wrote:
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> Hello Airflow community,
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> Over the last year, an engineer at Google developed,
> > and
> > >>> open
> > >>> > > > > sourced
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> a
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use
> > it
> > >>> to
> > >>> > > deploy
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> Airflow
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> on their k8s cluster freely.
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> There have been discussions among community members
> > that
> > >>> it
> > >>> > > would
> > >>> > > > > be
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> great
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> to donate the operator to Apache to be part of
> Airflow.
> > >>> That
> > >>> > > way it
> > >>> > > > > > is
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> easy
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> to accept contributions from the community, improve
> and
> > >>> > > maintain it
> > >>> > > > > > >>>>> collectively and transparently, along with the
> > >>> Airflow-k8s
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> integration.
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> This idea has been discussed at Google, and we have
> > >>> obtained
> > >>> > > all
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> necessary
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> approvals to donate the operator.
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> This discussion is to gather opinions from the
> > community
> > >>> > > whether
> > >>> > > > > you
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> all
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> think that it is a good idea. I personally think that
> > >>> this
> > >>> > > would
> > >>> > > > > be a
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>> great
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> addition to Airflow.
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> Please express your thoughts or concerns if you have
> > any.
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> The discussion will run for 72 hours, and if there is
> > >>> > > consensus on
> > >>> > > > > > >>>>> accepting the donation, we will move the code under
> the
> > >>> > Apache
> > >>> > > > > > >>>>> organization, to be owned by the Airflow community.
> If
> > >>> > > consensus is
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>> not
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> evident, we can have a vote after this discussion.
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> Thanks,
> > >>> > > > > > >>>>> Aizhamal
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
> > >>> > > airflow-operator (
> > >>> > > > > > >>>>>
> > https://github.com/GoogleCloudPlatform/airflow-operator
> > >>> )
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>>
> > >>> > > > > > >>>
> > >>> > > > > > >>>
> > >>> > > > > > >>
> > >>> > > > > > >>
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > > > >
> > >>> > > > >
> > >>> > >
> > >>> >
> > >>>
> > >>
> >
>


-- 

Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer

M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>

Re: [DISCUSS] Donating Airflow k8s Operator

[Kaxil Naik <ka...@gmail.com>]

Awesome, thanks Aizhamal, Jakob and everyone involved.

On Wed, Jan 15, 2020 at 6:15 PM Aizhamal Nurmamat kyzy <ai...@apache.org>
wrote:

> Forgot to clarify that I will create the repo :) Thanks
>
> On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy <
> aizhamal@apache.org>
> wrote:
>
> > Hi everyone,,
> >
> > We have finally pushed through the process of getting the IP clearance
> for
> > this donation. Thanks for driving a lot of the effort, Jakob!
> >
> > As per Apache Infra response [1], we now can create a new
> > 'airflow-on-k8s-operator' repo under apache/airflow and move the code.
> >
> >
> > [1]
> >
> https://issues.apache.org/jira/browse/INFRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel
> >
> > On Fri, Nov 15, 2019 at 10:46 AM Aizhamal Nurmamat kyzy <
> > aizhamal@apache.org> wrote:
> >
> >> Hi Tao and everyone,
> >>
> >> Sorry that we haven't updated you in a while. We have just changed the
> >> licenses into appropriate ones and currently still dealing with its
> >> dependencies. But it is moving now. +Jakob Homan <jg...@gmail.com> I
> >> think was about to start a vote soon.
> >>
> >> On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fe...@gmail.com> wrote:
> >>
> >>> Hey,
> >>>
> >>> Is the Airflow k8s Operator project now part of airflow code base now?
> Or
> >>> still waiting for IP clearance?
> >>>
> >>> Thanks,
> >>> -Tao
> >>>
> >>> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy <
> >>> aizhamal@apache.org>
> >>> wrote:
> >>>
> >>> > Thanks everyone for participating in the discussion! I see there is a
> >>> > consensus among the community on this regard, therefore we will move
> >>> > forward with the process.
> >>> >
> >>> > Next step is to get IP clearance as described here [1]. This step is
> >>> done
> >>> > by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has
> agreed
> >>> to
> >>> > help. Thank you!
> >>> >
> >>> > I am closing this thread now, and Jakob will start a new one when it
> is
> >>> > time to vote.
> >>> >
> >>> > Thanks everyone,
> >>> > Aizhamal
> >>> >
> >>> > [1] http://incubator.apache.org/ip-clearance/index.html
> >>> >
> >>> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <
> >>> kamil.bregula@polidea.com>
> >>> > wrote:
> >>> >
> >>> > > +1
> >>> > >
> >>> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <
> >>> Jarek.Potiuk@polidea.com>
> >>> > > wrote:
> >>> > > >
> >>> > > > +1 for aieflow-on-k8s-operator. Good enough :)
> >>> > > >
> >>> > > > J.
> >>> > > >
> >>> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fengtao04@gmail.com
> >
> >>> > > napisał:
> >>> > > >
> >>> > > > > +1 on `airflow-on-k8s-operator` as well
> >>> > > > >
> >>> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com>
> >>> wrote:
> >>> > > > >
> >>> > > > > > +1 from me for sure. Thanks for pushing this through
> Aizhamal.
> >>> > > > > >
> >>> > > > > > GCP just named their flink operator (
> >>> > > > > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> >>> > > > > > ) *flink-on-k8s-operator.*
> >>> > > > > >
> >>> > > > > > So  for name, I prefer either *k8s-operator-for-airflow* or
> >>> > > > > > *airflow-on-k8s-operator*. I sort of like the latter better
> >>> because
> >>> > > > > > *airflow* is the first word rather than the last.
> >>> > > > > >
> >>> > > > > > -Ry
> >>> > > > > >
> >>> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
> >>> Potiuk@
> >>> > > > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> >>> > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > > Fantastic! Strong +1 from me.
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > > To alleviate some of the concerns - we @Polidea are just
> >>> > starting a
> >>> > > > > > > project for big and serious customer where we will most
> >>> likely
> >>> > use
> >>> > > and
> >>> > > > > > > extend Kubernetes Operator.
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > > We have 3 people that could become contributors and
> >>> commiters day
> >>> > > one,
> >>> > > > > so
> >>> > > > > > > we can already help building community for it. Looking
> >>> forward to
> >>> > > > > > > following the Apache way in this case !
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > > J.
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@
> gmail.
> >>> > com (
> >>> > > > > > > fengtao04@gmail.com ) > wrote:
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> +1 as well. One question: does the original author still
> >>> > actively
> >>> > > > > > maintain
> >>> > > > > > >> or would like to continue maintaining the code base after
> >>> the
> >>> > > repo is
> >>> > > > > > >> moved
> >>> > > > > > >>
> >>> > > > > > >> to Airflow?
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> sumeet.
> >>> > manit@
> >>> > > > > > gmail. com
> >>> > > > > > >> ( sumeet.manit@gmail.com )
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> wrote:
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> Strong +1
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> >>> > > aizhamal@
> >>> > > > > > apache.
> >>> > > > > > >>> org ( aizhamal@apache.org ) >
> >>> > > > > > >>>
> >>> > > > > > >>> wrote:
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> Hello Airflow community,
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> Over the last year, an engineer at Google developed, and
> >>> open
> >>> > > > > sourced
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> a
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it
> >>> to
> >>> > > deploy
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> Airflow
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> on their k8s cluster freely.
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> There have been discussions among community members that
> >>> it
> >>> > > would be
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> great
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> to donate the operator to Apache to be part of Airflow.
> >>> That
> >>> > > way it
> >>> > > > > is
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> easy
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> to accept contributions from the community, improve and
> >>> > > maintain it
> >>> > > > > > >>>> collectively and transparently, along with the
> Airflow-k8s
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> integration.
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> This idea has been discussed at Google, and we have
> >>> obtained
> >>> > all
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> necessary
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> approvals to donate the operator.
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> This discussion is to gather opinions from the community
> >>> > > whether you
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> all
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> think that it is a good idea. I personally think that
> this
> >>> > > would be
> >>> > > > > a
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> great
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> addition to Airflow.
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> Please express your thoughts or concerns if you have
> any.
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> The discussion will run for 72 hours, and if there is
> >>> > consensus
> >>> > > on
> >>> > > > > > >>>> accepting the donation, we will move the code under the
> >>> Apache
> >>> > > > > > >>>> organization, to be owned by the Airflow community. If
> >>> > > consensus is
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> not
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> evident, we can have a vote after this discussion.
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> Thanks,
> >>> > > > > > >>>>
> >>> > > > > > >>>> Aizhamal
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > >
> >>> > > > > > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
> >>> > > > > >
> >>> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> >>> > > > > Jarek.Potiuk@polidea.com
> >>> > > > > > > wrote:
> >>> > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > > The name is indeed misleading. My proposal would be
> >>> > > > > > > k8s-operator-for-airflow - this might make it unambiguous .
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
> >>> Potiuk@
> >>> > > > > > polidea.
> >>> > > > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> Fantastic! Strong +1 from me.
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> To alleviate some of the concerns - we @Polidea are just
> >>> > starting
> >>> > > a
> >>> > > > > > >> project for big and serious customer where we will most
> >>> likely
> >>> > > use and
> >>> > > > > > >> extend Kubernetes Operator.
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> We have 3 people that could become contributors and
> >>> commiters
> >>> > day
> >>> > > one,
> >>> > > > > > so
> >>> > > > > > >> we can already help building community for it. Looking
> >>> forward
> >>> > to
> >>> > > > > > >> following the Apache way in this case !
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> J.
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@
> >>> gmail.
> >>> > com
> >>> > > (
> >>> > > > > > >> fengtao04@gmail.com ) > wrote:
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> +1 as well. One question: does the original author still
> >>> > actively
> >>> > > > > > maintain
> >>> > > > > > >>> or would like to continue maintaining the code base after
> >>> the
> >>> > > repo is
> >>> > > > > > >>> moved
> >>> > > > > > >>> to Airflow?
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> sumeet.
> >>> > > manit@
> >>> > > > > > gmail. com
> >>> > > > > > >>> ( sumeet.manit@gmail.com )
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> wrote:
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> Strong +1
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> >>> > > aizhamal@
> >>> > > > > > apache.
> >>> > > > > > >>>> org ( aizhamal@apache.org ) >
> >>> > > > > > >>>> wrote:
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> Hello Airflow community,
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> Over the last year, an engineer at Google developed,
> and
> >>> open
> >>> > > > > sourced
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> a
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use
> it
> >>> to
> >>> > > deploy
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> Airflow
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> on their k8s cluster freely.
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> There have been discussions among community members
> that
> >>> it
> >>> > > would
> >>> > > > > be
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> great
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> to donate the operator to Apache to be part of Airflow.
> >>> That
> >>> > > way it
> >>> > > > > > is
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> easy
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> to accept contributions from the community, improve and
> >>> > > maintain it
> >>> > > > > > >>>>> collectively and transparently, along with the
> >>> Airflow-k8s
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> integration.
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> This idea has been discussed at Google, and we have
> >>> obtained
> >>> > > all
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> necessary
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> approvals to donate the operator.
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> This discussion is to gather opinions from the
> community
> >>> > > whether
> >>> > > > > you
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> all
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> think that it is a good idea. I personally think that
> >>> this
> >>> > > would
> >>> > > > > be a
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>> great
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> addition to Airflow.
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> Please express your thoughts or concerns if you have
> any.
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> The discussion will run for 72 hours, and if there is
> >>> > > consensus on
> >>> > > > > > >>>>> accepting the donation, we will move the code under the
> >>> > Apache
> >>> > > > > > >>>>> organization, to be owned by the Airflow community. If
> >>> > > consensus is
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>> not
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> evident, we can have a vote after this discussion.
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> Thanks,
> >>> > > > > > >>>>> Aizhamal
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
> >>> > > airflow-operator (
> >>> > > > > > >>>>>
> https://github.com/GoogleCloudPlatform/airflow-operator
> >>> )
> >>> > > > > > >>>>>
> >>> > > > > > >>>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>>
> >>> > > > > > >>>
> >>> > > > > > >>>
> >>> > > > > > >>
> >>> > > > > > >>
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > > > >
> >>> > > > >
> >>> > >
> >>> >
> >>>
> >>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Aizhamal Nurmamat kyzy <ai...@apache.org>]

Forgot to clarify that I will create the repo :) Thanks

On Wed, Jan 15, 2020 at 10:07 AM Aizhamal Nurmamat kyzy <ai...@apache.org>
wrote:

> Hi everyone,,
>
> We have finally pushed through the process of getting the IP clearance for
> this donation. Thanks for driving a lot of the effort, Jakob!
>
> As per Apache Infra response [1], we now can create a new
> 'airflow-on-k8s-operator' repo under apache/airflow and move the code.
>
>
> [1]
> https://issues.apache.org/jira/browse/INFRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel
>
> On Fri, Nov 15, 2019 at 10:46 AM Aizhamal Nurmamat kyzy <
> aizhamal@apache.org> wrote:
>
>> Hi Tao and everyone,
>>
>> Sorry that we haven't updated you in a while. We have just changed the
>> licenses into appropriate ones and currently still dealing with its
>> dependencies. But it is moving now. +Jakob Homan <jg...@gmail.com> I
>> think was about to start a vote soon.
>>
>> On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fe...@gmail.com> wrote:
>>
>>> Hey,
>>>
>>> Is the Airflow k8s Operator project now part of airflow code base now? Or
>>> still waiting for IP clearance?
>>>
>>> Thanks,
>>> -Tao
>>>
>>> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy <
>>> aizhamal@apache.org>
>>> wrote:
>>>
>>> > Thanks everyone for participating in the discussion! I see there is a
>>> > consensus among the community on this regard, therefore we will move
>>> > forward with the process.
>>> >
>>> > Next step is to get IP clearance as described here [1]. This step is
>>> done
>>> > by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has agreed
>>> to
>>> > help. Thank you!
>>> >
>>> > I am closing this thread now, and Jakob will start a new one when it is
>>> > time to vote.
>>> >
>>> > Thanks everyone,
>>> > Aizhamal
>>> >
>>> > [1] http://incubator.apache.org/ip-clearance/index.html
>>> >
>>> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <
>>> kamil.bregula@polidea.com>
>>> > wrote:
>>> >
>>> > > +1
>>> > >
>>> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <
>>> Jarek.Potiuk@polidea.com>
>>> > > wrote:
>>> > > >
>>> > > > +1 for aieflow-on-k8s-operator. Good enough :)
>>> > > >
>>> > > > J.
>>> > > >
>>> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fe...@gmail.com>
>>> > > napisał:
>>> > > >
>>> > > > > +1 on `airflow-on-k8s-operator` as well
>>> > > > >
>>> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com>
>>> wrote:
>>> > > > >
>>> > > > > > +1 from me for sure. Thanks for pushing this through Aizhamal.
>>> > > > > >
>>> > > > > > GCP just named their flink operator (
>>> > > > > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
>>> > > > > > ) *flink-on-k8s-operator.*
>>> > > > > >
>>> > > > > > So  for name, I prefer either *k8s-operator-for-airflow* or
>>> > > > > > *airflow-on-k8s-operator*. I sort of like the latter better
>>> because
>>> > > > > > *airflow* is the first word rather than the last.
>>> > > > > >
>>> > > > > > -Ry
>>> > > > > >
>>> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
>>> Potiuk@
>>> > > > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
>>> > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > > Fantastic! Strong +1 from me.
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > > To alleviate some of the concerns - we @Polidea are just
>>> > starting a
>>> > > > > > > project for big and serious customer where we will most
>>> likely
>>> > use
>>> > > and
>>> > > > > > > extend Kubernetes Operator.
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > > We have 3 people that could become contributors and
>>> commiters day
>>> > > one,
>>> > > > > so
>>> > > > > > > we can already help building community for it. Looking
>>> forward to
>>> > > > > > > following the Apache way in this case !
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > > J.
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail.
>>> > com (
>>> > > > > > > fengtao04@gmail.com ) > wrote:
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> +1 as well. One question: does the original author still
>>> > actively
>>> > > > > > maintain
>>> > > > > > >> or would like to continue maintaining the code base after
>>> the
>>> > > repo is
>>> > > > > > >> moved
>>> > > > > > >>
>>> > > > > > >> to Airflow?
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
>>> > manit@
>>> > > > > > gmail. com
>>> > > > > > >> ( sumeet.manit@gmail.com )
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> wrote:
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> Strong +1
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
>>> > > aizhamal@
>>> > > > > > apache.
>>> > > > > > >>> org ( aizhamal@apache.org ) >
>>> > > > > > >>>
>>> > > > > > >>> wrote:
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> Hello Airflow community,
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> Over the last year, an engineer at Google developed, and
>>> open
>>> > > > > sourced
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> a
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it
>>> to
>>> > > deploy
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> Airflow
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> on their k8s cluster freely.
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> There have been discussions among community members that
>>> it
>>> > > would be
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> great
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> to donate the operator to Apache to be part of Airflow.
>>> That
>>> > > way it
>>> > > > > is
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> easy
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> to accept contributions from the community, improve and
>>> > > maintain it
>>> > > > > > >>>> collectively and transparently, along with the Airflow-k8s
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> integration.
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> This idea has been discussed at Google, and we have
>>> obtained
>>> > all
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> necessary
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> approvals to donate the operator.
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> This discussion is to gather opinions from the community
>>> > > whether you
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> all
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> think that it is a good idea. I personally think that this
>>> > > would be
>>> > > > > a
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> great
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> addition to Airflow.
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> Please express your thoughts or concerns if you have any.
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> The discussion will run for 72 hours, and if there is
>>> > consensus
>>> > > on
>>> > > > > > >>>> accepting the donation, we will move the code under the
>>> Apache
>>> > > > > > >>>> organization, to be owned by the Airflow community. If
>>> > > consensus is
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> not
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> evident, we can have a vote after this discussion.
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> Thanks,
>>> > > > > > >>>>
>>> > > > > > >>>> Aizhamal
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >
>>> > > > > > >
>>> > > > > >
>>> > > > > > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
>>> > > > > >
>>> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
>>> > > > > Jarek.Potiuk@polidea.com
>>> > > > > > > wrote:
>>> > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > > The name is indeed misleading. My proposal would be
>>> > > > > > > k8s-operator-for-airflow - this might make it unambiguous .
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
>>> Potiuk@
>>> > > > > > polidea.
>>> > > > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> Fantastic! Strong +1 from me.
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> To alleviate some of the concerns - we @Polidea are just
>>> > starting
>>> > > a
>>> > > > > > >> project for big and serious customer where we will most
>>> likely
>>> > > use and
>>> > > > > > >> extend Kubernetes Operator.
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> We have 3 people that could become contributors and
>>> commiters
>>> > day
>>> > > one,
>>> > > > > > so
>>> > > > > > >> we can already help building community for it. Looking
>>> forward
>>> > to
>>> > > > > > >> following the Apache way in this case !
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> J.
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@
>>> gmail.
>>> > com
>>> > > (
>>> > > > > > >> fengtao04@gmail.com ) > wrote:
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> +1 as well. One question: does the original author still
>>> > actively
>>> > > > > > maintain
>>> > > > > > >>> or would like to continue maintaining the code base after
>>> the
>>> > > repo is
>>> > > > > > >>> moved
>>> > > > > > >>> to Airflow?
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
>>> > > manit@
>>> > > > > > gmail. com
>>> > > > > > >>> ( sumeet.manit@gmail.com )
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> wrote:
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> Strong +1
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
>>> > > aizhamal@
>>> > > > > > apache.
>>> > > > > > >>>> org ( aizhamal@apache.org ) >
>>> > > > > > >>>> wrote:
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> Hello Airflow community,
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> Over the last year, an engineer at Google developed, and
>>> open
>>> > > > > sourced
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> a
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it
>>> to
>>> > > deploy
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> Airflow
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> on their k8s cluster freely.
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> There have been discussions among community members that
>>> it
>>> > > would
>>> > > > > be
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> great
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> to donate the operator to Apache to be part of Airflow.
>>> That
>>> > > way it
>>> > > > > > is
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> easy
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> to accept contributions from the community, improve and
>>> > > maintain it
>>> > > > > > >>>>> collectively and transparently, along with the
>>> Airflow-k8s
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> integration.
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> This idea has been discussed at Google, and we have
>>> obtained
>>> > > all
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> necessary
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> approvals to donate the operator.
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> This discussion is to gather opinions from the community
>>> > > whether
>>> > > > > you
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> all
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> think that it is a good idea. I personally think that
>>> this
>>> > > would
>>> > > > > be a
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>> great
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> addition to Airflow.
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> Please express your thoughts or concerns if you have any.
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> The discussion will run for 72 hours, and if there is
>>> > > consensus on
>>> > > > > > >>>>> accepting the donation, we will move the code under the
>>> > Apache
>>> > > > > > >>>>> organization, to be owned by the Airflow community. If
>>> > > consensus is
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>> not
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> evident, we can have a vote after this discussion.
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> Thanks,
>>> > > > > > >>>>> Aizhamal
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
>>> > > airflow-operator (
>>> > > > > > >>>>> https://github.com/GoogleCloudPlatform/airflow-operator
>>> )
>>> > > > > > >>>>>
>>> > > > > > >>>>>
>>> > > > > > >>>>
>>> > > > > > >>>>
>>> > > > > > >>>
>>> > > > > > >>>
>>> > > > > > >>
>>> > > > > > >>
>>> > > > > > >
>>> > > > > > >
>>> > > > > > >
>>> > > > >
>>> > >
>>> >
>>>
>>

Re: [DISCUSS] Donating Airflow k8s Operator

[Aizhamal Nurmamat kyzy <ai...@apache.org>]

Hi everyone,,

We have finally pushed through the process of getting the IP clearance for
this donation. Thanks for driving a lot of the effort, Jakob!

As per Apache Infra response [1], we now can create a new
'airflow-on-k8s-operator' repo under apache/airflow and move the code.


[1]
https://issues.apache.org/jira/browse/INFRA-19715?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel

On Fri, Nov 15, 2019 at 10:46 AM Aizhamal Nurmamat kyzy <ai...@apache.org>
wrote:

> Hi Tao and everyone,
>
> Sorry that we haven't updated you in a while. We have just changed the
> licenses into appropriate ones and currently still dealing with its
> dependencies. But it is moving now. +Jakob Homan <jg...@gmail.com> I
> think was about to start a vote soon.
>
> On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fe...@gmail.com> wrote:
>
>> Hey,
>>
>> Is the Airflow k8s Operator project now part of airflow code base now? Or
>> still waiting for IP clearance?
>>
>> Thanks,
>> -Tao
>>
>> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy <
>> aizhamal@apache.org>
>> wrote:
>>
>> > Thanks everyone for participating in the discussion! I see there is a
>> > consensus among the community on this regard, therefore we will move
>> > forward with the process.
>> >
>> > Next step is to get IP clearance as described here [1]. This step is
>> done
>> > by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has agreed
>> to
>> > help. Thank you!
>> >
>> > I am closing this thread now, and Jakob will start a new one when it is
>> > time to vote.
>> >
>> > Thanks everyone,
>> > Aizhamal
>> >
>> > [1] http://incubator.apache.org/ip-clearance/index.html
>> >
>> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <
>> kamil.bregula@polidea.com>
>> > wrote:
>> >
>> > > +1
>> > >
>> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <
>> Jarek.Potiuk@polidea.com>
>> > > wrote:
>> > > >
>> > > > +1 for aieflow-on-k8s-operator. Good enough :)
>> > > >
>> > > > J.
>> > > >
>> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fe...@gmail.com>
>> > > napisał:
>> > > >
>> > > > > +1 on `airflow-on-k8s-operator` as well
>> > > > >
>> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com>
>> wrote:
>> > > > >
>> > > > > > +1 from me for sure. Thanks for pushing this through Aizhamal.
>> > > > > >
>> > > > > > GCP just named their flink operator (
>> > > > > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
>> > > > > > ) *flink-on-k8s-operator.*
>> > > > > >
>> > > > > > So  for name, I prefer either *k8s-operator-for-airflow* or
>> > > > > > *airflow-on-k8s-operator*. I sort of like the latter better
>> because
>> > > > > > *airflow* is the first word rather than the last.
>> > > > > >
>> > > > > > -Ry
>> > > > > >
>> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
>> Potiuk@
>> > > > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
>> > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > Fantastic! Strong +1 from me.
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > To alleviate some of the concerns - we @Polidea are just
>> > starting a
>> > > > > > > project for big and serious customer where we will most likely
>> > use
>> > > and
>> > > > > > > extend Kubernetes Operator.
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > We have 3 people that could become contributors and commiters
>> day
>> > > one,
>> > > > > so
>> > > > > > > we can already help building community for it. Looking
>> forward to
>> > > > > > > following the Apache way in this case !
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > J.
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail.
>> > com (
>> > > > > > > fengtao04@gmail.com ) > wrote:
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> +1 as well. One question: does the original author still
>> > actively
>> > > > > > maintain
>> > > > > > >> or would like to continue maintaining the code base after the
>> > > repo is
>> > > > > > >> moved
>> > > > > > >>
>> > > > > > >> to Airflow?
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
>> > manit@
>> > > > > > gmail. com
>> > > > > > >> ( sumeet.manit@gmail.com )
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> wrote:
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> Strong +1
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
>> > > aizhamal@
>> > > > > > apache.
>> > > > > > >>> org ( aizhamal@apache.org ) >
>> > > > > > >>>
>> > > > > > >>> wrote:
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Hello Airflow community,
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Over the last year, an engineer at Google developed, and
>> open
>> > > > > sourced
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> a
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it to
>> > > deploy
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> Airflow
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> on their k8s cluster freely.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> There have been discussions among community members that it
>> > > would be
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> great
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> to donate the operator to Apache to be part of Airflow.
>> That
>> > > way it
>> > > > > is
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> easy
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> to accept contributions from the community, improve and
>> > > maintain it
>> > > > > > >>>> collectively and transparently, along with the Airflow-k8s
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> integration.
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> This idea has been discussed at Google, and we have
>> obtained
>> > all
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> necessary
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> approvals to donate the operator.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> This discussion is to gather opinions from the community
>> > > whether you
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> all
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> think that it is a good idea. I personally think that this
>> > > would be
>> > > > > a
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> great
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> addition to Airflow.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Please express your thoughts or concerns if you have any.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> The discussion will run for 72 hours, and if there is
>> > consensus
>> > > on
>> > > > > > >>>> accepting the donation, we will move the code under the
>> Apache
>> > > > > > >>>> organization, to be owned by the Airflow community. If
>> > > consensus is
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> not
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> evident, we can have a vote after this discussion.
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Thanks,
>> > > > > > >>>>
>> > > > > > >>>> Aizhamal
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > > > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
>> > > > > >
>> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
>> > > > > Jarek.Potiuk@polidea.com
>> > > > > > > wrote:
>> > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > The name is indeed misleading. My proposal would be
>> > > > > > > k8s-operator-for-airflow - this might make it unambiguous .
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
>> Potiuk@
>> > > > > > polidea.
>> > > > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
>> > > > > > >
>> > > > > > >
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> Fantastic! Strong +1 from me.
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> To alleviate some of the concerns - we @Polidea are just
>> > starting
>> > > a
>> > > > > > >> project for big and serious customer where we will most
>> likely
>> > > use and
>> > > > > > >> extend Kubernetes Operator.
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> We have 3 people that could become contributors and commiters
>> > day
>> > > one,
>> > > > > > so
>> > > > > > >> we can already help building community for it. Looking
>> forward
>> > to
>> > > > > > >> following the Apache way in this case !
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> J.
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail.
>> > com
>> > > (
>> > > > > > >> fengtao04@gmail.com ) > wrote:
>> > > > > > >>
>> > > > > > >>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> +1 as well. One question: does the original author still
>> > actively
>> > > > > > maintain
>> > > > > > >>> or would like to continue maintaining the code base after
>> the
>> > > repo is
>> > > > > > >>> moved
>> > > > > > >>> to Airflow?
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
>> > > manit@
>> > > > > > gmail. com
>> > > > > > >>> ( sumeet.manit@gmail.com )
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> wrote:
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Strong +1
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
>> > > aizhamal@
>> > > > > > apache.
>> > > > > > >>>> org ( aizhamal@apache.org ) >
>> > > > > > >>>> wrote:
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> Hello Airflow community,
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> Over the last year, an engineer at Google developed, and
>> open
>> > > > > sourced
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> a
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it
>> to
>> > > deploy
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> Airflow
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> on their k8s cluster freely.
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> There have been discussions among community members that
>> it
>> > > would
>> > > > > be
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> great
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> to donate the operator to Apache to be part of Airflow.
>> That
>> > > way it
>> > > > > > is
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> easy
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> to accept contributions from the community, improve and
>> > > maintain it
>> > > > > > >>>>> collectively and transparently, along with the Airflow-k8s
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> integration.
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> This idea has been discussed at Google, and we have
>> obtained
>> > > all
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> necessary
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> approvals to donate the operator.
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> This discussion is to gather opinions from the community
>> > > whether
>> > > > > you
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> all
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> think that it is a good idea. I personally think that this
>> > > would
>> > > > > be a
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>> great
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> addition to Airflow.
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> Please express your thoughts or concerns if you have any.
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> The discussion will run for 72 hours, and if there is
>> > > consensus on
>> > > > > > >>>>> accepting the donation, we will move the code under the
>> > Apache
>> > > > > > >>>>> organization, to be owned by the Airflow community. If
>> > > consensus is
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>> not
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> evident, we can have a vote after this discussion.
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> Thanks,
>> > > > > > >>>>> Aizhamal
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
>> > > airflow-operator (
>> > > > > > >>>>> https://github.com/GoogleCloudPlatform/airflow-operator )
>> > > > > > >>>>>
>> > > > > > >>>>>
>> > > > > > >>>>
>> > > > > > >>>>
>> > > > > > >>>
>> > > > > > >>>
>> > > > > > >>
>> > > > > > >>
>> > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > >
>> > >
>> >
>>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Aizhamal Nurmamat kyzy <ai...@apache.org>]

Hi Tao and everyone,

Sorry that we haven't updated you in a while. We have just changed the
licenses into appropriate ones and currently still dealing with its
dependencies. But it is moving now. +Jakob Homan <jg...@gmail.com> I
think was about to start a vote soon.

On Fri, Nov 15, 2019 at 12:13 AM Tao Feng <fe...@gmail.com> wrote:

> Hey,
>
> Is the Airflow k8s Operator project now part of airflow code base now? Or
> still waiting for IP clearance?
>
> Thanks,
> -Tao
>
> On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy <
> aizhamal@apache.org>
> wrote:
>
> > Thanks everyone for participating in the discussion! I see there is a
> > consensus among the community on this regard, therefore we will move
> > forward with the process.
> >
> > Next step is to get IP clearance as described here [1]. This step is done
> > by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has agreed to
> > help. Thank you!
> >
> > I am closing this thread now, and Jakob will start a new one when it is
> > time to vote.
> >
> > Thanks everyone,
> > Aizhamal
> >
> > [1] http://incubator.apache.org/ip-clearance/index.html
> >
> > On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <
> kamil.bregula@polidea.com>
> > wrote:
> >
> > > +1
> > >
> > > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <Jarek.Potiuk@polidea.com
> >
> > > wrote:
> > > >
> > > > +1 for aieflow-on-k8s-operator. Good enough :)
> > > >
> > > > J.
> > > >
> > > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fe...@gmail.com>
> > > napisał:
> > > >
> > > > > +1 on `airflow-on-k8s-operator` as well
> > > > >
> > > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com>
> wrote:
> > > > >
> > > > > > +1 from me for sure. Thanks for pushing this through Aizhamal.
> > > > > >
> > > > > > GCP just named their flink operator (
> > > > > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> > > > > > ) *flink-on-k8s-operator.*
> > > > > >
> > > > > > So  for name, I prefer either *k8s-operator-for-airflow* or
> > > > > > *airflow-on-k8s-operator*. I sort of like the latter better
> because
> > > > > > *airflow* is the first word rather than the last.
> > > > > >
> > > > > > -Ry
> > > > > >
> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > > > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Fantastic! Strong +1 from me.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > To alleviate some of the concerns - we @Polidea are just
> > starting a
> > > > > > > project for big and serious customer where we will most likely
> > use
> > > and
> > > > > > > extend Kubernetes Operator.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > We have 3 people that could become contributors and commiters
> day
> > > one,
> > > > > so
> > > > > > > we can already help building community for it. Looking forward
> to
> > > > > > > following the Apache way in this case !
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > J.
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail.
> > com (
> > > > > > > fengtao04@gmail.com ) > wrote:
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> +1 as well. One question: does the original author still
> > actively
> > > > > > maintain
> > > > > > >> or would like to continue maintaining the code base after the
> > > repo is
> > > > > > >> moved
> > > > > > >>
> > > > > > >> to Airflow?
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
> > manit@
> > > > > > gmail. com
> > > > > > >> ( sumeet.manit@gmail.com )
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> Strong +1
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> > > aizhamal@
> > > > > > apache.
> > > > > > >>> org ( aizhamal@apache.org ) >
> > > > > > >>>
> > > > > > >>> wrote:
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Hello Airflow community,
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Over the last year, an engineer at Google developed, and
> open
> > > > > sourced
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> a
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it to
> > > deploy
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> Airflow
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> on their k8s cluster freely.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> There have been discussions among community members that it
> > > would be
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> great
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> to donate the operator to Apache to be part of Airflow. That
> > > way it
> > > > > is
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> easy
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> to accept contributions from the community, improve and
> > > maintain it
> > > > > > >>>> collectively and transparently, along with the Airflow-k8s
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> integration.
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> This idea has been discussed at Google, and we have obtained
> > all
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> necessary
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> approvals to donate the operator.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> This discussion is to gather opinions from the community
> > > whether you
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> all
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> think that it is a good idea. I personally think that this
> > > would be
> > > > > a
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> great
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> addition to Airflow.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Please express your thoughts or concerns if you have any.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> The discussion will run for 72 hours, and if there is
> > consensus
> > > on
> > > > > > >>>> accepting the donation, we will move the code under the
> Apache
> > > > > > >>>> organization, to be owned by the Airflow community. If
> > > consensus is
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> not
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> evident, we can have a vote after this discussion.
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Thanks,
> > > > > > >>>>
> > > > > > >>>> Aizhamal
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
> > > > > >
> > > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> > > > > Jarek.Potiuk@polidea.com
> > > > > > > wrote:
> > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > The name is indeed misleading. My proposal would be
> > > > > > > k8s-operator-for-airflow - this might make it unambiguous .
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek.
> Potiuk@
> > > > > > polidea.
> > > > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > > > > >
> > > > > > >
> > > > > > >>
> > > > > > >>
> > > > > > >> Fantastic! Strong +1 from me.
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> To alleviate some of the concerns - we @Polidea are just
> > starting
> > > a
> > > > > > >> project for big and serious customer where we will most likely
> > > use and
> > > > > > >> extend Kubernetes Operator.
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> We have 3 people that could become contributors and commiters
> > day
> > > one,
> > > > > > so
> > > > > > >> we can already help building community for it. Looking forward
> > to
> > > > > > >> following the Apache way in this case !
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> J.
> > > > > > >>
> > > > > > >>
> > > > > > >>
> > > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail.
> > com
> > > (
> > > > > > >> fengtao04@gmail.com ) > wrote:
> > > > > > >>
> > > > > > >>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> +1 as well. One question: does the original author still
> > actively
> > > > > > maintain
> > > > > > >>> or would like to continue maintaining the code base after the
> > > repo is
> > > > > > >>> moved
> > > > > > >>> to Airflow?
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
> > > manit@
> > > > > > gmail. com
> > > > > > >>> ( sumeet.manit@gmail.com )
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> wrote:
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Strong +1
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> > > aizhamal@
> > > > > > apache.
> > > > > > >>>> org ( aizhamal@apache.org ) >
> > > > > > >>>> wrote:
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> Hello Airflow community,
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> Over the last year, an engineer at Google developed, and
> open
> > > > > sourced
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> a
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it to
> > > deploy
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> Airflow
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> on their k8s cluster freely.
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> There have been discussions among community members that it
> > > would
> > > > > be
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> great
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> to donate the operator to Apache to be part of Airflow.
> That
> > > way it
> > > > > > is
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> easy
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> to accept contributions from the community, improve and
> > > maintain it
> > > > > > >>>>> collectively and transparently, along with the Airflow-k8s
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> integration.
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> This idea has been discussed at Google, and we have
> obtained
> > > all
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> necessary
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> approvals to donate the operator.
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> This discussion is to gather opinions from the community
> > > whether
> > > > > you
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> all
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> think that it is a good idea. I personally think that this
> > > would
> > > > > be a
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>> great
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> addition to Airflow.
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> Please express your thoughts or concerns if you have any.
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> The discussion will run for 72 hours, and if there is
> > > consensus on
> > > > > > >>>>> accepting the donation, we will move the code under the
> > Apache
> > > > > > >>>>> organization, to be owned by the Airflow community. If
> > > consensus is
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>> not
> > > > > > >>>
> > > > > > >>>
> > > > > > >>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> evident, we can have a vote after this discussion.
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> Thanks,
> > > > > > >>>>> Aizhamal
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
> > > airflow-operator (
> > > > > > >>>>> https://github.com/GoogleCloudPlatform/airflow-operator )
> > > > > > >>>>>
> > > > > > >>>>>
> > > > > > >>>>
> > > > > > >>>>
> > > > > > >>>
> > > > > > >>>
> > > > > > >>
> > > > > > >>
> > > > > > >
> > > > > > >
> > > > > > >
> > > > >
> > >
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Tao Feng <fe...@gmail.com>]

Hey,

Is the Airflow k8s Operator project now part of airflow code base now? Or
still waiting for IP clearance?

Thanks,
-Tao

On Tue, Sep 17, 2019 at 10:34 AM Aizhamal Nurmamat kyzy <ai...@apache.org>
wrote:

> Thanks everyone for participating in the discussion! I see there is a
> consensus among the community on this regard, therefore we will move
> forward with the process.
>
> Next step is to get IP clearance as described here [1]. This step is done
> by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has agreed to
> help. Thank you!
>
> I am closing this thread now, and Jakob will start a new one when it is
> time to vote.
>
> Thanks everyone,
> Aizhamal
>
> [1] http://incubator.apache.org/ip-clearance/index.html
>
> On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <ka...@polidea.com>
> wrote:
>
> > +1
> >
> > On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <Ja...@polidea.com>
> > wrote:
> > >
> > > +1 for aieflow-on-k8s-operator. Good enough :)
> > >
> > > J.
> > >
> > > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fe...@gmail.com>
> > napisał:
> > >
> > > > +1 on `airflow-on-k8s-operator` as well
> > > >
> > > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com> wrote:
> > > >
> > > > > +1 from me for sure. Thanks for pushing this through Aizhamal.
> > > > >
> > > > > GCP just named their flink operator (
> > > > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> > > > > ) *flink-on-k8s-operator.*
> > > > >
> > > > > So  for name, I prefer either *k8s-operator-for-airflow* or
> > > > > *airflow-on-k8s-operator*. I sort of like the latter better because
> > > > > *airflow* is the first word rather than the last.
> > > > >
> > > > > -Ry
> > > > >
> > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > Fantastic! Strong +1 from me.
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > To alleviate some of the concerns - we @Polidea are just
> starting a
> > > > > > project for big and serious customer where we will most likely
> use
> > and
> > > > > > extend Kubernetes Operator.
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > We have 3 people that could become contributors and commiters day
> > one,
> > > > so
> > > > > > we can already help building community for it. Looking forward to
> > > > > > following the Apache way in this case !
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > J.
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail.
> com (
> > > > > > fengtao04@gmail.com ) > wrote:
> > > > > >
> > > > > >
> > > > > >
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> +1 as well. One question: does the original author still
> actively
> > > > > maintain
> > > > > >> or would like to continue maintaining the code base after the
> > repo is
> > > > > >> moved
> > > > > >>
> > > > > >> to Airflow?
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
> manit@
> > > > > gmail. com
> > > > > >> ( sumeet.manit@gmail.com )
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> wrote:
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>>
> > > > > >>>
> > > > > >>> Strong +1
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> > aizhamal@
> > > > > apache.
> > > > > >>> org ( aizhamal@apache.org ) >
> > > > > >>>
> > > > > >>> wrote:
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Hello Airflow community,
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Over the last year, an engineer at Google developed, and open
> > > > sourced
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> a
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it to
> > deploy
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> Airflow
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> on their k8s cluster freely.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> There have been discussions among community members that it
> > would be
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> great
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> to donate the operator to Apache to be part of Airflow. That
> > way it
> > > > is
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> easy
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> to accept contributions from the community, improve and
> > maintain it
> > > > > >>>> collectively and transparently, along with the Airflow-k8s
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> integration.
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> This idea has been discussed at Google, and we have obtained
> all
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> necessary
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> approvals to donate the operator.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> This discussion is to gather opinions from the community
> > whether you
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> all
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> think that it is a good idea. I personally think that this
> > would be
> > > > a
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> great
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> addition to Airflow.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Please express your thoughts or concerns if you have any.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> The discussion will run for 72 hours, and if there is
> consensus
> > on
> > > > > >>>> accepting the donation, we will move the code under the Apache
> > > > > >>>> organization, to be owned by the Airflow community. If
> > consensus is
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> not
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> evident, we can have a vote after this discussion.
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Thanks,
> > > > > >>>>
> > > > > >>>> Aizhamal
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > > > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
> > > > >
> > > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> > > > Jarek.Potiuk@polidea.com
> > > > > > wrote:
> > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > The name is indeed misleading. My proposal would be
> > > > > > k8s-operator-for-airflow - this might make it unambiguous .
> > > > > >
> > > > > >
> > > > > >
> > > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > > > > polidea.
> > > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > > > >
> > > > > >
> > > > > >>
> > > > > >>
> > > > > >> Fantastic! Strong +1 from me.
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> To alleviate some of the concerns - we @Polidea are just
> starting
> > a
> > > > > >> project for big and serious customer where we will most likely
> > use and
> > > > > >> extend Kubernetes Operator.
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> We have 3 people that could become contributors and commiters
> day
> > one,
> > > > > so
> > > > > >> we can already help building community for it. Looking forward
> to
> > > > > >> following the Apache way in this case !
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> J.
> > > > > >>
> > > > > >>
> > > > > >>
> > > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail.
> com
> > (
> > > > > >> fengtao04@gmail.com ) > wrote:
> > > > > >>
> > > > > >>
> > > > > >>>
> > > > > >>>
> > > > > >>> +1 as well. One question: does the original author still
> actively
> > > > > maintain
> > > > > >>> or would like to continue maintaining the code base after the
> > repo is
> > > > > >>> moved
> > > > > >>> to Airflow?
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
> > manit@
> > > > > gmail. com
> > > > > >>> ( sumeet.manit@gmail.com )
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> wrote:
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Strong +1
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> > aizhamal@
> > > > > apache.
> > > > > >>>> org ( aizhamal@apache.org ) >
> > > > > >>>> wrote:
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> Hello Airflow community,
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> Over the last year, an engineer at Google developed, and open
> > > > sourced
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> a
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it to
> > deploy
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> Airflow
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> on their k8s cluster freely.
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> There have been discussions among community members that it
> > would
> > > > be
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> great
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> to donate the operator to Apache to be part of Airflow. That
> > way it
> > > > > is
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> easy
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> to accept contributions from the community, improve and
> > maintain it
> > > > > >>>>> collectively and transparently, along with the Airflow-k8s
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> integration.
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> This idea has been discussed at Google, and we have obtained
> > all
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> necessary
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> approvals to donate the operator.
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> This discussion is to gather opinions from the community
> > whether
> > > > you
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> all
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> think that it is a good idea. I personally think that this
> > would
> > > > be a
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>> great
> > > > > >>>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> addition to Airflow.
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> Please express your thoughts or concerns if you have any.
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> The discussion will run for 72 hours, and if there is
> > consensus on
> > > > > >>>>> accepting the donation, we will move the code under the
> Apache
> > > > > >>>>> organization, to be owned by the Airflow community. If
> > consensus is
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>>
> > > > > >>> not
> > > > > >>>
> > > > > >>>
> > > > > >>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> evident, we can have a vote after this discussion.
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> Thanks,
> > > > > >>>>> Aizhamal
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
> > airflow-operator (
> > > > > >>>>> https://github.com/GoogleCloudPlatform/airflow-operator )
> > > > > >>>>>
> > > > > >>>>>
> > > > > >>>>
> > > > > >>>>
> > > > > >>>
> > > > > >>>
> > > > > >>
> > > > > >>
> > > > > >
> > > > > >
> > > > > >
> > > >
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Aizhamal Nurmamat kyzy <ai...@apache.org>]

Thanks everyone for participating in the discussion! I see there is a
consensus among the community on this regard, therefore we will move
forward with the process.

Next step is to get IP clearance as described here [1]. This step is done
by the receiving PMC, and @Jakob Homan <jg...@gmail.com> has agreed to
help. Thank you!

I am closing this thread now, and Jakob will start a new one when it is
time to vote.

Thanks everyone,
Aizhamal

[1] http://incubator.apache.org/ip-clearance/index.html

On Fri, Sep 13, 2019 at 12:41 PM Kamil Breguła <ka...@polidea.com>
wrote:

> +1
>
> On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <Ja...@polidea.com>
> wrote:
> >
> > +1 for aieflow-on-k8s-operator. Good enough :)
> >
> > J.
> >
> > pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fe...@gmail.com>
> napisał:
> >
> > > +1 on `airflow-on-k8s-operator` as well
> > >
> > > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com> wrote:
> > >
> > > > +1 from me for sure. Thanks for pushing this through Aizhamal.
> > > >
> > > > GCP just named their flink operator (
> > > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> > > > ) *flink-on-k8s-operator.*
> > > >
> > > > So  for name, I prefer either *k8s-operator-for-airflow* or
> > > > *airflow-on-k8s-operator*. I sort of like the latter better because
> > > > *airflow* is the first word rather than the last.
> > > >
> > > > -Ry
> > > >
> > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > >
> > > > >
> > > > >
> > > > >
> > > > > Fantastic! Strong +1 from me.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > To alleviate some of the concerns - we @Polidea are just starting a
> > > > > project for big and serious customer where we will most likely use
> and
> > > > > extend Kubernetes Operator.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > We have 3 people that could become contributors and commiters day
> one,
> > > so
> > > > > we can already help building community for it. Looking forward to
> > > > > following the Apache way in this case !
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > J.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
> > > > > fengtao04@gmail.com ) > wrote:
> > > > >
> > > > >
> > > > >
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >> +1 as well. One question: does the original author still actively
> > > > maintain
> > > > >> or would like to continue maintaining the code base after the
> repo is
> > > > >> moved
> > > > >>
> > > > >> to Airflow?
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@
> > > > gmail. com
> > > > >> ( sumeet.manit@gmail.com )
> > > > >>
> > > > >>
> > > > >>
> > > > >>
> > > > >> wrote:
> > > > >>
> > > > >>
> > > > >>
> > > > >>>
> > > > >>>
> > > > >>> Strong +1
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> aizhamal@
> > > > apache.
> > > > >>> org ( aizhamal@apache.org ) >
> > > > >>>
> > > > >>> wrote:
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Hello Airflow community,
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Over the last year, an engineer at Google developed, and open
> > > sourced
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >>
> > > > >> a
> > > > >>
> > > > >>
> > > > >>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it to
> deploy
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> Airflow
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> on their k8s cluster freely.
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> There have been discussions among community members that it
> would be
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> great
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> to donate the operator to Apache to be part of Airflow. That
> way it
> > > is
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> easy
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> to accept contributions from the community, improve and
> maintain it
> > > > >>>> collectively and transparently, along with the Airflow-k8s
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >>
> > > > >> integration.
> > > > >>
> > > > >>
> > > > >>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> This idea has been discussed at Google, and we have obtained all
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> necessary
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> approvals to donate the operator.
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> This discussion is to gather opinions from the community
> whether you
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >>
> > > > >> all
> > > > >>
> > > > >>
> > > > >>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> think that it is a good idea. I personally think that this
> would be
> > > a
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> great
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> addition to Airflow.
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Please express your thoughts or concerns if you have any.
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> The discussion will run for 72 hours, and if there is consensus
> on
> > > > >>>> accepting the donation, we will move the code under the Apache
> > > > >>>> organization, to be owned by the Airflow community. If
> consensus is
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >>
> > > > >> not
> > > > >>
> > > > >>
> > > > >>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> evident, we can have a vote after this discussion.
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Thanks,
> > > > >>>>
> > > > >>>> Aizhamal
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > >
> > > > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
> > > >
> > > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> > > Jarek.Potiuk@polidea.com
> > > > > wrote:
> > > >
> > > > >
> > > > >
> > > > >
> > > > > The name is indeed misleading. My proposal would be
> > > > > k8s-operator-for-airflow - this might make it unambiguous .
> > > > >
> > > > >
> > > > >
> > > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > > > polidea.
> > > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > > >
> > > > >
> > > > >>
> > > > >>
> > > > >> Fantastic! Strong +1 from me.
> > > > >>
> > > > >>
> > > > >>
> > > > >> To alleviate some of the concerns - we @Polidea are just starting
> a
> > > > >> project for big and serious customer where we will most likely
> use and
> > > > >> extend Kubernetes Operator.
> > > > >>
> > > > >>
> > > > >>
> > > > >> We have 3 people that could become contributors and commiters day
> one,
> > > > so
> > > > >> we can already help building community for it. Looking forward to
> > > > >> following the Apache way in this case !
> > > > >>
> > > > >>
> > > > >>
> > > > >> J.
> > > > >>
> > > > >>
> > > > >>
> > > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com
> (
> > > > >> fengtao04@gmail.com ) > wrote:
> > > > >>
> > > > >>
> > > > >>>
> > > > >>>
> > > > >>> +1 as well. One question: does the original author still actively
> > > > maintain
> > > > >>> or would like to continue maintaining the code base after the
> repo is
> > > > >>> moved
> > > > >>> to Airflow?
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet.
> manit@
> > > > gmail. com
> > > > >>> ( sumeet.manit@gmail.com )
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> wrote:
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Strong +1
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> aizhamal@
> > > > apache.
> > > > >>>> org ( aizhamal@apache.org ) >
> > > > >>>> wrote:
> > > > >>>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> Hello Airflow community,
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> Over the last year, an engineer at Google developed, and open
> > > sourced
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> a
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it to
> deploy
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> Airflow
> > > > >>>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> on their k8s cluster freely.
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> There have been discussions among community members that it
> would
> > > be
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> great
> > > > >>>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> to donate the operator to Apache to be part of Airflow. That
> way it
> > > > is
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> easy
> > > > >>>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> to accept contributions from the community, improve and
> maintain it
> > > > >>>>> collectively and transparently, along with the Airflow-k8s
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> integration.
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> This idea has been discussed at Google, and we have obtained
> all
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> necessary
> > > > >>>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> approvals to donate the operator.
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> This discussion is to gather opinions from the community
> whether
> > > you
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> all
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> think that it is a good idea. I personally think that this
> would
> > > be a
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>>
> > > > >>>> great
> > > > >>>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> addition to Airflow.
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> Please express your thoughts or concerns if you have any.
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> The discussion will run for 72 hours, and if there is
> consensus on
> > > > >>>>> accepting the donation, we will move the code under the Apache
> > > > >>>>> organization, to be owned by the Airflow community. If
> consensus is
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>>
> > > > >>> not
> > > > >>>
> > > > >>>
> > > > >>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> evident, we can have a vote after this discussion.
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> Thanks,
> > > > >>>>> Aizhamal
> > > > >>>>>
> > > > >>>>>
> > > > >>>>>
> > > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/
> airflow-operator (
> > > > >>>>> https://github.com/GoogleCloudPlatform/airflow-operator )
> > > > >>>>>
> > > > >>>>>
> > > > >>>>
> > > > >>>>
> > > > >>>
> > > > >>>
> > > > >>
> > > > >>
> > > > >
> > > > >
> > > > >
> > >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Kamil Breguła <ka...@polidea.com>]

+1

On Fri, Sep 13, 2019 at 8:40 PM Jarek Potiuk <Ja...@polidea.com> wrote:
>
> +1 for aieflow-on-k8s-operator. Good enough :)
>
> J.
>
> pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fe...@gmail.com> napisał:
>
> > +1 on `airflow-on-k8s-operator` as well
> >
> > On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com> wrote:
> >
> > > +1 from me for sure. Thanks for pushing this through Aizhamal.
> > >
> > > GCP just named their flink operator (
> > > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> > > ) *flink-on-k8s-operator.*
> > >
> > > So  for name, I prefer either *k8s-operator-for-airflow* or
> > > *airflow-on-k8s-operator*. I sort of like the latter better because
> > > *airflow* is the first word rather than the last.
> > >
> > > -Ry
> > >
> > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> > >
> > > >
> > > >
> > > >
> > > > Fantastic! Strong +1 from me.
> > > >
> > > >
> > > >
> > > >
> > > > To alleviate some of the concerns - we @Polidea are just starting a
> > > > project for big and serious customer where we will most likely use and
> > > > extend Kubernetes Operator.
> > > >
> > > >
> > > >
> > > >
> > > > We have 3 people that could become contributors and commiters day one,
> > so
> > > > we can already help building community for it. Looking forward to
> > > > following the Apache way in this case !
> > > >
> > > >
> > > >
> > > >
> > > > J.
> > > >
> > > >
> > > >
> > > >
> > > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
> > > > fengtao04@gmail.com ) > wrote:
> > > >
> > > >
> > > >
> > > >>
> > > >>
> > > >>
> > > >>
> > > >> +1 as well. One question: does the original author still actively
> > > maintain
> > > >> or would like to continue maintaining the code base after the repo is
> > > >> moved
> > > >>
> > > >> to Airflow?
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >>
> > > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@
> > > gmail. com
> > > >> ( sumeet.manit@gmail.com )
> > > >>
> > > >>
> > > >>
> > > >>
> > > >> wrote:
> > > >>
> > > >>
> > > >>
> > > >>>
> > > >>>
> > > >>> Strong +1
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < aizhamal@
> > > apache.
> > > >>> org ( aizhamal@apache.org ) >
> > > >>>
> > > >>> wrote:
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> Hello Airflow community,
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> Over the last year, an engineer at Google developed, and open
> > sourced
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> a
> > > >>
> > > >>
> > > >>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> Airflow
> > > >>>
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> on their k8s cluster freely.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> There have been discussions among community members that it would be
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> great
> > > >>>
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> to donate the operator to Apache to be part of Airflow. That way it
> > is
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> easy
> > > >>>
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> to accept contributions from the community, improve and maintain it
> > > >>>> collectively and transparently, along with the Airflow-k8s
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> integration.
> > > >>
> > > >>
> > > >>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> This idea has been discussed at Google, and we have obtained all
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> necessary
> > > >>>
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> approvals to donate the operator.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> This discussion is to gather opinions from the community whether you
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> all
> > > >>
> > > >>
> > > >>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> think that it is a good idea. I personally think that this would be
> > a
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> great
> > > >>>
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> addition to Airflow.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> Please express your thoughts or concerns if you have any.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> The discussion will run for 72 hours, and if there is consensus on
> > > >>>> accepting the donation, we will move the code under the Apache
> > > >>>> organization, to be owned by the Airflow community. If consensus is
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >>
> > > >> not
> > > >>
> > > >>
> > > >>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> evident, we can have a vote after this discussion.
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> Thanks,
> > > >>>>
> > > >>>> Aizhamal
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >
> > > >
> > >
> > > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
> > >
> > > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> > Jarek.Potiuk@polidea.com
> > > > wrote:
> > >
> > > >
> > > >
> > > >
> > > > The name is indeed misleading. My proposal would be
> > > > k8s-operator-for-airflow - this might make it unambiguous .
> > > >
> > > >
> > > >
> > > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > > polidea.
> > > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> > > >
> > > >
> > > >>
> > > >>
> > > >> Fantastic! Strong +1 from me.
> > > >>
> > > >>
> > > >>
> > > >> To alleviate some of the concerns - we @Polidea are just starting a
> > > >> project for big and serious customer where we will most likely use and
> > > >> extend Kubernetes Operator.
> > > >>
> > > >>
> > > >>
> > > >> We have 3 people that could become contributors and commiters day one,
> > > so
> > > >> we can already help building community for it. Looking forward to
> > > >> following the Apache way in this case !
> > > >>
> > > >>
> > > >>
> > > >> J.
> > > >>
> > > >>
> > > >>
> > > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
> > > >> fengtao04@gmail.com ) > wrote:
> > > >>
> > > >>
> > > >>>
> > > >>>
> > > >>> +1 as well. One question: does the original author still actively
> > > maintain
> > > >>> or would like to continue maintaining the code base after the repo is
> > > >>> moved
> > > >>> to Airflow?
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@
> > > gmail. com
> > > >>> ( sumeet.manit@gmail.com )
> > > >>>
> > > >>>
> > > >>>
> > > >>> wrote:
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>
> > > >>>> Strong +1
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < aizhamal@
> > > apache.
> > > >>>> org ( aizhamal@apache.org ) >
> > > >>>> wrote:
> > > >>>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> Hello Airflow community,
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> Over the last year, an engineer at Google developed, and open
> > sourced
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> a
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> Airflow
> > > >>>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> on their k8s cluster freely.
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> There have been discussions among community members that it would
> > be
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> great
> > > >>>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> to donate the operator to Apache to be part of Airflow. That way it
> > > is
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> easy
> > > >>>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> to accept contributions from the community, improve and maintain it
> > > >>>>> collectively and transparently, along with the Airflow-k8s
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> integration.
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> This idea has been discussed at Google, and we have obtained all
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> necessary
> > > >>>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> approvals to donate the operator.
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> This discussion is to gather opinions from the community whether
> > you
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> all
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> think that it is a good idea. I personally think that this would
> > be a
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>>
> > > >>>> great
> > > >>>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> addition to Airflow.
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> Please express your thoughts or concerns if you have any.
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> The discussion will run for 72 hours, and if there is consensus on
> > > >>>>> accepting the donation, we will move the code under the Apache
> > > >>>>> organization, to be owned by the Airflow community. If consensus is
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> not
> > > >>>
> > > >>>
> > > >>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> evident, we can have a vote after this discussion.
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> Thanks,
> > > >>>>> Aizhamal
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/ airflow-operator (
> > > >>>>> https://github.com/GoogleCloudPlatform/airflow-operator )
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>
> > > >>>
> > > >>
> > > >>
> > > >
> > > >
> > > >
> >

Re: [DISCUSS] Donating Airflow k8s Operator

[Jarek Potiuk <Ja...@polidea.com>]

+1 for aieflow-on-k8s-operator. Good enough :)

J.

pt., 13 wrz 2019, 19:19 użytkownik Tao Feng <fe...@gmail.com> napisał:

> +1 on `airflow-on-k8s-operator` as well
>
> On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com> wrote:
>
> > +1 from me for sure. Thanks for pushing this through Aizhamal.
> >
> > GCP just named their flink operator (
> > https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> > ) *flink-on-k8s-operator.*
> >
> > So  for name, I prefer either *k8s-operator-for-airflow* or
> > *airflow-on-k8s-operator*. I sort of like the latter better because
> > *airflow* is the first word rather than the last.
> >
> > -Ry
> >
> > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
> >
> > >
> > >
> > >
> > > Fantastic! Strong +1 from me.
> > >
> > >
> > >
> > >
> > > To alleviate some of the concerns - we @Polidea are just starting a
> > > project for big and serious customer where we will most likely use and
> > > extend Kubernetes Operator.
> > >
> > >
> > >
> > >
> > > We have 3 people that could become contributors and commiters day one,
> so
> > > we can already help building community for it. Looking forward to
> > > following the Apache way in this case !
> > >
> > >
> > >
> > >
> > > J.
> > >
> > >
> > >
> > >
> > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
> > > fengtao04@gmail.com ) > wrote:
> > >
> > >
> > >
> > >>
> > >>
> > >>
> > >>
> > >> +1 as well. One question: does the original author still actively
> > maintain
> > >> or would like to continue maintaining the code base after the repo is
> > >> moved
> > >>
> > >> to Airflow?
> > >>
> > >>
> > >>
> > >>
> > >>
> > >>
> > >>
> > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@
> > gmail. com
> > >> ( sumeet.manit@gmail.com )
> > >>
> > >>
> > >>
> > >>
> > >> wrote:
> > >>
> > >>
> > >>
> > >>>
> > >>>
> > >>> Strong +1
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < aizhamal@
> > apache.
> > >>> org ( aizhamal@apache.org ) >
> > >>>
> > >>> wrote:
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>>
> > >>>>
> > >>>> Hello Airflow community,
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> Over the last year, an engineer at Google developed, and open
> sourced
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>
> > >>
> > >>
> > >> a
> > >>
> > >>
> > >>
> > >>>
> > >>>>
> > >>>>
> > >>>> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> Airflow
> > >>>
> > >>>
> > >>>
> > >>>>
> > >>>>
> > >>>> on their k8s cluster freely.
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> There have been discussions among community members that it would be
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> great
> > >>>
> > >>>
> > >>>
> > >>>>
> > >>>>
> > >>>> to donate the operator to Apache to be part of Airflow. That way it
> is
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> easy
> > >>>
> > >>>
> > >>>
> > >>>>
> > >>>>
> > >>>> to accept contributions from the community, improve and maintain it
> > >>>> collectively and transparently, along with the Airflow-k8s
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>
> > >>
> > >>
> > >> integration.
> > >>
> > >>
> > >>
> > >>>
> > >>>>
> > >>>>
> > >>>> This idea has been discussed at Google, and we have obtained all
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> necessary
> > >>>
> > >>>
> > >>>
> > >>>>
> > >>>>
> > >>>> approvals to donate the operator.
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> This discussion is to gather opinions from the community whether you
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>
> > >>
> > >>
> > >> all
> > >>
> > >>
> > >>
> > >>>
> > >>>>
> > >>>>
> > >>>> think that it is a good idea. I personally think that this would be
> a
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> great
> > >>>
> > >>>
> > >>>
> > >>>>
> > >>>>
> > >>>> addition to Airflow.
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> Please express your thoughts or concerns if you have any.
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> The discussion will run for 72 hours, and if there is consensus on
> > >>>> accepting the donation, we will move the code under the Apache
> > >>>> organization, to be owned by the Airflow community. If consensus is
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>
> > >>
> > >>
> > >> not
> > >>
> > >>
> > >>
> > >>>
> > >>>>
> > >>>>
> > >>>> evident, we can have a vote after this discussion.
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> Thanks,
> > >>>>
> > >>>> Aizhamal
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>
> > >>
> > >
> > >
> >
> > Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
> >
> > On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk <
> Jarek.Potiuk@polidea.com
> > > wrote:
> >
> > >
> > >
> > >
> > > The name is indeed misleading. My proposal would be
> > > k8s-operator-for-airflow - this might make it unambiguous .
> > >
> > >
> > >
> > > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> > polidea.
> > > com ( Jarek.Potiuk@polidea.com ) > napisał:
> > >
> > >
> > >>
> > >>
> > >> Fantastic! Strong +1 from me.
> > >>
> > >>
> > >>
> > >> To alleviate some of the concerns - we @Polidea are just starting a
> > >> project for big and serious customer where we will most likely use and
> > >> extend Kubernetes Operator.
> > >>
> > >>
> > >>
> > >> We have 3 people that could become contributors and commiters day one,
> > so
> > >> we can already help building community for it. Looking forward to
> > >> following the Apache way in this case !
> > >>
> > >>
> > >>
> > >> J.
> > >>
> > >>
> > >>
> > >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
> > >> fengtao04@gmail.com ) > wrote:
> > >>
> > >>
> > >>>
> > >>>
> > >>> +1 as well. One question: does the original author still actively
> > maintain
> > >>> or would like to continue maintaining the code base after the repo is
> > >>> moved
> > >>> to Airflow?
> > >>>
> > >>>
> > >>>
> > >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@
> > gmail. com
> > >>> ( sumeet.manit@gmail.com )
> > >>>
> > >>>
> > >>>
> > >>> wrote:
> > >>>
> > >>>
> > >>>>
> > >>>>
> > >>>> Strong +1
> > >>>>
> > >>>>
> > >>>>
> > >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < aizhamal@
> > apache.
> > >>>> org ( aizhamal@apache.org ) >
> > >>>> wrote:
> > >>>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> Hello Airflow community,
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> Over the last year, an engineer at Google developed, and open
> sourced
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> a
> > >>>
> > >>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> Airflow
> > >>>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> on their k8s cluster freely.
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> There have been discussions among community members that it would
> be
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> great
> > >>>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> to donate the operator to Apache to be part of Airflow. That way it
> > is
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> easy
> > >>>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> to accept contributions from the community, improve and maintain it
> > >>>>> collectively and transparently, along with the Airflow-k8s
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> integration.
> > >>>
> > >>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> This idea has been discussed at Google, and we have obtained all
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> necessary
> > >>>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> approvals to donate the operator.
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> This discussion is to gather opinions from the community whether
> you
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> all
> > >>>
> > >>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> think that it is a good idea. I personally think that this would
> be a
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>> great
> > >>>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> addition to Airflow.
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> Please express your thoughts or concerns if you have any.
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> The discussion will run for 72 hours, and if there is consensus on
> > >>>>> accepting the donation, we will move the code under the Apache
> > >>>>> organization, to be owned by the Airflow community. If consensus is
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> not
> > >>>
> > >>>
> > >>>>
> > >>>>>
> > >>>>>
> > >>>>> evident, we can have a vote after this discussion.
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> Thanks,
> > >>>>> Aizhamal
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/ airflow-operator (
> > >>>>> https://github.com/GoogleCloudPlatform/airflow-operator )
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>
> > >>
> > >
> > >
> > >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Tao Feng <fe...@gmail.com>]

+1 on `airflow-on-k8s-operator` as well

On Fri, Sep 13, 2019 at 10:07 AM Ry Walker <ry...@rywalker.com> wrote:

> +1 from me for sure. Thanks for pushing this through Aizhamal.
>
> GCP just named their flink operator (
> https://github.com/GoogleCloudPlatform/flink-on-k8s-operator
> ) *flink-on-k8s-operator.*
>
> So  for name, I prefer either *k8s-operator-for-airflow* or
> *airflow-on-k8s-operator*. I sort of like the latter better because
> *airflow* is the first word rather than the last.
>
> -Ry
>
> czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:
>
> >
> >
> >
> > Fantastic! Strong +1 from me.
> >
> >
> >
> >
> > To alleviate some of the concerns - we @Polidea are just starting a
> > project for big and serious customer where we will most likely use and
> > extend Kubernetes Operator.
> >
> >
> >
> >
> > We have 3 people that could become contributors and commiters day one, so
> > we can already help building community for it. Looking forward to
> > following the Apache way in this case !
> >
> >
> >
> >
> > J.
> >
> >
> >
> >
> > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
> > fengtao04@gmail.com ) > wrote:
> >
> >
> >
> >>
> >>
> >>
> >>
> >> +1 as well. One question: does the original author still actively
> maintain
> >> or would like to continue maintaining the code base after the repo is
> >> moved
> >>
> >> to Airflow?
> >>
> >>
> >>
> >>
> >>
> >>
> >>
> >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@
> gmail. com
> >> ( sumeet.manit@gmail.com )
> >>
> >>
> >>
> >>
> >> wrote:
> >>
> >>
> >>
> >>>
> >>>
> >>> Strong +1
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < aizhamal@
> apache.
> >>> org ( aizhamal@apache.org ) >
> >>>
> >>> wrote:
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>
> >>>>
> >>>>
> >>>> Hello Airflow community,
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> Over the last year, an engineer at Google developed, and open sourced
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >>
> >> a
> >>
> >>
> >>
> >>>
> >>>>
> >>>>
> >>>> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> Airflow
> >>>
> >>>
> >>>
> >>>>
> >>>>
> >>>> on their k8s cluster freely.
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> There have been discussions among community members that it would be
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> great
> >>>
> >>>
> >>>
> >>>>
> >>>>
> >>>> to donate the operator to Apache to be part of Airflow. That way it is
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> easy
> >>>
> >>>
> >>>
> >>>>
> >>>>
> >>>> to accept contributions from the community, improve and maintain it
> >>>> collectively and transparently, along with the Airflow-k8s
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >>
> >> integration.
> >>
> >>
> >>
> >>>
> >>>>
> >>>>
> >>>> This idea has been discussed at Google, and we have obtained all
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> necessary
> >>>
> >>>
> >>>
> >>>>
> >>>>
> >>>> approvals to donate the operator.
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> This discussion is to gather opinions from the community whether you
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >>
> >> all
> >>
> >>
> >>
> >>>
> >>>>
> >>>>
> >>>> think that it is a good idea. I personally think that this would be a
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> great
> >>>
> >>>
> >>>
> >>>>
> >>>>
> >>>> addition to Airflow.
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> Please express your thoughts or concerns if you have any.
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> The discussion will run for 72 hours, and if there is consensus on
> >>>> accepting the donation, we will move the code under the Apache
> >>>> organization, to be owned by the Airflow community. If consensus is
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >>
> >> not
> >>
> >>
> >>
> >>>
> >>>>
> >>>>
> >>>> evident, we can have a vote after this discussion.
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> Thanks,
> >>>>
> >>>> Aizhamal
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >
> >
>
> Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )
>
> On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk < Jarek.Potiuk@polidea.com
> > wrote:
>
> >
> >
> >
> > The name is indeed misleading. My proposal would be
> > k8s-operator-for-airflow - this might make it unambiguous .
> >
> >
> >
> > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@
> polidea.
> > com ( Jarek.Potiuk@polidea.com ) > napisał:
> >
> >
> >>
> >>
> >> Fantastic! Strong +1 from me.
> >>
> >>
> >>
> >> To alleviate some of the concerns - we @Polidea are just starting a
> >> project for big and serious customer where we will most likely use and
> >> extend Kubernetes Operator.
> >>
> >>
> >>
> >> We have 3 people that could become contributors and commiters day one,
> so
> >> we can already help building community for it. Looking forward to
> >> following the Apache way in this case !
> >>
> >>
> >>
> >> J.
> >>
> >>
> >>
> >> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
> >> fengtao04@gmail.com ) > wrote:
> >>
> >>
> >>>
> >>>
> >>> +1 as well. One question: does the original author still actively
> maintain
> >>> or would like to continue maintaining the code base after the repo is
> >>> moved
> >>> to Airflow?
> >>>
> >>>
> >>>
> >>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@
> gmail. com
> >>> ( sumeet.manit@gmail.com )
> >>>
> >>>
> >>>
> >>> wrote:
> >>>
> >>>
> >>>>
> >>>>
> >>>> Strong +1
> >>>>
> >>>>
> >>>>
> >>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < aizhamal@
> apache.
> >>>> org ( aizhamal@apache.org ) >
> >>>> wrote:
> >>>>
> >>>>
> >>>>>
> >>>>>
> >>>>> Hello Airflow community,
> >>>>>
> >>>>>
> >>>>>
> >>>>> Over the last year, an engineer at Google developed, and open sourced
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> a
> >>>
> >>>
> >>>>
> >>>>>
> >>>>>
> >>>>> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>> Airflow
> >>>>
> >>>>
> >>>>>
> >>>>>
> >>>>> on their k8s cluster freely.
> >>>>>
> >>>>>
> >>>>>
> >>>>> There have been discussions among community members that it would be
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>> great
> >>>>
> >>>>
> >>>>>
> >>>>>
> >>>>> to donate the operator to Apache to be part of Airflow. That way it
> is
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>> easy
> >>>>
> >>>>
> >>>>>
> >>>>>
> >>>>> to accept contributions from the community, improve and maintain it
> >>>>> collectively and transparently, along with the Airflow-k8s
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> integration.
> >>>
> >>>
> >>>>
> >>>>>
> >>>>>
> >>>>> This idea has been discussed at Google, and we have obtained all
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>> necessary
> >>>>
> >>>>
> >>>>>
> >>>>>
> >>>>> approvals to donate the operator.
> >>>>>
> >>>>>
> >>>>>
> >>>>> This discussion is to gather opinions from the community whether you
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> all
> >>>
> >>>
> >>>>
> >>>>>
> >>>>>
> >>>>> think that it is a good idea. I personally think that this would be a
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>> great
> >>>>
> >>>>
> >>>>>
> >>>>>
> >>>>> addition to Airflow.
> >>>>>
> >>>>>
> >>>>>
> >>>>> Please express your thoughts or concerns if you have any.
> >>>>>
> >>>>>
> >>>>>
> >>>>> The discussion will run for 72 hours, and if there is consensus on
> >>>>> accepting the donation, we will move the code under the Apache
> >>>>> organization, to be owned by the Airflow community. If consensus is
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>> not
> >>>
> >>>
> >>>>
> >>>>>
> >>>>>
> >>>>> evident, we can have a vote after this discussion.
> >>>>>
> >>>>>
> >>>>>
> >>>>> Thanks,
> >>>>> Aizhamal
> >>>>>
> >>>>>
> >>>>>
> >>>>> [1] https:/ / github. com/ GoogleCloudPlatform/ airflow-operator (
> >>>>> https://github.com/GoogleCloudPlatform/airflow-operator )
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >
> >
> >

Re: [DISCUSS] Donating Airflow k8s Operator

[Ry Walker <ry...@rywalker.com>]

+1 from me for sure. Thanks for pushing this through Aizhamal.

GCP just named their flink operator ( https://github.com/GoogleCloudPlatform/flink-on-k8s-operator ) *flink-on-k8s-operator.*

So  for name, I prefer either *k8s-operator-for-airflow* or *airflow-on-k8s-operator*. I sort of like the latter better because *airflow* is the first word rather than the last.

-Ry

czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@ polidea. com ( Jarek.Potiuk@polidea.com ) > napisał:

> 
> 
> 
> Fantastic! Strong +1 from me.
> 
> 
> 
> 
> To alleviate some of the concerns - we @Polidea are just starting a
> project for big and serious customer where we will most likely use and
> extend Kubernetes Operator.
> 
> 
> 
> 
> We have 3 people that could become contributors and commiters day one, so
> we can already help building community for it. Looking forward to
> following the Apache way in this case !
> 
> 
> 
> 
> J.
> 
> 
> 
> 
> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
> fengtao04@gmail.com ) > wrote:
> 
> 
> 
>> 
>> 
>> 
>> 
>> +1 as well. One question: does the original author still actively maintain
>> or would like to continue maintaining the code base after the repo is
>> moved
>> 
>> to Airflow?
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@ gmail. com
>> ( sumeet.manit@gmail.com )
>> 
>> 
>> 
>> 
>> wrote:
>> 
>> 
>> 
>>> 
>>> 
>>> Strong +1
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < aizhamal@ apache.
>>> org ( aizhamal@apache.org ) >
>>> 
>>> wrote:
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>>> 
>>>> 
>>>> Hello Airflow community,
>>>> 
>>>> 
>>>> 
>>>> 
>>>> Over the last year, an engineer at Google developed, and open sourced
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
>> 
>> a
>> 
>> 
>> 
>>> 
>>>> 
>>>> 
>>>> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> Airflow
>>> 
>>> 
>>> 
>>>> 
>>>> 
>>>> on their k8s cluster freely.
>>>> 
>>>> 
>>>> 
>>>> 
>>>> There have been discussions among community members that it would be
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> great
>>> 
>>> 
>>> 
>>>> 
>>>> 
>>>> to donate the operator to Apache to be part of Airflow. That way it is
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> easy
>>> 
>>> 
>>> 
>>>> 
>>>> 
>>>> to accept contributions from the community, improve and maintain it
>>>> collectively and transparently, along with the Airflow-k8s
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
>> 
>> integration.
>> 
>> 
>> 
>>> 
>>>> 
>>>> 
>>>> This idea has been discussed at Google, and we have obtained all
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> necessary
>>> 
>>> 
>>> 
>>>> 
>>>> 
>>>> approvals to donate the operator.
>>>> 
>>>> 
>>>> 
>>>> 
>>>> This discussion is to gather opinions from the community whether you
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
>> 
>> all
>> 
>> 
>> 
>>> 
>>>> 
>>>> 
>>>> think that it is a good idea. I personally think that this would be a
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> great
>>> 
>>> 
>>> 
>>>> 
>>>> 
>>>> addition to Airflow.
>>>> 
>>>> 
>>>> 
>>>> 
>>>> Please express your thoughts or concerns if you have any.
>>>> 
>>>> 
>>>> 
>>>> 
>>>> The discussion will run for 72 hours, and if there is consensus on
>>>> accepting the donation, we will move the code under the Apache
>>>> organization, to be owned by the Airflow community. If consensus is
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
>> 
>> not
>> 
>> 
>> 
>>> 
>>>> 
>>>> 
>>>> evident, we can have a vote after this discussion.
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>>> Thanks,
>>>> 
>>>> Aizhamal 
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
> 
> 

Sent via Superhuman ( https://sprh.mn/?vip=ry@rywalker.com )

On Thu, Sep 12, 2019 at 11:19 AM, Jarek Potiuk < Jarek.Potiuk@polidea.com > wrote:

> 
> 
> 
> The name is indeed misleading. My proposal would be
> k8s-operator-for-airflow - this might make it unambiguous .
> 
> 
> 
> czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk < Jarek. Potiuk@ polidea.
> com ( Jarek.Potiuk@polidea.com ) > napisał:
> 
> 
>> 
>> 
>> Fantastic! Strong +1 from me.
>> 
>> 
>> 
>> To alleviate some of the concerns - we @Polidea are just starting a
>> project for big and serious customer where we will most likely use and
>> extend Kubernetes Operator.
>> 
>> 
>> 
>> We have 3 people that could become contributors and commiters day one, so
>> we can already help building community for it. Looking forward to
>> following the Apache way in this case !
>> 
>> 
>> 
>> J.
>> 
>> 
>> 
>> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng < fengtao04@ gmail. com (
>> fengtao04@gmail.com ) > wrote:
>> 
>> 
>>> 
>>> 
>>> +1 as well. One question: does the original author still actively maintain
>>> or would like to continue maintaining the code base after the repo is
>>> moved
>>> to Airflow?
>>> 
>>> 
>>> 
>>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari < sumeet. manit@ gmail. com
>>> ( sumeet.manit@gmail.com )
>>> 
>>> 
>>> 
>>> wrote:
>>> 
>>> 
>>>> 
>>>> 
>>>> Strong +1
>>>> 
>>>> 
>>>> 
>>>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy < aizhamal@ apache.
>>>> org ( aizhamal@apache.org ) >
>>>> wrote:
>>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> Hello Airflow community,
>>>>> 
>>>>> 
>>>>> 
>>>>> Over the last year, an engineer at Google developed, and open sourced
>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> a
>>> 
>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
>>>>> 
>>>>> 
>>>> 
>>>> 
>>>> 
>>>> Airflow
>>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> on their k8s cluster freely.
>>>>> 
>>>>> 
>>>>> 
>>>>> There have been discussions among community members that it would be
>>>>> 
>>>>> 
>>>> 
>>>> 
>>>> 
>>>> great
>>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> to donate the operator to Apache to be part of Airflow. That way it is
>>>>> 
>>>>> 
>>>> 
>>>> 
>>>> 
>>>> easy
>>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> to accept contributions from the community, improve and maintain it
>>>>> collectively and transparently, along with the Airflow-k8s
>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> integration.
>>> 
>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> This idea has been discussed at Google, and we have obtained all
>>>>> 
>>>>> 
>>>> 
>>>> 
>>>> 
>>>> necessary
>>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> approvals to donate the operator.
>>>>> 
>>>>> 
>>>>> 
>>>>> This discussion is to gather opinions from the community whether you
>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> all
>>> 
>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> think that it is a good idea. I personally think that this would be a
>>>>> 
>>>>> 
>>>> 
>>>> 
>>>> 
>>>> great
>>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> addition to Airflow.
>>>>> 
>>>>> 
>>>>> 
>>>>> Please express your thoughts or concerns if you have any.
>>>>> 
>>>>> 
>>>>> 
>>>>> The discussion will run for 72 hours, and if there is consensus on
>>>>> accepting the donation, we will move the code under the Apache
>>>>> organization, to be owned by the Airflow community. If consensus is
>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> not
>>> 
>>> 
>>>> 
>>>>> 
>>>>> 
>>>>> evident, we can have a vote after this discussion.
>>>>> 
>>>>> 
>>>>> 
>>>>> Thanks,
>>>>> Aizhamal
>>>>> 
>>>>> 
>>>>> 
>>>>> [1] https:/ / github. com/ GoogleCloudPlatform/ airflow-operator (
>>>>> https://github.com/GoogleCloudPlatform/airflow-operator )
>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
> 
> 
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Barni Seetharaman <ba...@google.com.INVALID>]

Thanks Aizhamal for starting the conversation.
Thanks to Daniel Imberman for his support over the last year.

Iam definitely maintaining it. Just trying to prioritize it among
other things.

regs
Barni

On Thu, Sep 12, 2019 at 10:45 AM Aizhamal Nurmamat kyzy <ai...@apache.org>
wrote:

> On Tao's comment: yes, the current author - Barni (cc'ed here) will
> continue to maintain the project :)
>
>
> On Thu, Sep 12, 2019 at 10:05 AM Daniel Imberman <
> dimberman.opensource@gmail.com> wrote:
>
>> +1 here!
>>
>> On Thu, Sep 12, 2019 at 10:20 AM Jarek Potiuk <Ja...@polidea.com>
>> wrote:
>>
>> > The name is indeed misleading. My proposal would be
>> > k8s-operator-for-airflow - this might make it unambiguous .
>> >
>> > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk <
>> Jarek.Potiuk@polidea.com
>> > >
>> > napisał:
>> >
>> > > Fantastic! Strong +1 from me.
>> > >
>> > > To alleviate some of the concerns - we @Polidea are just starting a
>> > > project for big and serious customer where we will most likely use and
>> > > extend Kubernetes Operator.
>> > >
>> > > We have 3 people that could become contributors and commiters day
>> one, so
>> > > we can already help building community for it. Looking forward to
>> > following
>> > > the Apache way in this case !
>> > >
>> > > J.
>> > >
>> > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng <fe...@gmail.com> wrote:
>> > >
>> > >> +1 as well. One question: does the original author still actively
>> > maintain
>> > >> or would like to continue maintaining the code base after the repo is
>> > >> moved
>> > >> to Airflow?
>> > >>
>> > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
>> > sumeet.manit@gmail.com
>> > >> >
>> > >> wrote:
>> > >>
>> > >> > Strong +1
>> > >> >
>> > >> > On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
>> > >> > aizhamal@apache.org>
>> > >> > wrote:
>> > >> >
>> > >> > > Hello Airflow community,
>> > >> > >
>> > >> > > Over the last year, an engineer at Google developed, and open
>> > sourced
>> > >> a
>> > >> > > Kubernetes operator to run Airflow[1]. Anyone can use it to
>> deploy
>> > >> > Airflow
>> > >> > > on their k8s cluster freely.
>> > >> > >
>> > >> > > There have been discussions among community members that it
>> would be
>> > >> > great
>> > >> > > to donate the operator to Apache to be part of Airflow. That way
>> it
>> > is
>> > >> > easy
>> > >> > > to accept contributions from the community, improve and maintain
>> it
>> > >> > > collectively and transparently, along with the Airflow-k8s
>> > >> integration.
>> > >> > >
>> > >> > > This idea has been discussed at Google, and we have obtained all
>> > >> > necessary
>> > >> > > approvals to donate the operator.
>> > >> > >
>> > >> > > This discussion is to gather opinions from the community whether
>> you
>> > >> all
>> > >> > > think that it is a good idea. I personally think that this would
>> be
>> > a
>> > >> > great
>> > >> > > addition to Airflow.
>> > >> > >
>> > >> > > Please express your thoughts or concerns if you have any.
>> > >> > >
>> > >> > > The discussion will run for 72 hours, and if there is consensus
>> on
>> > >> > > accepting the donation, we will move the code under the Apache
>> > >> > > organization, to be owned by the Airflow community. If consensus
>> is
>> > >> not
>> > >> > > evident, we can have a vote after this discussion.
>> > >> > >
>> > >> > > Thanks,
>> > >> > > Aizhamal
>> > >> > >
>> > >> > > [1] https://github.com/GoogleCloudPlatform/airflow-operator
>> > >> > >
>> > >> >
>> > >>
>> > >
>> > >
>> > >
>> >
>>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Aizhamal Nurmamat kyzy <ai...@apache.org>]

On Tao's comment: yes, the current author - Barni (cc'ed here) will
continue to maintain the project :)


On Thu, Sep 12, 2019 at 10:05 AM Daniel Imberman <
dimberman.opensource@gmail.com> wrote:

> +1 here!
>
> On Thu, Sep 12, 2019 at 10:20 AM Jarek Potiuk <Ja...@polidea.com>
> wrote:
>
> > The name is indeed misleading. My proposal would be
> > k8s-operator-for-airflow - this might make it unambiguous .
> >
> > czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk <
> Jarek.Potiuk@polidea.com
> > >
> > napisał:
> >
> > > Fantastic! Strong +1 from me.
> > >
> > > To alleviate some of the concerns - we @Polidea are just starting a
> > > project for big and serious customer where we will most likely use and
> > > extend Kubernetes Operator.
> > >
> > > We have 3 people that could become contributors and commiters day one,
> so
> > > we can already help building community for it. Looking forward to
> > following
> > > the Apache way in this case !
> > >
> > > J.
> > >
> > > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng <fe...@gmail.com> wrote:
> > >
> > >> +1 as well. One question: does the original author still actively
> > maintain
> > >> or would like to continue maintaining the code base after the repo is
> > >> moved
> > >> to Airflow?
> > >>
> > >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> > sumeet.manit@gmail.com
> > >> >
> > >> wrote:
> > >>
> > >> > Strong +1
> > >> >
> > >> > On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> > >> > aizhamal@apache.org>
> > >> > wrote:
> > >> >
> > >> > > Hello Airflow community,
> > >> > >
> > >> > > Over the last year, an engineer at Google developed, and open
> > sourced
> > >> a
> > >> > > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> > >> > Airflow
> > >> > > on their k8s cluster freely.
> > >> > >
> > >> > > There have been discussions among community members that it would
> be
> > >> > great
> > >> > > to donate the operator to Apache to be part of Airflow. That way
> it
> > is
> > >> > easy
> > >> > > to accept contributions from the community, improve and maintain
> it
> > >> > > collectively and transparently, along with the Airflow-k8s
> > >> integration.
> > >> > >
> > >> > > This idea has been discussed at Google, and we have obtained all
> > >> > necessary
> > >> > > approvals to donate the operator.
> > >> > >
> > >> > > This discussion is to gather opinions from the community whether
> you
> > >> all
> > >> > > think that it is a good idea. I personally think that this would
> be
> > a
> > >> > great
> > >> > > addition to Airflow.
> > >> > >
> > >> > > Please express your thoughts or concerns if you have any.
> > >> > >
> > >> > > The discussion will run for 72 hours, and if there is consensus on
> > >> > > accepting the donation, we will move the code under the Apache
> > >> > > organization, to be owned by the Airflow community. If consensus
> is
> > >> not
> > >> > > evident, we can have a vote after this discussion.
> > >> > >
> > >> > > Thanks,
> > >> > > Aizhamal
> > >> > >
> > >> > > [1] https://github.com/GoogleCloudPlatform/airflow-operator
> > >> > >
> > >> >
> > >>
> > >
> > >
> > >
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Daniel Imberman <di...@gmail.com>]

+1 here!

On Thu, Sep 12, 2019 at 10:20 AM Jarek Potiuk <Ja...@polidea.com>
wrote:

> The name is indeed misleading. My proposal would be
> k8s-operator-for-airflow - this might make it unambiguous .
>
> czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk <Jarek.Potiuk@polidea.com
> >
> napisał:
>
> > Fantastic! Strong +1 from me.
> >
> > To alleviate some of the concerns - we @Polidea are just starting a
> > project for big and serious customer where we will most likely use and
> > extend Kubernetes Operator.
> >
> > We have 3 people that could become contributors and commiters day one, so
> > we can already help building community for it. Looking forward to
> following
> > the Apache way in this case !
> >
> > J.
> >
> > On Thu, Sep 12, 2019 at 7:23 AM Tao Feng <fe...@gmail.com> wrote:
> >
> >> +1 as well. One question: does the original author still actively
> maintain
> >> or would like to continue maintaining the code base after the repo is
> >> moved
> >> to Airflow?
> >>
> >> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <
> sumeet.manit@gmail.com
> >> >
> >> wrote:
> >>
> >> > Strong +1
> >> >
> >> > On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> >> > aizhamal@apache.org>
> >> > wrote:
> >> >
> >> > > Hello Airflow community,
> >> > >
> >> > > Over the last year, an engineer at Google developed, and open
> sourced
> >> a
> >> > > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> >> > Airflow
> >> > > on their k8s cluster freely.
> >> > >
> >> > > There have been discussions among community members that it would be
> >> > great
> >> > > to donate the operator to Apache to be part of Airflow. That way it
> is
> >> > easy
> >> > > to accept contributions from the community, improve and maintain it
> >> > > collectively and transparently, along with the Airflow-k8s
> >> integration.
> >> > >
> >> > > This idea has been discussed at Google, and we have obtained all
> >> > necessary
> >> > > approvals to donate the operator.
> >> > >
> >> > > This discussion is to gather opinions from the community whether you
> >> all
> >> > > think that it is a good idea. I personally think that this would be
> a
> >> > great
> >> > > addition to Airflow.
> >> > >
> >> > > Please express your thoughts or concerns if you have any.
> >> > >
> >> > > The discussion will run for 72 hours, and if there is consensus on
> >> > > accepting the donation, we will move the code under the Apache
> >> > > organization, to be owned by the Airflow community. If consensus is
> >> not
> >> > > evident, we can have a vote after this discussion.
> >> > >
> >> > > Thanks,
> >> > > Aizhamal
> >> > >
> >> > > [1] https://github.com/GoogleCloudPlatform/airflow-operator
> >> > >
> >> >
> >>
> >
> >
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Jarek Potiuk <Ja...@polidea.com>]

The name is indeed misleading. My proposal would be
k8s-operator-for-airflow - this might make it unambiguous .

czw., 12 wrz 2019, 16:17 użytkownik Jarek Potiuk <Ja...@polidea.com>
napisał:

> Fantastic! Strong +1 from me.
>
> To alleviate some of the concerns - we @Polidea are just starting a
> project for big and serious customer where we will most likely use and
> extend Kubernetes Operator.
>
> We have 3 people that could become contributors and commiters day one, so
> we can already help building community for it. Looking forward to following
> the Apache way in this case !
>
> J.
>
> On Thu, Sep 12, 2019 at 7:23 AM Tao Feng <fe...@gmail.com> wrote:
>
>> +1 as well. One question: does the original author still actively maintain
>> or would like to continue maintaining the code base after the repo is
>> moved
>> to Airflow?
>>
>> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <sumeet.manit@gmail.com
>> >
>> wrote:
>>
>> > Strong +1
>> >
>> > On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
>> > aizhamal@apache.org>
>> > wrote:
>> >
>> > > Hello Airflow community,
>> > >
>> > > Over the last year, an engineer at Google developed, and open sourced
>> a
>> > > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
>> > Airflow
>> > > on their k8s cluster freely.
>> > >
>> > > There have been discussions among community members that it would be
>> > great
>> > > to donate the operator to Apache to be part of Airflow. That way it is
>> > easy
>> > > to accept contributions from the community, improve and maintain it
>> > > collectively and transparently, along with the Airflow-k8s
>> integration.
>> > >
>> > > This idea has been discussed at Google, and we have obtained all
>> > necessary
>> > > approvals to donate the operator.
>> > >
>> > > This discussion is to gather opinions from the community whether you
>> all
>> > > think that it is a good idea. I personally think that this would be a
>> > great
>> > > addition to Airflow.
>> > >
>> > > Please express your thoughts or concerns if you have any.
>> > >
>> > > The discussion will run for 72 hours, and if there is consensus on
>> > > accepting the donation, we will move the code under the Apache
>> > > organization, to be owned by the Airflow community. If consensus is
>> not
>> > > evident, we can have a vote after this discussion.
>> > >
>> > > Thanks,
>> > > Aizhamal
>> > >
>> > > [1] https://github.com/GoogleCloudPlatform/airflow-operator
>> > >
>> >
>>
>
>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Jarek Potiuk <Ja...@polidea.com>]

Fantastic! Strong +1 from me.

To alleviate some of the concerns - we @Polidea are just starting a project
for big and serious customer where we will most likely use and extend
Kubernetes Operator.

We have 3 people that could become contributors and commiters day one, so
we can already help building community for it. Looking forward to following
the Apache way in this case !

J.

On Thu, Sep 12, 2019 at 7:23 AM Tao Feng <fe...@gmail.com> wrote:

> +1 as well. One question: does the original author still actively maintain
> or would like to continue maintaining the code base after the repo is moved
> to Airflow?
>
> On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <su...@gmail.com>
> wrote:
>
> > Strong +1
> >
> > On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> > aizhamal@apache.org>
> > wrote:
> >
> > > Hello Airflow community,
> > >
> > > Over the last year, an engineer at Google developed, and open sourced a
> > > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> > Airflow
> > > on their k8s cluster freely.
> > >
> > > There have been discussions among community members that it would be
> > great
> > > to donate the operator to Apache to be part of Airflow. That way it is
> > easy
> > > to accept contributions from the community, improve and maintain it
> > > collectively and transparently, along with the Airflow-k8s integration.
> > >
> > > This idea has been discussed at Google, and we have obtained all
> > necessary
> > > approvals to donate the operator.
> > >
> > > This discussion is to gather opinions from the community whether you
> all
> > > think that it is a good idea. I personally think that this would be a
> > great
> > > addition to Airflow.
> > >
> > > Please express your thoughts or concerns if you have any.
> > >
> > > The discussion will run for 72 hours, and if there is consensus on
> > > accepting the donation, we will move the code under the Apache
> > > organization, to be owned by the Airflow community. If consensus is not
> > > evident, we can have a vote after this discussion.
> > >
> > > Thanks,
> > > Aizhamal
> > >
> > > [1] https://github.com/GoogleCloudPlatform/airflow-operator
> > >
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Kaxil Naik <ka...@gmail.com>]

Agree to Ash's comment.

On Thu, Sep 12, 2019, 11:37 Andrii Soldatenko <an...@gmail.com>
wrote:

> +1
> +1 to Ash comment, maybe "airflow-k8s-operator" or something in this
> manner.
>
> On Thu, Sep 12, 2019 at 12:25 PM Kaxil Naik <ka...@gmail.com> wrote:
>
> > +1
> >
> > On Thu, Sep 12, 2019, 10:22 Ash Berlin-Taylor <as...@apache.org> wrote:
> >
> > > +1
> > >
> > > My only "concern" is what we call it - the term operator clashes
> between
> > > Kubernetes and Airflow to mean different things.
> > >
> > > -ash
> > >
> > > On 12 September 2019 08:22:39 CEST, Tao Feng <fe...@gmail.com>
> > wrote:
> > > >+1 as well. One question: does the original author still actively
> > > >maintain
> > > >or would like to continue maintaining the code base after the repo is
> > > >moved
> > > >to Airflow?
> > > >
> > > >On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari
> > > ><su...@gmail.com>
> > > >wrote:
> > > >
> > > >> Strong +1
> > > >>
> > > >> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> > > >> aizhamal@apache.org>
> > > >> wrote:
> > > >>
> > > >> > Hello Airflow community,
> > > >> >
> > > >> > Over the last year, an engineer at Google developed, and open
> > > >sourced a
> > > >> > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> > > >> Airflow
> > > >> > on their k8s cluster freely.
> > > >> >
> > > >> > There have been discussions among community members that it would
> > > >be
> > > >> great
> > > >> > to donate the operator to Apache to be part of Airflow. That way
> it
> > > >is
> > > >> easy
> > > >> > to accept contributions from the community, improve and maintain
> it
> > > >> > collectively and transparently, along with the Airflow-k8s
> > > >integration.
> > > >> >
> > > >> > This idea has been discussed at Google, and we have obtained all
> > > >> necessary
> > > >> > approvals to donate the operator.
> > > >> >
> > > >> > This discussion is to gather opinions from the community whether
> > > >you all
> > > >> > think that it is a good idea. I personally think that this would
> be
> > > >a
> > > >> great
> > > >> > addition to Airflow.
> > > >> >
> > > >> > Please express your thoughts or concerns if you have any.
> > > >> >
> > > >> > The discussion will run for 72 hours, and if there is consensus on
> > > >> > accepting the donation, we will move the code under the Apache
> > > >> > organization, to be owned by the Airflow community. If consensus
> is
> > > >not
> > > >> > evident, we can have a vote after this discussion.
> > > >> >
> > > >> > Thanks,
> > > >> > Aizhamal
> > > >> >
> > > >> > [1] https://github.com/GoogleCloudPlatform/airflow-operator
> > > >> >
> > > >>
> > >
> >
>
>
> --
> Best regards,
>
> Andrii Soldatenko
> Python Developer
>
> skype: andrii.soldatenko
> andrii.soldatenko@gmail.com
> http://asoldatenko.com
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Andrii Soldatenko <an...@gmail.com>]

+1
+1 to Ash comment, maybe "airflow-k8s-operator" or something in this manner.

On Thu, Sep 12, 2019 at 12:25 PM Kaxil Naik <ka...@gmail.com> wrote:

> +1
>
> On Thu, Sep 12, 2019, 10:22 Ash Berlin-Taylor <as...@apache.org> wrote:
>
> > +1
> >
> > My only "concern" is what we call it - the term operator clashes between
> > Kubernetes and Airflow to mean different things.
> >
> > -ash
> >
> > On 12 September 2019 08:22:39 CEST, Tao Feng <fe...@gmail.com>
> wrote:
> > >+1 as well. One question: does the original author still actively
> > >maintain
> > >or would like to continue maintaining the code base after the repo is
> > >moved
> > >to Airflow?
> > >
> > >On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari
> > ><su...@gmail.com>
> > >wrote:
> > >
> > >> Strong +1
> > >>
> > >> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> > >> aizhamal@apache.org>
> > >> wrote:
> > >>
> > >> > Hello Airflow community,
> > >> >
> > >> > Over the last year, an engineer at Google developed, and open
> > >sourced a
> > >> > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> > >> Airflow
> > >> > on their k8s cluster freely.
> > >> >
> > >> > There have been discussions among community members that it would
> > >be
> > >> great
> > >> > to donate the operator to Apache to be part of Airflow. That way it
> > >is
> > >> easy
> > >> > to accept contributions from the community, improve and maintain it
> > >> > collectively and transparently, along with the Airflow-k8s
> > >integration.
> > >> >
> > >> > This idea has been discussed at Google, and we have obtained all
> > >> necessary
> > >> > approvals to donate the operator.
> > >> >
> > >> > This discussion is to gather opinions from the community whether
> > >you all
> > >> > think that it is a good idea. I personally think that this would be
> > >a
> > >> great
> > >> > addition to Airflow.
> > >> >
> > >> > Please express your thoughts or concerns if you have any.
> > >> >
> > >> > The discussion will run for 72 hours, and if there is consensus on
> > >> > accepting the donation, we will move the code under the Apache
> > >> > organization, to be owned by the Airflow community. If consensus is
> > >not
> > >> > evident, we can have a vote after this discussion.
> > >> >
> > >> > Thanks,
> > >> > Aizhamal
> > >> >
> > >> > [1] https://github.com/GoogleCloudPlatform/airflow-operator
> > >> >
> > >>
> >
>


-- 
Best regards,

Andrii Soldatenko
Python Developer

skype: andrii.soldatenko
andrii.soldatenko@gmail.com
http://asoldatenko.com

Re: [DISCUSS] Donating Airflow k8s Operator

[Kaxil Naik <ka...@gmail.com>]

+1

On Thu, Sep 12, 2019, 10:22 Ash Berlin-Taylor <as...@apache.org> wrote:

> +1
>
> My only "concern" is what we call it - the term operator clashes between
> Kubernetes and Airflow to mean different things.
>
> -ash
>
> On 12 September 2019 08:22:39 CEST, Tao Feng <fe...@gmail.com> wrote:
> >+1 as well. One question: does the original author still actively
> >maintain
> >or would like to continue maintaining the code base after the repo is
> >moved
> >to Airflow?
> >
> >On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari
> ><su...@gmail.com>
> >wrote:
> >
> >> Strong +1
> >>
> >> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> >> aizhamal@apache.org>
> >> wrote:
> >>
> >> > Hello Airflow community,
> >> >
> >> > Over the last year, an engineer at Google developed, and open
> >sourced a
> >> > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> >> Airflow
> >> > on their k8s cluster freely.
> >> >
> >> > There have been discussions among community members that it would
> >be
> >> great
> >> > to donate the operator to Apache to be part of Airflow. That way it
> >is
> >> easy
> >> > to accept contributions from the community, improve and maintain it
> >> > collectively and transparently, along with the Airflow-k8s
> >integration.
> >> >
> >> > This idea has been discussed at Google, and we have obtained all
> >> necessary
> >> > approvals to donate the operator.
> >> >
> >> > This discussion is to gather opinions from the community whether
> >you all
> >> > think that it is a good idea. I personally think that this would be
> >a
> >> great
> >> > addition to Airflow.
> >> >
> >> > Please express your thoughts or concerns if you have any.
> >> >
> >> > The discussion will run for 72 hours, and if there is consensus on
> >> > accepting the donation, we will move the code under the Apache
> >> > organization, to be owned by the Airflow community. If consensus is
> >not
> >> > evident, we can have a vote after this discussion.
> >> >
> >> > Thanks,
> >> > Aizhamal
> >> >
> >> > [1] https://github.com/GoogleCloudPlatform/airflow-operator
> >> >
> >>
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Ash Berlin-Taylor <as...@apache.org>]

+1

My only "concern" is what we call it - the term operator clashes between Kubernetes and Airflow to mean different things.

-ash

On 12 September 2019 08:22:39 CEST, Tao Feng <fe...@gmail.com> wrote:
>+1 as well. One question: does the original author still actively
>maintain
>or would like to continue maintaining the code base after the repo is
>moved
>to Airflow?
>
>On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari
><su...@gmail.com>
>wrote:
>
>> Strong +1
>>
>> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
>> aizhamal@apache.org>
>> wrote:
>>
>> > Hello Airflow community,
>> >
>> > Over the last year, an engineer at Google developed, and open
>sourced a
>> > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
>> Airflow
>> > on their k8s cluster freely.
>> >
>> > There have been discussions among community members that it would
>be
>> great
>> > to donate the operator to Apache to be part of Airflow. That way it
>is
>> easy
>> > to accept contributions from the community, improve and maintain it
>> > collectively and transparently, along with the Airflow-k8s
>integration.
>> >
>> > This idea has been discussed at Google, and we have obtained all
>> necessary
>> > approvals to donate the operator.
>> >
>> > This discussion is to gather opinions from the community whether
>you all
>> > think that it is a good idea. I personally think that this would be
>a
>> great
>> > addition to Airflow.
>> >
>> > Please express your thoughts or concerns if you have any.
>> >
>> > The discussion will run for 72 hours, and if there is consensus on
>> > accepting the donation, we will move the code under the Apache
>> > organization, to be owned by the Airflow community. If consensus is
>not
>> > evident, we can have a vote after this discussion.
>> >
>> > Thanks,
>> > Aizhamal
>> >
>> > [1] https://github.com/GoogleCloudPlatform/airflow-operator
>> >
>>

Re: [DISCUSS] Donating Airflow k8s Operator

[Tao Feng <fe...@gmail.com>]

+1 as well. One question: does the original author still actively maintain
or would like to continue maintaining the code base after the repo is moved
to Airflow?

On Wed, Sep 11, 2019 at 11:10 PM Sumit Maheshwari <su...@gmail.com>
wrote:

> Strong +1
>
> On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <
> aizhamal@apache.org>
> wrote:
>
> > Hello Airflow community,
> >
> > Over the last year, an engineer at Google developed, and open sourced a
> > Kubernetes operator to run Airflow[1]. Anyone can use it to deploy
> Airflow
> > on their k8s cluster freely.
> >
> > There have been discussions among community members that it would be
> great
> > to donate the operator to Apache to be part of Airflow. That way it is
> easy
> > to accept contributions from the community, improve and maintain it
> > collectively and transparently, along with the Airflow-k8s integration.
> >
> > This idea has been discussed at Google, and we have obtained all
> necessary
> > approvals to donate the operator.
> >
> > This discussion is to gather opinions from the community whether you all
> > think that it is a good idea. I personally think that this would be a
> great
> > addition to Airflow.
> >
> > Please express your thoughts or concerns if you have any.
> >
> > The discussion will run for 72 hours, and if there is consensus on
> > accepting the donation, we will move the code under the Apache
> > organization, to be owned by the Airflow community. If consensus is not
> > evident, we can have a vote after this discussion.
> >
> > Thanks,
> > Aizhamal
> >
> > [1] https://github.com/GoogleCloudPlatform/airflow-operator
> >
>

Re: [DISCUSS] Donating Airflow k8s Operator

[Sumit Maheshwari <su...@gmail.com>]

Strong +1

On Thu, Sep 12, 2019 at 7:29 AM Aizhamal Nurmamat kyzy <ai...@apache.org>
wrote:

> Hello Airflow community,
>
> Over the last year, an engineer at Google developed, and open sourced a
> Kubernetes operator to run Airflow[1]. Anyone can use it to deploy Airflow
> on their k8s cluster freely.
>
> There have been discussions among community members that it would be great
> to donate the operator to Apache to be part of Airflow. That way it is easy
> to accept contributions from the community, improve and maintain it
> collectively and transparently, along with the Airflow-k8s integration.
>
> This idea has been discussed at Google, and we have obtained all necessary
> approvals to donate the operator.
>
> This discussion is to gather opinions from the community whether you all
> think that it is a good idea. I personally think that this would be a great
> addition to Airflow.
>
> Please express your thoughts or concerns if you have any.
>
> The discussion will run for 72 hours, and if there is consensus on
> accepting the donation, we will move the code under the Apache
> organization, to be owned by the Airflow community. If consensus is not
> evident, we can have a vote after this discussion.
>
> Thanks,
> Aizhamal
>
> [1] https://github.com/GoogleCloudPlatform/airflow-operator
>