You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by Niranda Perera <ni...@cse.mrt.ac.lk> on 2017/11/29 06:44:05 UTC
Kubernetes Executor
Hi all,
I am interested in this discussion on the Kubernetes executor [1].
Is there any way to access the current work that has been done on this
area? I was looking for any sources, but I couldn't find any unfortunately.
[1]
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=71013666
Best regards
Niranda Perera
Research Assistant
Dept of CSE, University of Moratuwa
niranda.17@cse.mrt.ac.lk
+94 71 554 8430
https://lk.linkedin.com/in/niranda
Re: Kubernetes Executor
Posted by Niranda Perera <ni...@cse.mrt.ac.lk>.
Hi Daniel,
I would love get involved with this. Let me know how I can contribute.
Best
Best regards
Niranda Perera
Research Assistant
Dept of CSE, University of Moratuwa
niranda.17@cse.mrt.ac.lk
+94 71 554 8430
https://lk.linkedin.com/in/niranda
On Wed, Nov 29, 2017 at 11:17 PM, Daniel Imberman <daniel.imberman@gmail.com
> wrote:
> Hi Niranda,
>
> One thing to note is we're actually re-writing the roadmap document since
> there have been pretty significant changes since it was released.
>
> Here is a more recent talk with an overview of the system and the features:
> https://www.youtube.com/watch?v=5BU3YPYYRno. We will also be discussing
> this feature at the airflow meetup next Monday at Airbnb if you are in the
> bay.
>
> We are one major feature away from a code freeze, where we would be glad
> for any help we can get in terms of stress/scale testing :).
>
> Let us know if you'd like to get involved!
>
> Daniel
>
> On Wed, Nov 29, 2017 at 9:26 AM Grant Nicholas <
> grantnicholas2015@u.northwestern.edu> wrote:
>
> > Here's where the active development is happening until it gets merged
> > upstream into airflow:
> > https://github.com/bloomberg/airflow/tree/airflow-kubernetes-executor
> >
> > Here's the roadmap toward the first release:
> > https://cwiki.apache.org/confluence/pages/viewpage.
> action?pageId=73633870
> >
> > Feel free to reach out and get involved, we can definitely use any help
> we
> > can get!
> >
> > On Wed, Nov 29, 2017 at 10:51 AM, Chris Riccomini <criccomini@apache.org
> >
> > wrote:
> >
> > > https://github.com/apache/incubator-airflow/pull/2414
> > >
> > > On Tue, Nov 28, 2017 at 10:44 PM, Niranda Perera <
> > niranda.17@cse.mrt.ac.lk
> > > >
> > > wrote:
> > >
> > > > Hi all,
> > > >
> > > > I am interested in this discussion on the Kubernetes executor [1].
> > > >
> > > > Is there any way to access the current work that has been done on
> this
> > > > area? I was looking for any sources, but I couldn't find any
> > > unfortunately.
> > > >
> > > > [1]
> > > > https://cwiki.apache.org/confluence/pages/viewpage.
> > > action?pageId=71013666
> > > >
> > > > Best regards
> > > >
> > > > Niranda Perera
> > > > Research Assistant
> > > > Dept of CSE, University of Moratuwa
> > > > niranda.17@cse.mrt.ac.lk
> > > > +94 71 554 8430 <+94%2071%20554%208430>
> > > > https://lk.linkedin.com/in/niranda
> > > >
> > >
> >
>
Re: Kubernetes Executor
Posted by Daniel Imberman <da...@gmail.com>.
Hi Niranda,
One thing to note is we're actually re-writing the roadmap document since
there have been pretty significant changes since it was released.
Here is a more recent talk with an overview of the system and the features:
https://www.youtube.com/watch?v=5BU3YPYYRno. We will also be discussing
this feature at the airflow meetup next Monday at Airbnb if you are in the
bay.
We are one major feature away from a code freeze, where we would be glad
for any help we can get in terms of stress/scale testing :).
Let us know if you'd like to get involved!
Daniel
On Wed, Nov 29, 2017 at 9:26 AM Grant Nicholas <
grantnicholas2015@u.northwestern.edu> wrote:
> Here's where the active development is happening until it gets merged
> upstream into airflow:
> https://github.com/bloomberg/airflow/tree/airflow-kubernetes-executor
>
> Here's the roadmap toward the first release:
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=73633870
>
> Feel free to reach out and get involved, we can definitely use any help we
> can get!
>
> On Wed, Nov 29, 2017 at 10:51 AM, Chris Riccomini <cr...@apache.org>
> wrote:
>
> > https://github.com/apache/incubator-airflow/pull/2414
> >
> > On Tue, Nov 28, 2017 at 10:44 PM, Niranda Perera <
> niranda.17@cse.mrt.ac.lk
> > >
> > wrote:
> >
> > > Hi all,
> > >
> > > I am interested in this discussion on the Kubernetes executor [1].
> > >
> > > Is there any way to access the current work that has been done on this
> > > area? I was looking for any sources, but I couldn't find any
> > unfortunately.
> > >
> > > [1]
> > > https://cwiki.apache.org/confluence/pages/viewpage.
> > action?pageId=71013666
> > >
> > > Best regards
> > >
> > > Niranda Perera
> > > Research Assistant
> > > Dept of CSE, University of Moratuwa
> > > niranda.17@cse.mrt.ac.lk
> > > +94 71 554 8430 <+94%2071%20554%208430>
> > > https://lk.linkedin.com/in/niranda
> > >
> >
>
Re: Kubernetes Executor
Posted by Grant Nicholas <gr...@u.northwestern.edu>.
Here's where the active development is happening until it gets merged
upstream into airflow:
https://github.com/bloomberg/airflow/tree/airflow-kubernetes-executor
Here's the roadmap toward the first release:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=73633870
Feel free to reach out and get involved, we can definitely use any help we
can get!
On Wed, Nov 29, 2017 at 10:51 AM, Chris Riccomini <cr...@apache.org>
wrote:
> https://github.com/apache/incubator-airflow/pull/2414
>
> On Tue, Nov 28, 2017 at 10:44 PM, Niranda Perera <niranda.17@cse.mrt.ac.lk
> >
> wrote:
>
> > Hi all,
> >
> > I am interested in this discussion on the Kubernetes executor [1].
> >
> > Is there any way to access the current work that has been done on this
> > area? I was looking for any sources, but I couldn't find any
> unfortunately.
> >
> > [1]
> > https://cwiki.apache.org/confluence/pages/viewpage.
> action?pageId=71013666
> >
> > Best regards
> >
> > Niranda Perera
> > Research Assistant
> > Dept of CSE, University of Moratuwa
> > niranda.17@cse.mrt.ac.lk
> > +94 71 554 8430
> > https://lk.linkedin.com/in/niranda
> >
>
Re: Kubernetes Executor
Posted by Chris Riccomini <cr...@apache.org>.
https://github.com/apache/incubator-airflow/pull/2414
On Tue, Nov 28, 2017 at 10:44 PM, Niranda Perera <ni...@cse.mrt.ac.lk>
wrote:
> Hi all,
>
> I am interested in this discussion on the Kubernetes executor [1].
>
> Is there any way to access the current work that has been done on this
> area? I was looking for any sources, but I couldn't find any unfortunately.
>
> [1]
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=71013666
>
> Best regards
>
> Niranda Perera
> Research Assistant
> Dept of CSE, University of Moratuwa
> niranda.17@cse.mrt.ac.lk
> +94 71 554 8430
> https://lk.linkedin.com/in/niranda
>