You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@aurora.apache.org by Tony Dong <to...@tellapart.com> on 2014/10/16 03:11:23 UTC
Docker on Aurora
Hi,
I was wondering if there was a timeline for support of Docker on Aurora?
https://issues.apache.org/jira/browse/AURORA-633
Or if there's any good ways of running Docker on the current version of
Aurora.
Thanks,
Tony
Re: Docker on Aurora
Posted by Bill Farner <wf...@apache.org>.
Some folks have trailblazed into this territory with success, but AFAIK
it's not for the faint of heart. We have no timeline on first-class docker
support, but would love guidance and contributions! The docker support in
mesos is still very new, and there are some challenges to overcome,
specifically for users with custom executors (e.g.
https://issues.apache.org/jira/browse/MESOS-1659).
-=Bill
On Wed, Oct 15, 2014 at 6:11 PM, Tony Dong <to...@tellapart.com> wrote:
> Hi,
>
> I was wondering if there was a timeline for support of Docker on Aurora?
> https://issues.apache.org/jira/browse/AURORA-633
>
> Or if there's any good ways of running Docker on the current version of
> Aurora.
>
> Thanks,
> Tony
>
Re: Docker on Aurora
Posted by Jay Buffington <me...@jaybuff.com>.
Hi Dobromir,
We're still looking through the legalities of contributing to this
open source project. Watch AURORA-633. If I'm able to open source
it, I update that jira.
Jay
On Tue, Nov 4, 2014 at 8:49 AM, Dobromir Montauk <do...@tellapart.com> wrote:
> Quick update: I got some jobs running using Docker but ran into the
> expected problems (e.g. Mesos/Aurora could not track resources usage, files
> were unavailable from the UI, etc).
>
> Jay, is there anything we can do to help get the Docker support officially
> into Aurora?
>
> dB
>
> On Fri, Oct 17, 2014 at 8:08 PM, Bill Farner <wf...@apache.org> wrote:
>
>> Dobromir - that's awesome to hear. You should start by reaching out to Jay
>> to see what they've done. We're very interested in adding this support,
>> and would greatly benefit from folks like you and Jay filling us in on what
>> needs to change to make it happen.
>>
>> -=Bill
>>
>> On Fri, Oct 17, 2014 at 10:09 AM, Dobromir Montauk <dobromir@tellapart.com
>> >
>> wrote:
>>
>> > Thanks for the update. We'd be very interested in this feature and may
>> have
>> > cycles to contribute to it, if necessary - definitely for testing it out
>> :)
>> >
>> > Let us know what we could do.
>> >
>> > Dobromir
>> >
>> > On Thu, Oct 16, 2014 at 1:50 PM, Jay Buffington <me...@jaybuff.com> wrote:
>> >
>> > > I'm hoping that AURORA-633 will be up for code review in November.
>> > >
>> > > I believe the docker containerizer is the best way to use docker with
>> > > mesos (compared to other options like a docker executor or using the
>> > > external containerizer).
>> > >
>> > > Right now you can write an Aurora job that has processes which execute
>> > > "docker run" for you. There are three major problems:
>> > >
>> > > - requires you give the user that your task runs as elevated privileges
>> > > - garbage collection is trickey to get right (maybe you just use
>> > > docker run --rm all the time)
>> > > - your docker containers will run under a different cgroup as the task
>> > > that does "docker run"
>> > >
>> > > Jay
>> > >
>> > >
>> > >
>> > >
>> > > On Wed, Oct 15, 2014 at 6:11 PM, Tony Dong <to...@tellapart.com>
>> wrote:
>> > > > Hi,
>> > > >
>> > > > I was wondering if there was a timeline for support of Docker on
>> > Aurora?
>> > > > https://issues.apache.org/jira/browse/AURORA-633
>> > > >
>> > > > Or if there's any good ways of running Docker on the current version
>> of
>> > > > Aurora.
>> > > >
>> > > > Thanks,
>> > > > Tony
>> > >
>> >
>>
Re: Docker on Aurora
Posted by Dobromir Montauk <do...@tellapart.com>.
Quick update: I got some jobs running using Docker but ran into the
expected problems (e.g. Mesos/Aurora could not track resources usage, files
were unavailable from the UI, etc).
Jay, is there anything we can do to help get the Docker support officially
into Aurora?
dB
On Fri, Oct 17, 2014 at 8:08 PM, Bill Farner <wf...@apache.org> wrote:
> Dobromir - that's awesome to hear. You should start by reaching out to Jay
> to see what they've done. We're very interested in adding this support,
> and would greatly benefit from folks like you and Jay filling us in on what
> needs to change to make it happen.
>
> -=Bill
>
> On Fri, Oct 17, 2014 at 10:09 AM, Dobromir Montauk <dobromir@tellapart.com
> >
> wrote:
>
> > Thanks for the update. We'd be very interested in this feature and may
> have
> > cycles to contribute to it, if necessary - definitely for testing it out
> :)
> >
> > Let us know what we could do.
> >
> > Dobromir
> >
> > On Thu, Oct 16, 2014 at 1:50 PM, Jay Buffington <me...@jaybuff.com> wrote:
> >
> > > I'm hoping that AURORA-633 will be up for code review in November.
> > >
> > > I believe the docker containerizer is the best way to use docker with
> > > mesos (compared to other options like a docker executor or using the
> > > external containerizer).
> > >
> > > Right now you can write an Aurora job that has processes which execute
> > > "docker run" for you. There are three major problems:
> > >
> > > - requires you give the user that your task runs as elevated privileges
> > > - garbage collection is trickey to get right (maybe you just use
> > > docker run --rm all the time)
> > > - your docker containers will run under a different cgroup as the task
> > > that does "docker run"
> > >
> > > Jay
> > >
> > >
> > >
> > >
> > > On Wed, Oct 15, 2014 at 6:11 PM, Tony Dong <to...@tellapart.com>
> wrote:
> > > > Hi,
> > > >
> > > > I was wondering if there was a timeline for support of Docker on
> > Aurora?
> > > > https://issues.apache.org/jira/browse/AURORA-633
> > > >
> > > > Or if there's any good ways of running Docker on the current version
> of
> > > > Aurora.
> > > >
> > > > Thanks,
> > > > Tony
> > >
> >
>
Re: Docker on Aurora
Posted by Bill Farner <wf...@apache.org>.
Dobromir - that's awesome to hear. You should start by reaching out to Jay
to see what they've done. We're very interested in adding this support,
and would greatly benefit from folks like you and Jay filling us in on what
needs to change to make it happen.
-=Bill
On Fri, Oct 17, 2014 at 10:09 AM, Dobromir Montauk <do...@tellapart.com>
wrote:
> Thanks for the update. We'd be very interested in this feature and may have
> cycles to contribute to it, if necessary - definitely for testing it out :)
>
> Let us know what we could do.
>
> Dobromir
>
> On Thu, Oct 16, 2014 at 1:50 PM, Jay Buffington <me...@jaybuff.com> wrote:
>
> > I'm hoping that AURORA-633 will be up for code review in November.
> >
> > I believe the docker containerizer is the best way to use docker with
> > mesos (compared to other options like a docker executor or using the
> > external containerizer).
> >
> > Right now you can write an Aurora job that has processes which execute
> > "docker run" for you. There are three major problems:
> >
> > - requires you give the user that your task runs as elevated privileges
> > - garbage collection is trickey to get right (maybe you just use
> > docker run --rm all the time)
> > - your docker containers will run under a different cgroup as the task
> > that does "docker run"
> >
> > Jay
> >
> >
> >
> >
> > On Wed, Oct 15, 2014 at 6:11 PM, Tony Dong <to...@tellapart.com> wrote:
> > > Hi,
> > >
> > > I was wondering if there was a timeline for support of Docker on
> Aurora?
> > > https://issues.apache.org/jira/browse/AURORA-633
> > >
> > > Or if there's any good ways of running Docker on the current version of
> > > Aurora.
> > >
> > > Thanks,
> > > Tony
> >
>
Re: Docker on Aurora
Posted by Dobromir Montauk <do...@tellapart.com>.
Thanks for the update. We'd be very interested in this feature and may have
cycles to contribute to it, if necessary - definitely for testing it out :)
Let us know what we could do.
Dobromir
On Thu, Oct 16, 2014 at 1:50 PM, Jay Buffington <me...@jaybuff.com> wrote:
> I'm hoping that AURORA-633 will be up for code review in November.
>
> I believe the docker containerizer is the best way to use docker with
> mesos (compared to other options like a docker executor or using the
> external containerizer).
>
> Right now you can write an Aurora job that has processes which execute
> "docker run" for you. There are three major problems:
>
> - requires you give the user that your task runs as elevated privileges
> - garbage collection is trickey to get right (maybe you just use
> docker run --rm all the time)
> - your docker containers will run under a different cgroup as the task
> that does "docker run"
>
> Jay
>
>
>
>
> On Wed, Oct 15, 2014 at 6:11 PM, Tony Dong <to...@tellapart.com> wrote:
> > Hi,
> >
> > I was wondering if there was a timeline for support of Docker on Aurora?
> > https://issues.apache.org/jira/browse/AURORA-633
> >
> > Or if there's any good ways of running Docker on the current version of
> > Aurora.
> >
> > Thanks,
> > Tony
>
Re: Docker on Aurora
Posted by Jay Buffington <me...@jaybuff.com>.
I'm hoping that AURORA-633 will be up for code review in November.
I believe the docker containerizer is the best way to use docker with
mesos (compared to other options like a docker executor or using the
external containerizer).
Right now you can write an Aurora job that has processes which execute
"docker run" for you. There are three major problems:
- requires you give the user that your task runs as elevated privileges
- garbage collection is trickey to get right (maybe you just use
docker run --rm all the time)
- your docker containers will run under a different cgroup as the task
that does "docker run"
Jay
On Wed, Oct 15, 2014 at 6:11 PM, Tony Dong <to...@tellapart.com> wrote:
> Hi,
>
> I was wondering if there was a timeline for support of Docker on Aurora?
> https://issues.apache.org/jira/browse/AURORA-633
>
> Or if there's any good ways of running Docker on the current version of
> Aurora.
>
> Thanks,
> Tony