You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by Zhitao Li <zh...@gmail.com> on 2018/06/20 23:02:54 UTC
Support image and resource pre-fetching in Mesos
Hi,
We have been working on optimizing container launch latency in our Mesos
based stack, and one of the optimization we are considering is to pre-fetch
docker image and any necessary resources for the task/executor.
This is especially useful in "updating" of containers of long running
services.
Before delving into detailed proposal, I wonder if anyone has done similar
things or has similar requirements.
Thanks!
--
Cheers,
Zhitao Li
Re: Support image and resource pre-fetching in Mesos
Posted by Jason Lai <ja...@jasonlai.net>.
Good to see we have a proposal. Do we have any design docs about the
overall image management on agent?
Jason
On Wed, Jun 20, 2018 at 4:19 PM, Ilya Pronin <ip...@twopensource.com>
wrote:
> I've posted a proposal and a set of patches for image prefetching some
> time ago: https://issues.apache.org/jira/browse/MESOS-2824
>
> On Wed, Jun 20, 2018 at 4:04 PM, James Peach <jo...@gmail.com> wrote:
> >
> >> On Jun 20, 2018, at 4:02 PM, Zhitao Li <zh...@gmail.com> wrote:
> >>
> >> Hi,
> >>
> >> We have been working on optimizing container launch latency in our
> Mesos based stack,
> >
> > How are you measuring the launch latency?
> >
> >> and one of the optimization we are considering is to pre-fetch docker
> image and any necessary resources for the task/executor.
> >>
> >> This is especially useful in "updating" of containers of long running
> services.
> >>
> >> Before delving into detailed proposal, I wonder if anyone has done
> similar things or has similar requirements.
> >>
> >> Thanks!
> >>
> >> --
> >> Cheers,
> >>
> >> Zhitao Li
> >
>
Re: Support image and resource pre-fetching in Mesos
Posted by Ilya Pronin <ip...@twopensource.com>.
I've posted a proposal and a set of patches for image prefetching some
time ago: https://issues.apache.org/jira/browse/MESOS-2824
On Wed, Jun 20, 2018 at 4:04 PM, James Peach <jo...@gmail.com> wrote:
>
>> On Jun 20, 2018, at 4:02 PM, Zhitao Li <zh...@gmail.com> wrote:
>>
>> Hi,
>>
>> We have been working on optimizing container launch latency in our Mesos based stack,
>
> How are you measuring the launch latency?
>
>> and one of the optimization we are considering is to pre-fetch docker image and any necessary resources for the task/executor.
>>
>> This is especially useful in "updating" of containers of long running services.
>>
>> Before delving into detailed proposal, I wonder if anyone has done similar things or has similar requirements.
>>
>> Thanks!
>>
>> --
>> Cheers,
>>
>> Zhitao Li
>
Re: Support image and resource pre-fetching in Mesos
Posted by James Peach <jo...@gmail.com>.
> On Jun 20, 2018, at 4:02 PM, Zhitao Li <zh...@gmail.com> wrote:
>
> Hi,
>
> We have been working on optimizing container launch latency in our Mesos based stack,
How are you measuring the launch latency?
> and one of the optimization we are considering is to pre-fetch docker image and any necessary resources for the task/executor.
>
> This is especially useful in "updating" of containers of long running services.
>
> Before delving into detailed proposal, I wonder if anyone has done similar things or has similar requirements.
>
> Thanks!
>
> --
> Cheers,
>
> Zhitao Li
Re: Support image and resource pre-fetching in Mesos
Posted by James Peach <jo...@gmail.com>.
> On Jun 20, 2018, at 4:02 PM, Zhitao Li <zh...@gmail.com> wrote:
>
> Hi,
>
> We have been working on optimizing container launch latency in our Mesos based stack,
How are you measuring the launch latency?
> and one of the optimization we are considering is to pre-fetch docker image and any necessary resources for the task/executor.
>
> This is especially useful in "updating" of containers of long running services.
>
> Before delving into detailed proposal, I wonder if anyone has done similar things or has similar requirements.
>
> Thanks!
>
> --
> Cheers,
>
> Zhitao Li