You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by haosdent <ha...@gmail.com> on 2015/03/13 15:51:48 UTC
How to sizing memory in mesos
Hello, I write a redis service based on Mesos. And I have a problem: when I
launch a executor with a resource offer, how could I allocate more memory
or reduce memory for this running executor? Are there any API relates to
this? Thank you in advance.
--
Best Regards,
Haosdent Huang
Re: How to sizing memory in mesos
Posted by Christos Kozyrakis <ch...@mesosphere.io>.
We should implement something like ballooning. It can be very convenient
for such use cases.
See vmware's ballooning
<http://www.vmware.com/files/pdf/perf-vsphere-memory_management.pdf> for
details.
On Fri, Mar 13, 2015 at 10:53 AM, Vinod Kone <vi...@apache.org> wrote:
> The only way you can increase or decrease memory for an executor is by
> launching/killing tasks. So you could presumably use no-op tasks to achieve
> what you want.
>
> On Fri, Mar 13, 2015 at 7:51 AM, haosdent <ha...@gmail.com> wrote:
>
> > Hello, I write a redis service based on Mesos. And I have a problem: when
> > I launch a executor with a resource offer, how could I allocate more
> memory
> > or reduce memory for this running executor? Are there any API relates to
> > this? Thank you in advance.
> >
> > --
> > Best Regards,
> > Haosdent Huang
> >
>
Re: How to sizing memory in mesos
Posted by haosdent <ha...@gmail.com>.
Thank you for your link. Let me check out it. Maybe I could add it to our
mesos branch.
On Mon, Mar 16, 2015 at 12:07 PM, Adam Bordelon <ad...@mesosphere.io> wrote:
> There's also the previously discussed ResizeTask primitive:
> https://issues.apache.org/jira/browse/MESOS-1279
> Yifan wrote an initial proof-of-concept patch that could probably be
> resurrected and cleaned up.
>
> On Fri, Mar 13, 2015 at 2:28 PM, Tim St Clair <ts...@redhat.com> wrote:
>
>> fwiw - other systems also have attributes on the job/submission side as
>> well as the machine side.
>> The job attributes are updated every time they are evicted, and the
>> requirements could be adjusted by expression.
>>
>> This allows for expressive steering mechanics.
>>
>> Cheers,
>> Tim
>> ----- Original Message -----
>>
>> > From: "Vinod Kone" <vi...@apache.org>
>> > To: user@mesos.apache.org
>> > Cc: "dev" <de...@mesos.apache.org>
>> > Sent: Friday, March 13, 2015 12:53:06 PM
>> > Subject: Re: How to sizing memory in mesos
>>
>> > The only way you can increase or decrease memory for an executor is by
>> > launching/killing tasks. So you could presumably use no-op tasks to
>> achieve
>> > what you want.
>>
>> > On Fri, Mar 13, 2015 at 7:51 AM, haosdent < haosdent@gmail.com > wrote:
>>
>> > > Hello, I write a redis service based on Mesos. And I have a problem:
>> when I
>> > > launch a executor with a resource offer, how could I allocate more
>> memory
>> > > or
>> > > reduce memory for this running executor? Are there any API relates to
>> this?
>> > > Thank you in advance.
>> >
>>
>> > > --
>> >
>> > > Best Regards,
>> >
>> > > Haosdent Huang
>> >
>>
>> --
>> Cheers,
>> Timothy St. Clair
>> Red Hat Inc.
>>
>
>
--
Best Regards,
Haosdent Huang
Re: How to sizing memory in mesos
Posted by Adam Bordelon <ad...@mesosphere.io>.
There's also the previously discussed ResizeTask primitive:
https://issues.apache.org/jira/browse/MESOS-1279
Yifan wrote an initial proof-of-concept patch that could probably be
resurrected and cleaned up.
On Fri, Mar 13, 2015 at 2:28 PM, Tim St Clair <ts...@redhat.com> wrote:
> fwiw - other systems also have attributes on the job/submission side as
> well as the machine side.
> The job attributes are updated every time they are evicted, and the
> requirements could be adjusted by expression.
>
> This allows for expressive steering mechanics.
>
> Cheers,
> Tim
> ----- Original Message -----
>
> > From: "Vinod Kone" <vi...@apache.org>
> > To: user@mesos.apache.org
> > Cc: "dev" <de...@mesos.apache.org>
> > Sent: Friday, March 13, 2015 12:53:06 PM
> > Subject: Re: How to sizing memory in mesos
>
> > The only way you can increase or decrease memory for an executor is by
> > launching/killing tasks. So you could presumably use no-op tasks to
> achieve
> > what you want.
>
> > On Fri, Mar 13, 2015 at 7:51 AM, haosdent < haosdent@gmail.com > wrote:
>
> > > Hello, I write a redis service based on Mesos. And I have a problem:
> when I
> > > launch a executor with a resource offer, how could I allocate more
> memory
> > > or
> > > reduce memory for this running executor? Are there any API relates to
> this?
> > > Thank you in advance.
> >
>
> > > --
> >
> > > Best Regards,
> >
> > > Haosdent Huang
> >
>
> --
> Cheers,
> Timothy St. Clair
> Red Hat Inc.
>
Re: How to sizing memory in mesos
Posted by Adam Bordelon <ad...@mesosphere.io>.
There's also the previously discussed ResizeTask primitive:
https://issues.apache.org/jira/browse/MESOS-1279
Yifan wrote an initial proof-of-concept patch that could probably be
resurrected and cleaned up.
On Fri, Mar 13, 2015 at 2:28 PM, Tim St Clair <ts...@redhat.com> wrote:
> fwiw - other systems also have attributes on the job/submission side as
> well as the machine side.
> The job attributes are updated every time they are evicted, and the
> requirements could be adjusted by expression.
>
> This allows for expressive steering mechanics.
>
> Cheers,
> Tim
> ----- Original Message -----
>
> > From: "Vinod Kone" <vi...@apache.org>
> > To: user@mesos.apache.org
> > Cc: "dev" <de...@mesos.apache.org>
> > Sent: Friday, March 13, 2015 12:53:06 PM
> > Subject: Re: How to sizing memory in mesos
>
> > The only way you can increase or decrease memory for an executor is by
> > launching/killing tasks. So you could presumably use no-op tasks to
> achieve
> > what you want.
>
> > On Fri, Mar 13, 2015 at 7:51 AM, haosdent < haosdent@gmail.com > wrote:
>
> > > Hello, I write a redis service based on Mesos. And I have a problem:
> when I
> > > launch a executor with a resource offer, how could I allocate more
> memory
> > > or
> > > reduce memory for this running executor? Are there any API relates to
> this?
> > > Thank you in advance.
> >
>
> > > --
> >
> > > Best Regards,
> >
> > > Haosdent Huang
> >
>
> --
> Cheers,
> Timothy St. Clair
> Red Hat Inc.
>
Re: How to sizing memory in mesos
Posted by Tim St Clair <ts...@redhat.com>.
fwiw - other systems also have attributes on the job/submission side as well as the machine side.
The job attributes are updated every time they are evicted, and the requirements could be adjusted by expression.
This allows for expressive steering mechanics.
Cheers,
Tim
----- Original Message -----
> From: "Vinod Kone" <vi...@apache.org>
> To: user@mesos.apache.org
> Cc: "dev" <de...@mesos.apache.org>
> Sent: Friday, March 13, 2015 12:53:06 PM
> Subject: Re: How to sizing memory in mesos
> The only way you can increase or decrease memory for an executor is by
> launching/killing tasks. So you could presumably use no-op tasks to achieve
> what you want.
> On Fri, Mar 13, 2015 at 7:51 AM, haosdent < haosdent@gmail.com > wrote:
> > Hello, I write a redis service based on Mesos. And I have a problem: when I
> > launch a executor with a resource offer, how could I allocate more memory
> > or
> > reduce memory for this running executor? Are there any API relates to this?
> > Thank you in advance.
>
> > --
>
> > Best Regards,
>
> > Haosdent Huang
>
--
Cheers,
Timothy St. Clair
Red Hat Inc.
Re: How to sizing memory in mesos
Posted by Tim St Clair <ts...@redhat.com>.
fwiw - other systems also have attributes on the job/submission side as well as the machine side.
The job attributes are updated every time they are evicted, and the requirements could be adjusted by expression.
This allows for expressive steering mechanics.
Cheers,
Tim
----- Original Message -----
> From: "Vinod Kone" <vi...@apache.org>
> To: user@mesos.apache.org
> Cc: "dev" <de...@mesos.apache.org>
> Sent: Friday, March 13, 2015 12:53:06 PM
> Subject: Re: How to sizing memory in mesos
> The only way you can increase or decrease memory for an executor is by
> launching/killing tasks. So you could presumably use no-op tasks to achieve
> what you want.
> On Fri, Mar 13, 2015 at 7:51 AM, haosdent < haosdent@gmail.com > wrote:
> > Hello, I write a redis service based on Mesos. And I have a problem: when I
> > launch a executor with a resource offer, how could I allocate more memory
> > or
> > reduce memory for this running executor? Are there any API relates to this?
> > Thank you in advance.
>
> > --
>
> > Best Regards,
>
> > Haosdent Huang
>
--
Cheers,
Timothy St. Clair
Red Hat Inc.
Re: How to sizing memory in mesos
Posted by Vinod Kone <vi...@apache.org>.
The only way you can increase or decrease memory for an executor is by
launching/killing tasks. So you could presumably use no-op tasks to achieve
what you want.
On Fri, Mar 13, 2015 at 7:51 AM, haosdent <ha...@gmail.com> wrote:
> Hello, I write a redis service based on Mesos. And I have a problem: when
> I launch a executor with a resource offer, how could I allocate more memory
> or reduce memory for this running executor? Are there any API relates to
> this? Thank you in advance.
>
> --
> Best Regards,
> Haosdent Huang
>
Re: How to sizing memory in mesos
Posted by Vinod Kone <vi...@apache.org>.
The only way you can increase or decrease memory for an executor is by
launching/killing tasks. So you could presumably use no-op tasks to achieve
what you want.
On Fri, Mar 13, 2015 at 7:51 AM, haosdent <ha...@gmail.com> wrote:
> Hello, I write a redis service based on Mesos. And I have a problem: when
> I launch a executor with a resource offer, how could I allocate more memory
> or reduce memory for this running executor? Are there any API relates to
> this? Thank you in advance.
>
> --
> Best Regards,
> Haosdent Huang
>