[jira] [Comment Edited] (MESOS-6113) Offer Quota resources as revocable

["Guangya Liu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MESOS-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15460347#comment-15460347 ] 

Guangya Liu edited comment on MESOS-6113 at 9/3/16 4:35 AM:
------------------------------------------------------------

Does the section section in MESOS-4392 help? It is saying lend out the un-used quota to other framework and reclaim them back when needed.

{code}
A greedy analytics batch system wants to use as much of the cluster as possible to maximize computational throughput. When a competing web service with fixed task size starts up, there must be sufficient resources to run it immediately. The operator can reserve these resources by setting quota. However, if these resources are kept idle until the service is in use, this is wasteful from the analytics job's point of view. On the other hand, the analytics job should hand back reserved resources to the service when needed to avoid starvation of the latter.
{code}


was (Author: gyliu):
Does the section section in MESOS-4392 help? It is saying lend out the un-used quota to other framework and reclaim them back when needed.

{quota}
A greedy analytics batch system wants to use as much of the cluster as possible to maximize computational throughput. When a competing web service with fixed task size starts up, there must be sufficient resources to run it immediately. The operator can reserve these resources by setting quota. However, if these resources are kept idle until the service is in use, this is wasteful from the analytics job's point of view. On the other hand, the analytics job should hand back reserved resources to the service when needed to avoid starvation of the latter.
{quota}

> Offer Quota resources as revocable
> ----------------------------------
>
>                 Key: MESOS-6113
>                 URL: https://issues.apache.org/jira/browse/MESOS-6113
>             Project: Mesos
>          Issue Type: Task
>          Components: allocation
>    Affects Versions: 1.0.1
>            Reporter: Michael Gummelt
>
> *Goal:*
> I have high-priority Spark jobs, and best-effort jobs.  I need my high-priority jobs to pre-empt my best-effort jobs, so I'd like to launch the best-effort jobs on revocable resources. 
> *Problem:*
> Revocable resources are currently only created via oversubscription, where resources allocated to but not used by a framework will be offered to other frameworks.  This doesn't support the ability for a high-pri framework to start up and pre-empty a low-pri framework.
> *Solution:*
> Let's allow quota (and ideally any reserved resources) to be configurable to be offered as revocable resources to other frameworks that don't register with the role.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)