Question about resource allocator

[HUO Jing <hu...@ihep.ac.cn>]

Hi,
Is there any other Resource allocation algorithm for mesos ?
The DRF algorithm is not very suitable for me.
I want to use an allocation algorithm which is like the capacity scheduler of Hadoop.

Thank you very much!

Huojing

Re: Question about resource allocator

[Benjamin Mahler <be...@gmail.com>]

Hi Huojing,

Can you provide more information? What in particular has not been very
suitable with DRF?

I ask because with the current implementation of DRF, one has to make use
of reservations to ensure fairness. This is because we do not have
revocation of offers implemented, and so a greedy framework can monopolize
all of the resources in the cluster.

Without revocation, once a framework has accepted an offer, we cannot
revoke it. So if framework A begins and makes use of all resource offers,
framework B that starts later may not be able to receive any offers, unless
reservations are in place on the slaves.

However, with revocation, it becomes possible for us to apply a weighted
fairness constraint by revoking existing offers if necessary. It also
becomes possible to safely make use of offers outside of one's own
reservation, knowing that these offers are 'revocable' and thus may be
revoked at any time.

Is this at all what you were encountering? How are you running your Mesos
cluster?

Ben


On Sat, Jan 11, 2014 at 12:38 AM, HUO Jing <hu...@ihep.ac.cn> wrote:

> Hi,
> Is there any other Resource allocation algorithm for mesos ?
> The DRF algorithm is not very suitable for me.
> I want to use an allocation algorithm which is like the capacity scheduler
> of Hadoop.
>
> Thank you very much!
>
> Huojing
>