You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@aurora.apache.org by 卢义 <ma...@icloud.com> on 2016/01/22 03:33:39 UTC
Aurora blocks other frameworks
Hi,
I am running multiple frameworks on one mesos cluster (actually, only one machine). But when aurora-scheduler is running, other frameworks such as spark-shell and kafka-mesos stop working. It seems that aurora seize all resources.
How to solve this problem?
Louis
Re: Aurora blocks other frameworks
Posted by Bill Farner <wf...@apache.org>.
Additionally, you will want to disable the preemptor
(-enable_preemptor=false), as preemption in multi-framework mesos is
currently futile.
On Thu, Jan 21, 2016 at 6:53 PM, Maxim Khutornenko <ma...@apache.org> wrote:
> Make sure you are running from master as we just had a new feature
> committed that allows Aurora to consume named role resources [1]. With
> that patch you should be able to request named resources from Mesos
> via '-mesos_role' scheduler flag. That, of course, if you properly
> configure '-roles' setting in Mesos [2].
>
> Aurora holds on to offers for 5 minutes before rejecting them. This is
> configured via '-min_offer_hold_time' flag [3], so you'll likely want
> to tune that depending on your needs as well.
>
>
> [1] - https://reviews.apache.org/r/42126/
> [2] - http://mesos.apache.org/documentation/latest/configuration/
> [3] -
> https://github.com/apache/aurora/blob/749f83502f059ae6d2b229cf76c1ed44ccf3d255/src/main/java/org/apache/aurora/scheduler/offers/OffersModule.java#L34-L38
>
> On Thu, Jan 21, 2016 at 6:33 PM, 卢义 <ma...@icloud.com> wrote:
> > Hi,
> >
> >
> > I am running multiple frameworks on one mesos cluster (actually, only
> one machine). But when aurora-scheduler is running, other frameworks such
> as spark-shell and kafka-mesos stop working. It seems that aurora seize all
> resources.
> > How to solve this problem?
> >
> >
> > Louis
>
Re: Aurora blocks other frameworks
Posted by Maxim Khutornenko <ma...@apache.org>.
Make sure you are running from master as we just had a new feature
committed that allows Aurora to consume named role resources [1]. With
that patch you should be able to request named resources from Mesos
via '-mesos_role' scheduler flag. That, of course, if you properly
configure '-roles' setting in Mesos [2].
Aurora holds on to offers for 5 minutes before rejecting them. This is
configured via '-min_offer_hold_time' flag [3], so you'll likely want
to tune that depending on your needs as well.
[1] - https://reviews.apache.org/r/42126/
[2] - http://mesos.apache.org/documentation/latest/configuration/
[3] - https://github.com/apache/aurora/blob/749f83502f059ae6d2b229cf76c1ed44ccf3d255/src/main/java/org/apache/aurora/scheduler/offers/OffersModule.java#L34-L38
On Thu, Jan 21, 2016 at 6:33 PM, 卢义 <ma...@icloud.com> wrote:
> Hi,
>
>
> I am running multiple frameworks on one mesos cluster (actually, only one machine). But when aurora-scheduler is running, other frameworks such as spark-shell and kafka-mesos stop working. It seems that aurora seize all resources.
> How to solve this problem?
>
>
> Louis