You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by Tobin Baker <td...@cs.washington.edu> on 2015/06/24 02:14:07 UTC
How do I allocate an Evaluator on a particular node?
Hi, in the course of porting the Myria project (
http://myria.cs.washington.edu/) to run on REEF, I need to allocate
Evaluators on particular nodes specified in a configuration file. At first
glance it seems that I should be able to do this with
EvaluatorRequest.Builder.fromDescriptor(NodeDescriptor), but I don't see
any way to get hold of a NodeDescriptor in the first place (except possibly
through the ResourceCatalog, but that is a private interface). The best I
can do for now is allocate as many containers as I have nodes, and hope
they're all on separate machines, and then look at the NodeDescriptor in
the EvaluatorDescriptor of the returned AllocatedEvaluator to determine the
node location (so I can schedule the correct Task on that node). That still
doesn't let me allocate Evaluators with different resource requirements on
particular nodes, though, which I really need to do. Since YARN can easily
do this, has REEF made a conscious decision not to expose this
functionality?
Thanks,
Tobin
Re: How do I allocate an Evaluator on a particular node?
Posted by Byung-Gon Chun <bg...@gmail.com>.
Welcome!
We heard from Brandon that you're interested in using REEF.
We're excited to hear that you're using REEF.
Cheers,
Gon
Sent from my iPhone
2015. 6. 24. 오전 3:06 Markus Weimer <ma...@weimo.de> 작성:
> Hi,
>
> welcome to the dev list!
>
>> in the course of porting the Myria project (
>> http://myria.cs.washington.edu/) to run on REEF
>
> cool! Please keep us in the loop how that goes. Most current users build
> *new* things on REEF. Porting experience can provide interesting feedback.
>
>> That still doesn't let me allocate Evaluators with different resource
>> requirements on particular nodes, though, which I really need to do.
>> Since YARN can easily do this, has REEF made a conscious decision not
>> to expose this functionality?
>
> Yes and no: REEF's `EvaluatorRequestor` is a least common denominator
> between all the resource managers we support (YARN, Mesos, Local). The
> targeting of individual nodes isn't part of that at this time.
>
> Individual resource manager plugins (we call them runtimes) can expose
> additional ways to request resources. That way, they can allow for the
> full fidelity of their underlying resource model. Our YARN runtime does
> that. In your Driver, you can have an instance of
>
> `org.apache.reef.runtime.yarn.driver.YarnContainerRequestHandler`
>
> provided as a constructor parameter. You can use that instead of the
> generic `EvaluatorRequestor` to fire off container requests. It accepts
> YARN's native `ContainerRequest` type, therefore exposing the fidelity
> of the YARN version you run to your application.
>
> Hope this helps,
>
> Markus
Re: How do I allocate an Evaluator on a particular node?
Posted by Markus Weimer <ma...@weimo.de>.
Hi,
> Kudos for cleanly exposing the native resource manager APIs! Glad you
> are heeding Butler Lampson's advice to interface designers "Don't
> hide power" :)
Thanks! We use dependency injection all over the place to avoid the
issues associated with having to specify (and maintain) an exact API.
This is a learning from the Hadoop mapred->mapreduce->mapred fiasco.
This also allows us to support alternative APIs as this one.
That said: As you have seen, discovery of these alternative API paths is
tricky. Maybe the next project will learn from that challenge :-)
Markus
Re: How do I allocate an Evaluator on a particular node?
Posted by Tobin Baker <td...@cs.washington.edu>.
Thanks, that looks like exactly what I need! We're standardizing on YARN
for now, so dropping down to YARN APIs shouldn't be a problem. Kudos for
cleanly exposing the native resource manager APIs! Glad you are heeding
Butler Lampson's advice to interface designers "Don't hide power" :)
I'll probably have plenty more questions as I continue with this project,
but that unblocks me for now :) Thanks again for the prompt response!
-Tobin
On Tue, Jun 23, 2015 at 6:06 PM, Markus Weimer <ma...@weimo.de> wrote:
> Hi,
>
> welcome to the dev list!
>
> > in the course of porting the Myria project (
> > http://myria.cs.washington.edu/) to run on REEF
>
> cool! Please keep us in the loop how that goes. Most current users build
> *new* things on REEF. Porting experience can provide interesting feedback.
>
> > That still doesn't let me allocate Evaluators with different resource
> > requirements on particular nodes, though, which I really need to do.
> > Since YARN can easily do this, has REEF made a conscious decision not
> > to expose this functionality?
>
> Yes and no: REEF's `EvaluatorRequestor` is a least common denominator
> between all the resource managers we support (YARN, Mesos, Local). The
> targeting of individual nodes isn't part of that at this time.
>
> Individual resource manager plugins (we call them runtimes) can expose
> additional ways to request resources. That way, they can allow for the
> full fidelity of their underlying resource model. Our YARN runtime does
> that. In your Driver, you can have an instance of
>
> `org.apache.reef.runtime.yarn.driver.YarnContainerRequestHandler`
>
> provided as a constructor parameter. You can use that instead of the
> generic `EvaluatorRequestor` to fire off container requests. It accepts
> YARN's native `ContainerRequest` type, therefore exposing the fidelity
> of the YARN version you run to your application.
>
> Hope this helps,
>
> Markus
>
Re: How do I allocate an Evaluator on a particular node?
Posted by Markus Weimer <ma...@weimo.de>.
Hi,
welcome to the dev list!
> in the course of porting the Myria project (
> http://myria.cs.washington.edu/) to run on REEF
cool! Please keep us in the loop how that goes. Most current users build
*new* things on REEF. Porting experience can provide interesting feedback.
> That still doesn't let me allocate Evaluators with different resource
> requirements on particular nodes, though, which I really need to do.
> Since YARN can easily do this, has REEF made a conscious decision not
> to expose this functionality?
Yes and no: REEF's `EvaluatorRequestor` is a least common denominator
between all the resource managers we support (YARN, Mesos, Local). The
targeting of individual nodes isn't part of that at this time.
Individual resource manager plugins (we call them runtimes) can expose
additional ways to request resources. That way, they can allow for the
full fidelity of their underlying resource model. Our YARN runtime does
that. In your Driver, you can have an instance of
`org.apache.reef.runtime.yarn.driver.YarnContainerRequestHandler`
provided as a constructor parameter. You can use that instead of the
generic `EvaluatorRequestor` to fire off container requests. It accepts
YARN's native `ContainerRequest` type, therefore exposing the fidelity
of the YARN version you run to your application.
Hope this helps,
Markus