You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Steve Loughran <st...@hortonworks.com> on 2013/09/23 14:31:27 UTC
correlating container allocation responses with specific requests
Before I file a JIRA against it, is there an easly/obvious way to go from a
container allocation response, onContainersAllocated(List<Container>
containers), to the specific request made of every container.
I need to track which requests have been satisfied, and i can't see an easy
way to do it, because the allocation responses don't include any
information on which
requests map to specific containers. As a result, I can't easily track
which container requests are outstanding.
-steve
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
RE: correlating container allocation responses with specific requests
Posted by Bikas Saha <bi...@hortonworks.com>.
To be clear, this method will return the requests that match the priority
and location and can fit in the capability provided. The fit takes care of
any adjustments made by the YARN scheduler.
Bikas
-----Original Message-----
From: Sandy Ryza [mailto:sandy.ryza@cloudera.com]
Sent: Monday, September 23, 2013 5:44 AM
To: yarn-dev@hadoop.apache.org
Subject: Re: correlating container allocation responses with specific
requests
Hi Steve,
This is done with AMRMClient#getMatchingRequests. You feed in the
priority, location, and capability of the container you were allocated and
it gives you a list of ContainerRequests you filed that could have
produced your allocation. Is this sufficient for what you need?
-Sandy
On Mon, Sep 23, 2013 at 5:31 AM, Steve Loughran
<st...@hortonworks.com>wrote:
> Before I file a JIRA against it, is there an easly/obvious way to go
> from a container allocation response,
> onContainersAllocated(List<Container>
> containers), to the specific request made of every container.
>
> I need to track which requests have been satisfied, and i can't see an
> easy way to do it, because the allocation responses don't include any
> information on which requests map to specific containers. As a result,
> I can't easily track which container requests are outstanding.
>
> -steve
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or
> entity to which it is addressed and may contain information that is
> confidential, privileged and exempt from disclosure under applicable
> law. If the reader of this message is not the intended recipient, you
> are hereby notified that any printing, copying, dissemination,
> distribution, disclosure or forwarding of this communication is
> strictly prohibited. If you have received this communication in error,
> please contact the sender immediately and delete it from your system.
Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: correlating container allocation responses with specific requests
Posted by Sandy Ryza <sa...@cloudera.com>.
Hi Steve,
This is done with AMRMClient#getMatchingRequests. You feed in the
priority, location, and capability of the container you were allocated and
it gives you a list of ContainerRequests you filed that could have produced
your allocation. Is this sufficient for what you need?
-Sandy
On Mon, Sep 23, 2013 at 5:31 AM, Steve Loughran <st...@hortonworks.com>wrote:
> Before I file a JIRA against it, is there an easly/obvious way to go from a
> container allocation response, onContainersAllocated(List<Container>
> containers), to the specific request made of every container.
>
> I need to track which requests have been satisfied, and i can't see an easy
> way to do it, because the allocation responses don't include any
> information on which
> requests map to specific containers. As a result, I can't easily track
> which container requests are outstanding.
>
> -steve
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>