You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Krishna Kishore Bonagiri <wr...@gmail.com> on 2013/09/27 17:31:15 UTC
Can container requests be made paralelly from multiple threads
Hi,
Can we submit container requests from multiple threads in parallel to the
Resource Manager?
Thanks,
Kishore
Re: Can container requests be made paralelly from multiple threads
Posted by Jian He <jh...@hortonworks.com>.
Hi,
If you adopt hadoop-2.1-beta, StartContainerRequest is changed to
StartContainer(s)Request, meaning it can accept a list of container start
requests and start those containers in one RPC call.
Jian
On Fri, Sep 27, 2013 at 1:06 PM, Omkar Joshi <oj...@hortonworks.com> wrote:
> My point is why you want multiple threads as a part of single AM talking
> to RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
> the requirement is to have multiple requestor requesting resources then it
> should be clubbed into one single request and sent to RM. One more thing
> may be related to this. When AM makes a request to RM; today it gets
> resources only if earlier NM heartbeat resulted into RM scheduling one for
> it. So multiplexing AMRM requests wont help anyway but it will only
> complicate things on RM side. Scheduler is not kicked in (synchronously)
> when AM makes a request.
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi Omkar,
>>
>> Thanks for the quick reply. I have a requirement for sets of containers
>> depending on some of my business logic. I found that each of the request
>> allocations is taking around 2 seconds, so I am thinking of doing the
>> requests at the same from multiple threads.
>>
>> Kishore
>>
>>
>> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>>
>>> Hi,
>>>
>>> I suggest you should not do that. After YARN-744 goes in this will be
>>> prevented on RM side. May I know why you want to do this? any advantage/
>>> use case?
>>>
>>> Thanks,
>>> Omkar Joshi
>>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>>
>>>
>>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>>> write2kishore@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Can we submit container requests from multiple threads in parallel to
>>>> the Resource Manager?
>>>>
>>>> Thanks,
>>>> Kishore
>>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Omkar,
I have a distributed application that I am trying to port to YARN. My
application does many things in multiple threads in parallel, and those
threads in turn run some executables (how many of them depends on some
business logic and is variable). Now I am trying to launch those
executables on the containers acquired from the YARN's RM. If I could make
requests for containers from those parallel threads itself my life would be
much easier.
On Sat, Sep 28, 2013 at 1:36 AM, Omkar Joshi <oj...@hortonworks.com> wrote:
> My point is why you want multiple threads as a part of single AM talking
> to RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
> the requirement is to have multiple requestor requesting resources then it
> should be clubbed into one single request and sent to RM. One more thing
> may be related to this. When AM makes a request to RM; today it gets
> resources only if earlier NM heartbeat resulted into RM scheduling one for
> it. So multiplexing AMRM requests wont help anyway but it will only
> complicate things on RM side. Scheduler is not kicked in (synchronously)
> when AM makes a request.
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi Omkar,
>>
>> Thanks for the quick reply. I have a requirement for sets of containers
>> depending on some of my business logic. I found that each of the request
>> allocations is taking around 2 seconds, so I am thinking of doing the
>> requests at the same from multiple threads.
>>
>> Kishore
>>
>>
>> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>>
>>> Hi,
>>>
>>> I suggest you should not do that. After YARN-744 goes in this will be
>>> prevented on RM side. May I know why you want to do this? any advantage/
>>> use case?
>>>
>>> Thanks,
>>> Omkar Joshi
>>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>>
>>>
>>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>>> write2kishore@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Can we submit container requests from multiple threads in parallel to
>>>> the Resource Manager?
>>>>
>>>> Thanks,
>>>> Kishore
>>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Can container requests be made paralelly from multiple threads
Posted by Jian He <jh...@hortonworks.com>.
Hi,
If you adopt hadoop-2.1-beta, StartContainerRequest is changed to
StartContainer(s)Request, meaning it can accept a list of container start
requests and start those containers in one RPC call.
Jian
On Fri, Sep 27, 2013 at 1:06 PM, Omkar Joshi <oj...@hortonworks.com> wrote:
> My point is why you want multiple threads as a part of single AM talking
> to RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
> the requirement is to have multiple requestor requesting resources then it
> should be clubbed into one single request and sent to RM. One more thing
> may be related to this. When AM makes a request to RM; today it gets
> resources only if earlier NM heartbeat resulted into RM scheduling one for
> it. So multiplexing AMRM requests wont help anyway but it will only
> complicate things on RM side. Scheduler is not kicked in (synchronously)
> when AM makes a request.
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi Omkar,
>>
>> Thanks for the quick reply. I have a requirement for sets of containers
>> depending on some of my business logic. I found that each of the request
>> allocations is taking around 2 seconds, so I am thinking of doing the
>> requests at the same from multiple threads.
>>
>> Kishore
>>
>>
>> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>>
>>> Hi,
>>>
>>> I suggest you should not do that. After YARN-744 goes in this will be
>>> prevented on RM side. May I know why you want to do this? any advantage/
>>> use case?
>>>
>>> Thanks,
>>> Omkar Joshi
>>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>>
>>>
>>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>>> write2kishore@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Can we submit container requests from multiple threads in parallel to
>>>> the Resource Manager?
>>>>
>>>> Thanks,
>>>> Kishore
>>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Omkar,
I have a distributed application that I am trying to port to YARN. My
application does many things in multiple threads in parallel, and those
threads in turn run some executables (how many of them depends on some
business logic and is variable). Now I am trying to launch those
executables on the containers acquired from the YARN's RM. If I could make
requests for containers from those parallel threads itself my life would be
much easier.
On Sat, Sep 28, 2013 at 1:36 AM, Omkar Joshi <oj...@hortonworks.com> wrote:
> My point is why you want multiple threads as a part of single AM talking
> to RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
> the requirement is to have multiple requestor requesting resources then it
> should be clubbed into one single request and sent to RM. One more thing
> may be related to this. When AM makes a request to RM; today it gets
> resources only if earlier NM heartbeat resulted into RM scheduling one for
> it. So multiplexing AMRM requests wont help anyway but it will only
> complicate things on RM side. Scheduler is not kicked in (synchronously)
> when AM makes a request.
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi Omkar,
>>
>> Thanks for the quick reply. I have a requirement for sets of containers
>> depending on some of my business logic. I found that each of the request
>> allocations is taking around 2 seconds, so I am thinking of doing the
>> requests at the same from multiple threads.
>>
>> Kishore
>>
>>
>> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>>
>>> Hi,
>>>
>>> I suggest you should not do that. After YARN-744 goes in this will be
>>> prevented on RM side. May I know why you want to do this? any advantage/
>>> use case?
>>>
>>> Thanks,
>>> Omkar Joshi
>>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>>
>>>
>>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>>> write2kishore@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Can we submit container requests from multiple threads in parallel to
>>>> the Resource Manager?
>>>>
>>>> Thanks,
>>>> Kishore
>>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Can container requests be made paralelly from multiple threads
Posted by Jian He <jh...@hortonworks.com>.
Hi,
If you adopt hadoop-2.1-beta, StartContainerRequest is changed to
StartContainer(s)Request, meaning it can accept a list of container start
requests and start those containers in one RPC call.
Jian
On Fri, Sep 27, 2013 at 1:06 PM, Omkar Joshi <oj...@hortonworks.com> wrote:
> My point is why you want multiple threads as a part of single AM talking
> to RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
> the requirement is to have multiple requestor requesting resources then it
> should be clubbed into one single request and sent to RM. One more thing
> may be related to this. When AM makes a request to RM; today it gets
> resources only if earlier NM heartbeat resulted into RM scheduling one for
> it. So multiplexing AMRM requests wont help anyway but it will only
> complicate things on RM side. Scheduler is not kicked in (synchronously)
> when AM makes a request.
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi Omkar,
>>
>> Thanks for the quick reply. I have a requirement for sets of containers
>> depending on some of my business logic. I found that each of the request
>> allocations is taking around 2 seconds, so I am thinking of doing the
>> requests at the same from multiple threads.
>>
>> Kishore
>>
>>
>> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>>
>>> Hi,
>>>
>>> I suggest you should not do that. After YARN-744 goes in this will be
>>> prevented on RM side. May I know why you want to do this? any advantage/
>>> use case?
>>>
>>> Thanks,
>>> Omkar Joshi
>>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>>
>>>
>>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>>> write2kishore@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Can we submit container requests from multiple threads in parallel to
>>>> the Resource Manager?
>>>>
>>>> Thanks,
>>>> Kishore
>>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Jian He <jh...@hortonworks.com>.
Hi,
If you adopt hadoop-2.1-beta, StartContainerRequest is changed to
StartContainer(s)Request, meaning it can accept a list of container start
requests and start those containers in one RPC call.
Jian
On Fri, Sep 27, 2013 at 1:06 PM, Omkar Joshi <oj...@hortonworks.com> wrote:
> My point is why you want multiple threads as a part of single AM talking
> to RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
> the requirement is to have multiple requestor requesting resources then it
> should be clubbed into one single request and sent to RM. One more thing
> may be related to this. When AM makes a request to RM; today it gets
> resources only if earlier NM heartbeat resulted into RM scheduling one for
> it. So multiplexing AMRM requests wont help anyway but it will only
> complicate things on RM side. Scheduler is not kicked in (synchronously)
> when AM makes a request.
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi Omkar,
>>
>> Thanks for the quick reply. I have a requirement for sets of containers
>> depending on some of my business logic. I found that each of the request
>> allocations is taking around 2 seconds, so I am thinking of doing the
>> requests at the same from multiple threads.
>>
>> Kishore
>>
>>
>> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>>
>>> Hi,
>>>
>>> I suggest you should not do that. After YARN-744 goes in this will be
>>> prevented on RM side. May I know why you want to do this? any advantage/
>>> use case?
>>>
>>> Thanks,
>>> Omkar Joshi
>>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>>
>>>
>>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>>> write2kishore@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Can we submit container requests from multiple threads in parallel to
>>>> the Resource Manager?
>>>>
>>>> Thanks,
>>>> Kishore
>>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Omkar,
I have a distributed application that I am trying to port to YARN. My
application does many things in multiple threads in parallel, and those
threads in turn run some executables (how many of them depends on some
business logic and is variable). Now I am trying to launch those
executables on the containers acquired from the YARN's RM. If I could make
requests for containers from those parallel threads itself my life would be
much easier.
On Sat, Sep 28, 2013 at 1:36 AM, Omkar Joshi <oj...@hortonworks.com> wrote:
> My point is why you want multiple threads as a part of single AM talking
> to RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
> the requirement is to have multiple requestor requesting resources then it
> should be clubbed into one single request and sent to RM. One more thing
> may be related to this. When AM makes a request to RM; today it gets
> resources only if earlier NM heartbeat resulted into RM scheduling one for
> it. So multiplexing AMRM requests wont help anyway but it will only
> complicate things on RM side. Scheduler is not kicked in (synchronously)
> when AM makes a request.
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi Omkar,
>>
>> Thanks for the quick reply. I have a requirement for sets of containers
>> depending on some of my business logic. I found that each of the request
>> allocations is taking around 2 seconds, so I am thinking of doing the
>> requests at the same from multiple threads.
>>
>> Kishore
>>
>>
>> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>>
>>> Hi,
>>>
>>> I suggest you should not do that. After YARN-744 goes in this will be
>>> prevented on RM side. May I know why you want to do this? any advantage/
>>> use case?
>>>
>>> Thanks,
>>> Omkar Joshi
>>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>>
>>>
>>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>>> write2kishore@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Can we submit container requests from multiple threads in parallel to
>>>> the Resource Manager?
>>>>
>>>> Thanks,
>>>> Kishore
>>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Can container requests be made paralelly from multiple threads
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Omkar,
I have a distributed application that I am trying to port to YARN. My
application does many things in multiple threads in parallel, and those
threads in turn run some executables (how many of them depends on some
business logic and is variable). Now I am trying to launch those
executables on the containers acquired from the YARN's RM. If I could make
requests for containers from those parallel threads itself my life would be
much easier.
On Sat, Sep 28, 2013 at 1:36 AM, Omkar Joshi <oj...@hortonworks.com> wrote:
> My point is why you want multiple threads as a part of single AM talking
> to RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
> the requirement is to have multiple requestor requesting resources then it
> should be clubbed into one single request and sent to RM. One more thing
> may be related to this. When AM makes a request to RM; today it gets
> resources only if earlier NM heartbeat resulted into RM scheduling one for
> it. So multiplexing AMRM requests wont help anyway but it will only
> complicate things on RM side. Scheduler is not kicked in (synchronously)
> when AM makes a request.
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi Omkar,
>>
>> Thanks for the quick reply. I have a requirement for sets of containers
>> depending on some of my business logic. I found that each of the request
>> allocations is taking around 2 seconds, so I am thinking of doing the
>> requests at the same from multiple threads.
>>
>> Kishore
>>
>>
>> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>>
>>> Hi,
>>>
>>> I suggest you should not do that. After YARN-744 goes in this will be
>>> prevented on RM side. May I know why you want to do this? any advantage/
>>> use case?
>>>
>>> Thanks,
>>> Omkar Joshi
>>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>>
>>>
>>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>>> write2kishore@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Can we submit container requests from multiple threads in parallel to
>>>> the Resource Manager?
>>>>
>>>> Thanks,
>>>> Kishore
>>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>
Re: Can container requests be made paralelly from multiple threads
Posted by Omkar Joshi <oj...@hortonworks.com>.
My point is why you want multiple threads as a part of single AM talking to
RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
the requirement is to have multiple requestor requesting resources then it
should be clubbed into one single request and sent to RM. One more thing
may be related to this. When AM makes a request to RM; today it gets
resources only if earlier NM heartbeat resulted into RM scheduling one for
it. So multiplexing AMRM requests wont help anyway but it will only
complicate things on RM side. Scheduler is not kicked in (synchronously)
when AM makes a request.
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:
> Hi Omkar,
>
> Thanks for the quick reply. I have a requirement for sets of containers
> depending on some of my business logic. I found that each of the request
> allocations is taking around 2 seconds, so I am thinking of doing the
> requests at the same from multiple threads.
>
> Kishore
>
>
> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>
>> Hi,
>>
>> I suggest you should not do that. After YARN-744 goes in this will be
>> prevented on RM side. May I know why you want to do this? any advantage/
>> use case?
>>
>> Thanks,
>> Omkar Joshi
>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>
>>
>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>> write2kishore@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Can we submit container requests from multiple threads in parallel to
>>> the Resource Manager?
>>>
>>> Thanks,
>>> Kishore
>>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Omkar Joshi <oj...@hortonworks.com>.
My point is why you want multiple threads as a part of single AM talking to
RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
the requirement is to have multiple requestor requesting resources then it
should be clubbed into one single request and sent to RM. One more thing
may be related to this. When AM makes a request to RM; today it gets
resources only if earlier NM heartbeat resulted into RM scheduling one for
it. So multiplexing AMRM requests wont help anyway but it will only
complicate things on RM side. Scheduler is not kicked in (synchronously)
when AM makes a request.
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:
> Hi Omkar,
>
> Thanks for the quick reply. I have a requirement for sets of containers
> depending on some of my business logic. I found that each of the request
> allocations is taking around 2 seconds, so I am thinking of doing the
> requests at the same from multiple threads.
>
> Kishore
>
>
> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>
>> Hi,
>>
>> I suggest you should not do that. After YARN-744 goes in this will be
>> prevented on RM side. May I know why you want to do this? any advantage/
>> use case?
>>
>> Thanks,
>> Omkar Joshi
>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>
>>
>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>> write2kishore@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Can we submit container requests from multiple threads in parallel to
>>> the Resource Manager?
>>>
>>> Thanks,
>>> Kishore
>>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Omkar Joshi <oj...@hortonworks.com>.
My point is why you want multiple threads as a part of single AM talking to
RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
the requirement is to have multiple requestor requesting resources then it
should be clubbed into one single request and sent to RM. One more thing
may be related to this. When AM makes a request to RM; today it gets
resources only if earlier NM heartbeat resulted into RM scheduling one for
it. So multiplexing AMRM requests wont help anyway but it will only
complicate things on RM side. Scheduler is not kicked in (synchronously)
when AM makes a request.
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:
> Hi Omkar,
>
> Thanks for the quick reply. I have a requirement for sets of containers
> depending on some of my business logic. I found that each of the request
> allocations is taking around 2 seconds, so I am thinking of doing the
> requests at the same from multiple threads.
>
> Kishore
>
>
> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>
>> Hi,
>>
>> I suggest you should not do that. After YARN-744 goes in this will be
>> prevented on RM side. May I know why you want to do this? any advantage/
>> use case?
>>
>> Thanks,
>> Omkar Joshi
>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>
>>
>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>> write2kishore@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Can we submit container requests from multiple threads in parallel to
>>> the Resource Manager?
>>>
>>> Thanks,
>>> Kishore
>>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Omkar Joshi <oj...@hortonworks.com>.
My point is why you want multiple threads as a part of single AM talking to
RM simultaneously? I think AMRMProtocol only AM is suppose to use and if
the requirement is to have multiple requestor requesting resources then it
should be clubbed into one single request and sent to RM. One more thing
may be related to this. When AM makes a request to RM; today it gets
resources only if earlier NM heartbeat resulted into RM scheduling one for
it. So multiplexing AMRM requests wont help anyway but it will only
complicate things on RM side. Scheduler is not kicked in (synchronously)
when AM makes a request.
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Fri, Sep 27, 2013 at 11:14 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:
> Hi Omkar,
>
> Thanks for the quick reply. I have a requirement for sets of containers
> depending on some of my business logic. I found that each of the request
> allocations is taking around 2 seconds, so I am thinking of doing the
> requests at the same from multiple threads.
>
> Kishore
>
>
> On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
>
>> Hi,
>>
>> I suggest you should not do that. After YARN-744 goes in this will be
>> prevented on RM side. May I know why you want to do this? any advantage/
>> use case?
>>
>> Thanks,
>> Omkar Joshi
>> *Hortonworks Inc.* <http://www.hortonworks.com>
>>
>>
>> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
>> write2kishore@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Can we submit container requests from multiple threads in parallel to
>>> the Resource Manager?
>>>
>>> Thanks,
>>> Kishore
>>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Omkar,
Thanks for the quick reply. I have a requirement for sets of containers
depending on some of my business logic. I found that each of the request
allocations is taking around 2 seconds, so I am thinking of doing the
requests at the same from multiple threads.
Kishore
On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
> Hi,
>
> I suggest you should not do that. After YARN-744 goes in this will be
> prevented on RM side. May I know why you want to do this? any advantage/
> use case?
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi,
>>
>> Can we submit container requests from multiple threads in parallel to
>> the Resource Manager?
>>
>> Thanks,
>> Kishore
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Omkar,
Thanks for the quick reply. I have a requirement for sets of containers
depending on some of my business logic. I found that each of the request
allocations is taking around 2 seconds, so I am thinking of doing the
requests at the same from multiple threads.
Kishore
On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
> Hi,
>
> I suggest you should not do that. After YARN-744 goes in this will be
> prevented on RM side. May I know why you want to do this? any advantage/
> use case?
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi,
>>
>> Can we submit container requests from multiple threads in parallel to
>> the Resource Manager?
>>
>> Thanks,
>> Kishore
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Omkar,
Thanks for the quick reply. I have a requirement for sets of containers
depending on some of my business logic. I found that each of the request
allocations is taking around 2 seconds, so I am thinking of doing the
requests at the same from multiple threads.
Kishore
On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
> Hi,
>
> I suggest you should not do that. After YARN-744 goes in this will be
> prevented on RM side. May I know why you want to do this? any advantage/
> use case?
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi,
>>
>> Can we submit container requests from multiple threads in parallel to
>> the Resource Manager?
>>
>> Thanks,
>> Kishore
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Krishna Kishore Bonagiri <wr...@gmail.com>.
Hi Omkar,
Thanks for the quick reply. I have a requirement for sets of containers
depending on some of my business logic. I found that each of the request
allocations is taking around 2 seconds, so I am thinking of doing the
requests at the same from multiple threads.
Kishore
On Fri, Sep 27, 2013 at 11:27 PM, Omkar Joshi <oj...@hortonworks.com>wrote:
> Hi,
>
> I suggest you should not do that. After YARN-744 goes in this will be
> prevented on RM side. May I know why you want to do this? any advantage/
> use case?
>
> Thanks,
> Omkar Joshi
> *Hortonworks Inc.* <http://www.hortonworks.com>
>
>
> On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
> write2kishore@gmail.com> wrote:
>
>> Hi,
>>
>> Can we submit container requests from multiple threads in parallel to
>> the Resource Manager?
>>
>> Thanks,
>> Kishore
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Omkar Joshi <oj...@hortonworks.com>.
Hi,
I suggest you should not do that. After YARN-744 goes in this will be
prevented on RM side. May I know why you want to do this? any advantage/
use case?
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:
> Hi,
>
> Can we submit container requests from multiple threads in parallel to
> the Resource Manager?
>
> Thanks,
> Kishore
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Omkar Joshi <oj...@hortonworks.com>.
Hi,
I suggest you should not do that. After YARN-744 goes in this will be
prevented on RM side. May I know why you want to do this? any advantage/
use case?
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:
> Hi,
>
> Can we submit container requests from multiple threads in parallel to
> the Resource Manager?
>
> Thanks,
> Kishore
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Omkar Joshi <oj...@hortonworks.com>.
Hi,
I suggest you should not do that. After YARN-744 goes in this will be
prevented on RM side. May I know why you want to do this? any advantage/
use case?
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:
> Hi,
>
> Can we submit container requests from multiple threads in parallel to
> the Resource Manager?
>
> Thanks,
> Kishore
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can container requests be made paralelly from multiple threads
Posted by Omkar Joshi <oj...@hortonworks.com>.
Hi,
I suggest you should not do that. After YARN-744 goes in this will be
prevented on RM side. May I know why you want to do this? any advantage/
use case?
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Fri, Sep 27, 2013 at 8:31 AM, Krishna Kishore Bonagiri <
write2kishore@gmail.com> wrote:
> Hi,
>
> Can we submit container requests from multiple threads in parallel to
> the Resource Manager?
>
> Thanks,
> Kishore
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.