You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by santosh kumar <sa...@gmail.com> on 2013/12/10 02:42:11 UTC
Can NMs communicate among themselves?
Hi,
The communication in YARN is b/w RM-NM or AM-RM from what I know.
Can Node Managers talk to each other? If so, how?
Also what protocol or communication model does hadoop follow?
Thanks,
Santosh
PhD Candidate
USF, Tampa, FL
Re: Can NMs communicate among themselves?
Posted by Adam Muise <am...@hortonworks.com>.
You would best bake this into your YARN application. Inter process Communication can be implemented in the container.
You should take a look at the weave framework as well.
https://github.com/continuuity/weave/blob/develop/README.md
Sent from my iPhone
> On Dec 9, 2013, at 8:50 PM, santosh kumar <sa...@gmail.com> wrote:
>
> Hi Sandy,
>
> Thank you so much for the immediate response.
>
> Is there a way to make it happen? Any suggestions will be greatly
> appreciated.
>
> Also, can you tell me how any communication happens in the cluster, be it
> between RM and nodes or any scenario?
>
> Thanks,
> Santosh
> PhD Candidate
> USF, Tampa, FL
>
>
>> On Mon, Dec 9, 2013 at 8:44 PM, Sandy Ryza <sa...@cloudera.com> wrote:
>>
>> Hi Santosh,
>>
>> NodeManagers do not communicate with each other in YARN.
>>
>> -Sandy
>>
>>
>> On Mon, Dec 9, 2013 at 5:42 PM, santosh kumar <santosh.aditham@gmail.com
>>> wrote:
>>
>>> Hi,
>>>
>>> The communication in YARN is b/w RM-NM or AM-RM from what I know.
>>> Can Node Managers talk to each other? If so, how?
>>>
>>> Also what protocol or communication model does hadoop follow?
>>>
>>> Thanks,
>>> Santosh
>>> PhD Candidate
>>> USF, Tampa, FL
>>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Can NMs communicate among themselves?
Posted by santosh kumar <sa...@gmail.com>.
Hi Sandy,
Thank you so much for the immediate response.
Is there a way to make it happen? Any suggestions will be greatly
appreciated.
Also, can you tell me how any communication happens in the cluster, be it
between RM and nodes or any scenario?
Thanks,
Santosh
PhD Candidate
USF, Tampa, FL
On Mon, Dec 9, 2013 at 8:44 PM, Sandy Ryza <sa...@cloudera.com> wrote:
> Hi Santosh,
>
> NodeManagers do not communicate with each other in YARN.
>
> -Sandy
>
>
> On Mon, Dec 9, 2013 at 5:42 PM, santosh kumar <santosh.aditham@gmail.com
> >wrote:
>
> > Hi,
> >
> > The communication in YARN is b/w RM-NM or AM-RM from what I know.
> > Can Node Managers talk to each other? If so, how?
> >
> > Also what protocol or communication model does hadoop follow?
> >
> > Thanks,
> > Santosh
> > PhD Candidate
> > USF, Tampa, FL
> >
>
Re: Can NMs communicate among themselves?
Posted by santosh kumar <sa...@gmail.com>.
Hi Sandy,
Thank you so much for the immediate response.
Is there a way to make it happen? Any suggestions will be greatly
appreciated.
Also, can you tell me how any communication happens in the cluster, be it
between RM and nodes or any scenario?
Thanks,
Santosh
PhD Candidate
USF, Tampa, FL
On Mon, Dec 9, 2013 at 8:44 PM, Sandy Ryza <sa...@cloudera.com> wrote:
> Hi Santosh,
>
> NodeManagers do not communicate with each other in YARN.
>
> -Sandy
>
>
> On Mon, Dec 9, 2013 at 5:42 PM, santosh kumar <santosh.aditham@gmail.com
> >wrote:
>
> > Hi,
> >
> > The communication in YARN is b/w RM-NM or AM-RM from what I know.
> > Can Node Managers talk to each other? If so, how?
> >
> > Also what protocol or communication model does hadoop follow?
> >
> > Thanks,
> > Santosh
> > PhD Candidate
> > USF, Tampa, FL
> >
>
Re: Can NMs communicate among themselves?
Posted by Sandy Ryza <sa...@cloudera.com>.
Hi Santosh,
NodeManagers do not communicate with each other in YARN.
-Sandy
On Mon, Dec 9, 2013 at 5:42 PM, santosh kumar <sa...@gmail.com>wrote:
> Hi,
>
> The communication in YARN is b/w RM-NM or AM-RM from what I know.
> Can Node Managers talk to each other? If so, how?
>
> Also what protocol or communication model does hadoop follow?
>
> Thanks,
> Santosh
> PhD Candidate
> USF, Tampa, FL
>
Re: Can NMs communicate among themselves?
Posted by Sandy Ryza <sa...@cloudera.com>.
Hi Santosh,
NodeManagers do not communicate with each other in YARN.
-Sandy
On Mon, Dec 9, 2013 at 5:42 PM, santosh kumar <sa...@gmail.com>wrote:
> Hi,
>
> The communication in YARN is b/w RM-NM or AM-RM from what I know.
> Can Node Managers talk to each other? If so, how?
>
> Also what protocol or communication model does hadoop follow?
>
> Thanks,
> Santosh
> PhD Candidate
> USF, Tampa, FL
>