You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Rahul Bhattacharjee <ra...@gmail.com> on 2013/04/22 17:27:55 UTC
Umbilical interface
Hi,
Tasktracer runs each of the tasks (M or R) in a separate VM (considering VM
reuse is disabled).So the actual task and task tracer daemon run in two
different OS processes. Umbilical interface is used by tasks to send its
progress to the task tracer.
Considering that both are different process then how is the umbilical
interface implemented ? shared file , sockets (unlikely) or ..
Thanks,
Rahul
Re: Umbilical interface
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thanks Vinod
On Monday, April 22, 2013, Vinod Kumar Vavilapalli wrote:
>
> It is the same as all other communication in Hadoop: Hadoop RPC which in
> turn is java RPC over a TPC connection.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Apr 22, 2013, at 8:27 AM, Rahul Bhattacharjee wrote:
>
> Hi,
>
> Tasktracer runs each of the tasks (M or R) in a separate VM (considering
> VM reuse is disabled).So the actual task and task tracer daemon run in two
> different OS processes. Umbilical interface is used by tasks to send its
> progress to the task tracer.
>
> Considering that both are different process then how is the umbilical
> interface implemented ? shared file , sockets (unlikely) or ..
>
> Thanks,
> Rahul
>
>
>
Re: Umbilical interface
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thanks Vinod
On Monday, April 22, 2013, Vinod Kumar Vavilapalli wrote:
>
> It is the same as all other communication in Hadoop: Hadoop RPC which in
> turn is java RPC over a TPC connection.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Apr 22, 2013, at 8:27 AM, Rahul Bhattacharjee wrote:
>
> Hi,
>
> Tasktracer runs each of the tasks (M or R) in a separate VM (considering
> VM reuse is disabled).So the actual task and task tracer daemon run in two
> different OS processes. Umbilical interface is used by tasks to send its
> progress to the task tracer.
>
> Considering that both are different process then how is the umbilical
> interface implemented ? shared file , sockets (unlikely) or ..
>
> Thanks,
> Rahul
>
>
>
Re: Umbilical interface
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thanks Vinod
On Monday, April 22, 2013, Vinod Kumar Vavilapalli wrote:
>
> It is the same as all other communication in Hadoop: Hadoop RPC which in
> turn is java RPC over a TPC connection.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Apr 22, 2013, at 8:27 AM, Rahul Bhattacharjee wrote:
>
> Hi,
>
> Tasktracer runs each of the tasks (M or R) in a separate VM (considering
> VM reuse is disabled).So the actual task and task tracer daemon run in two
> different OS processes. Umbilical interface is used by tasks to send its
> progress to the task tracer.
>
> Considering that both are different process then how is the umbilical
> interface implemented ? shared file , sockets (unlikely) or ..
>
> Thanks,
> Rahul
>
>
>
Re: Umbilical interface
Posted by Rahul Bhattacharjee <ra...@gmail.com>.
Thanks Vinod
On Monday, April 22, 2013, Vinod Kumar Vavilapalli wrote:
>
> It is the same as all other communication in Hadoop: Hadoop RPC which in
> turn is java RPC over a TPC connection.
>
> Thanks,
> +Vinod Kumar Vavilapalli
> Hortonworks Inc.
> http://hortonworks.com/
>
> On Apr 22, 2013, at 8:27 AM, Rahul Bhattacharjee wrote:
>
> Hi,
>
> Tasktracer runs each of the tasks (M or R) in a separate VM (considering
> VM reuse is disabled).So the actual task and task tracer daemon run in two
> different OS processes. Umbilical interface is used by tasks to send its
> progress to the task tracer.
>
> Considering that both are different process then how is the umbilical
> interface implemented ? shared file , sockets (unlikely) or ..
>
> Thanks,
> Rahul
>
>
>
Re: Umbilical interface
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
It is the same as all other communication in Hadoop: Hadoop RPC which in turn is java RPC over a TPC connection.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Apr 22, 2013, at 8:27 AM, Rahul Bhattacharjee wrote:
> Hi,
>
> Tasktracer runs each of the tasks (M or R) in a separate VM (considering VM reuse is disabled).So the actual task and task tracer daemon run in two different OS processes. Umbilical interface is used by tasks to send its progress to the task tracer.
>
> Considering that both are different process then how is the umbilical interface implemented ? shared file , sockets (unlikely) or ..
>
> Thanks,
> Rahul
Re: Umbilical interface
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
It is the same as all other communication in Hadoop: Hadoop RPC which in turn is java RPC over a TPC connection.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Apr 22, 2013, at 8:27 AM, Rahul Bhattacharjee wrote:
> Hi,
>
> Tasktracer runs each of the tasks (M or R) in a separate VM (considering VM reuse is disabled).So the actual task and task tracer daemon run in two different OS processes. Umbilical interface is used by tasks to send its progress to the task tracer.
>
> Considering that both are different process then how is the umbilical interface implemented ? shared file , sockets (unlikely) or ..
>
> Thanks,
> Rahul
Re: Umbilical interface
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
It is the same as all other communication in Hadoop: Hadoop RPC which in turn is java RPC over a TPC connection.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Apr 22, 2013, at 8:27 AM, Rahul Bhattacharjee wrote:
> Hi,
>
> Tasktracer runs each of the tasks (M or R) in a separate VM (considering VM reuse is disabled).So the actual task and task tracer daemon run in two different OS processes. Umbilical interface is used by tasks to send its progress to the task tracer.
>
> Considering that both are different process then how is the umbilical interface implemented ? shared file , sockets (unlikely) or ..
>
> Thanks,
> Rahul
Re: Umbilical interface
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
It is the same as all other communication in Hadoop: Hadoop RPC which in turn is java RPC over a TPC connection.
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Apr 22, 2013, at 8:27 AM, Rahul Bhattacharjee wrote:
> Hi,
>
> Tasktracer runs each of the tasks (M or R) in a separate VM (considering VM reuse is disabled).So the actual task and task tracer daemon run in two different OS processes. Umbilical interface is used by tasks to send its progress to the task tracer.
>
> Considering that both are different process then how is the umbilical interface implemented ? shared file , sockets (unlikely) or ..
>
> Thanks,
> Rahul