You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Ben Kucinich <be...@gmail.com> on 2008/03/08 08:27:37 UTC

How jobs are copied to other nodes?

I am interested to know the internal working of Hadoop regarding
distribution of jobs. How are the jobs copied to other nodes?

Is the class file copied to all other nodes where they are executed?

Re: How jobs are copied to other nodes?

Posted by Amar Kamat <am...@yahoo-inc.com>.

The job file i.e job.jar is copied to the dfs by the job client. When the 
task tracker prepares for new task it makes a local copy of the job.
On Sat, 8 Mar 2008, Ben Kucinich wrote:

> I am interested to know the internal working of Hadoop regarding
> distribution of jobs. How are the jobs copied to other nodes?
>
> Is the class file copied to all other nodes where they are executed?
Yes.
Btw I think this should be posted on core-dev!
Amar
>