You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by ma qiang <ma...@gmail.com> on 2008/01/23 05:01:31 UTC

How to invoke program in hadoop

Dear colleagues:
        I have some mapreduce codes in hadoop,now I want to invoke
these codes in another place outside of hadoop server. Who can gell me
how?
       Thanks !

Re: How to invoke program in hadoop

Posted by ma qiang <ma...@gmail.com>.
Sorry, I have this problem!
I have some mapreduce codes in hadoop.   Now I am writing some java
code  in my own app that need to use the results of mapreduce code's
computation. My app is not run in hadoop and it is the general java
such as SWT project.




On Jan 23, 2008 12:25 PM, Ted Dunning <td...@veoh.com> wrote:
>
> Adding -Dmapred.job.tracker=local to your command line will cause a
> map-reduce program to be executed entirely locally.  This may not be what
> you mean.
>
> You can run a map-reduce program on a machine outside of the hadoop cluster
> by just copying the configuration files to the machine where you want to run
> your program.  Your program will contact the namenode and job tracker to
> access or store data and to start tasks.  You can get away with very little
> of the normal distribution, but I find it easiest to copy the entire
> distribution to the machine that runs the program.
>
>
>
> On 1/22/08 8:01 PM, "ma qiang" <ma...@gmail.com> wrote:
>
> > Dear colleagues:
> >         I have some mapreduce codes in hadoop,now I want to invoke
> > these codes in another place outside of hadoop server. Who can gell me
> > how?
> >        Thanks !
>
>

Re: How to invoke program in hadoop

Posted by Ted Dunning <td...@veoh.com>.
Adding -Dmapred.job.tracker=local to your command line will cause a
map-reduce program to be executed entirely locally.  This may not be what
you mean.

You can run a map-reduce program on a machine outside of the hadoop cluster
by just copying the configuration files to the machine where you want to run
your program.  Your program will contact the namenode and job tracker to
access or store data and to start tasks.  You can get away with very little
of the normal distribution, but I find it easiest to copy the entire
distribution to the machine that runs the program.


On 1/22/08 8:01 PM, "ma qiang" <ma...@gmail.com> wrote:

> Dear colleagues:
>         I have some mapreduce codes in hadoop,now I want to invoke
> these codes in another place outside of hadoop server. Who can gell me
> how?
>        Thanks !