How to access contents of a Map Reduce job's working directory

[Shrish Bajpai <s....@lancaster.ac.uk>]

I have just started to explore Hadoop but I am stuck in a situation now.

I want to run a MapReduce job in hadoop which needs to create a "setup"
folder in working directory. During the execution the job will generate
some additional text files within this "setup" folder. The problem is I
dont know how to access or move this setup folder content to my local file
system as at end of the job, the job directory will be cleaned up.

It would be great if you can help.

Regards

Shrish

Re: How to access contents of a Map Reduce job's working directory

[madhu phatak <ph...@gmail.com>]

Try to use FileSystem.copyToLocal API to copy the files from the setup
directory.

On Tue, Aug 2, 2011 at 5:54 AM, Shrish Bajpai <s....@lancaster.ac.uk>wrote:

> I have just started to explore Hadoop but I am stuck in a situation now.
>
> I want to run a MapReduce job in hadoop which needs to create a "setup"
> folder in working directory. During the execution the job will generate
> some additional text files within this "setup" folder. The problem is I
> dont know how to access or move this setup folder content to my local file
> system as at end of the job, the job directory will be cleaned up.
>
> It would be great if you can help.
>
> Regards
>
> Shrish
>
>


-- 
Join me at http://hadoopworkshop.eventbrite.com/