You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Satoshi Noto <nt...@gmail.com> on 2012/04/27 08:08:58 UTC
How to use "mapred.temp.dir" ?
Hi all,
The default config mapred-default.xml has a property "mapred.temp.dir".
How to use "mapred.temp.dir" ?
I did grep "mapred.temp.dir" to hadoop-0.20.2 sources,
but I could not get line from mapred sources.
Is this property not used by mapreduce framework ?
And if we want to use temporary directory in mapreduce job,
we should use this property in own code ?
Regards,
Satoshi
Re: How to use "mapred.temp.dir" ?
Posted by Satoshi Noto <nt...@gmail.com>.
Hi Harsh,
I got it.
Thank you very much !
Satoshi
On Fri, Apr 27, 2012 at 8:00 PM, Harsh J <ha...@cloudera.com> wrote:
> This property is no longer used. You probably need either
> hadoop.tmp.dir or mapred.local.dir. The latter controls where map
> intermediates and partitioned reducer inputs go to, in MR.
>
> From within an Mapper or Reducer, if you want to use temporary files,
> you can use the regular Java API's File.createTempFile/etc., or refer
> to the mapred.child.tmp property from within the Mapper/Reducer, which
> refers to ./tmp (within the task's local working directory, a path
> derived out of mapred.local.dir by the framework).
>
> On Fri, Apr 27, 2012 at 11:38 AM, Satoshi Noto <nt...@gmail.com> wrote:
>> Hi all,
>>
>> The default config mapred-default.xml has a property "mapred.temp.dir".
>> How to use "mapred.temp.dir" ?
>>
>> I did grep "mapred.temp.dir" to hadoop-0.20.2 sources,
>> but I could not get line from mapred sources.
>>
>> Is this property not used by mapreduce framework ?
>> And if we want to use temporary directory in mapreduce job,
>> we should use this property in own code ?
>>
>>
>> Regards,
>> Satoshi
>
>
>
> --
> Harsh J
Re: How to use "mapred.temp.dir" ?
Posted by Harsh J <ha...@cloudera.com>.
This property is no longer used. You probably need either
hadoop.tmp.dir or mapred.local.dir. The latter controls where map
intermediates and partitioned reducer inputs go to, in MR.
>From within an Mapper or Reducer, if you want to use temporary files,
you can use the regular Java API's File.createTempFile/etc., or refer
to the mapred.child.tmp property from within the Mapper/Reducer, which
refers to ./tmp (within the task's local working directory, a path
derived out of mapred.local.dir by the framework).
On Fri, Apr 27, 2012 at 11:38 AM, Satoshi Noto <nt...@gmail.com> wrote:
> Hi all,
>
> The default config mapred-default.xml has a property "mapred.temp.dir".
> How to use "mapred.temp.dir" ?
>
> I did grep "mapred.temp.dir" to hadoop-0.20.2 sources,
> but I could not get line from mapred sources.
>
> Is this property not used by mapreduce framework ?
> And if we want to use temporary directory in mapreduce job,
> we should use this property in own code ?
>
>
> Regards,
> Satoshi
--
Harsh J