You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Sandy Ryza <sa...@cloudera.com> on 2012/11/28 20:23:15 UTC

specify mapper and reducer requested memory

If I want to run a MR job in YARN, how do I ask for x MB of memory for each
mapper, and y MB for each reducer?  I spent a while looking through the
code and couldn't figure it out.

thanks
-Sandy

Re: specify mapper and reducer requested memory

Posted by Robert Evans <ev...@yahoo-inc.com>.
It is and is very cool kind of like flash but with dram speed.

http://en.wikipedia.org/wiki/Mram

--Bobby

On 11/28/12 2:46 PM, "Harsh J" <ha...@cloudera.com> wrote:

>I guess its better to type MR-AM than MRAM. The latter, when read,
>always feels like a special type of RAM to me :)
>
>On Thu, Nov 29, 2012 at 1:33 AM, Harsh J <ha...@cloudera.com> wrote:
>> Hi,
>>
>> You can supply mapreduce.map.memory.mb and mapreduce.reduce.memory.mb
>> in the Job's configuration, and the MRAM will use these values to
>> configure the resource request.
>>
>> On Thu, Nov 29, 2012 at 12:53 AM, Sandy Ryza <sa...@cloudera.com>
>>wrote:
>>> If I want to run a MR job in YARN, how do I ask for x MB of memory for
>>>each
>>> mapper, and y MB for each reducer?  I spent a while looking through the
>>> code and couldn't figure it out.
>>>
>>> thanks
>>> -Sandy
>>
>>
>>
>> --
>> Harsh J
>
>
>
>-- 
>Harsh J


Re: specify mapper and reducer requested memory

Posted by Harsh J <ha...@cloudera.com>.
I guess its better to type MR-AM than MRAM. The latter, when read,
always feels like a special type of RAM to me :)

On Thu, Nov 29, 2012 at 1:33 AM, Harsh J <ha...@cloudera.com> wrote:
> Hi,
>
> You can supply mapreduce.map.memory.mb and mapreduce.reduce.memory.mb
> in the Job's configuration, and the MRAM will use these values to
> configure the resource request.
>
> On Thu, Nov 29, 2012 at 12:53 AM, Sandy Ryza <sa...@cloudera.com> wrote:
>> If I want to run a MR job in YARN, how do I ask for x MB of memory for each
>> mapper, and y MB for each reducer?  I spent a while looking through the
>> code and couldn't figure it out.
>>
>> thanks
>> -Sandy
>
>
>
> --
> Harsh J



-- 
Harsh J

Re: specify mapper and reducer requested memory

Posted by Harsh J <ha...@cloudera.com>.
Hi,

You can supply mapreduce.map.memory.mb and mapreduce.reduce.memory.mb
in the Job's configuration, and the MRAM will use these values to
configure the resource request.

On Thu, Nov 29, 2012 at 12:53 AM, Sandy Ryza <sa...@cloudera.com> wrote:
> If I want to run a MR job in YARN, how do I ask for x MB of memory for each
> mapper, and y MB for each reducer?  I spent a while looking through the
> code and couldn't figure it out.
>
> thanks
> -Sandy



-- 
Harsh J