You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by Sandy Ryza <sa...@cloudera.com> on 2012/11/28 20:23:15 UTC
specify mapper and reducer requested memory
If I want to run a MR job in YARN, how do I ask for x MB of memory for each
mapper, and y MB for each reducer? I spent a while looking through the
code and couldn't figure it out.
thanks
-Sandy
Re: specify mapper and reducer requested memory
Posted by Robert Evans <ev...@yahoo-inc.com>.
It is and is very cool kind of like flash but with dram speed.
http://en.wikipedia.org/wiki/Mram
--Bobby
On 11/28/12 2:46 PM, "Harsh J" <ha...@cloudera.com> wrote:
>I guess its better to type MR-AM than MRAM. The latter, when read,
>always feels like a special type of RAM to me :)
>
>On Thu, Nov 29, 2012 at 1:33 AM, Harsh J <ha...@cloudera.com> wrote:
>> Hi,
>>
>> You can supply mapreduce.map.memory.mb and mapreduce.reduce.memory.mb
>> in the Job's configuration, and the MRAM will use these values to
>> configure the resource request.
>>
>> On Thu, Nov 29, 2012 at 12:53 AM, Sandy Ryza <sa...@cloudera.com>
>>wrote:
>>> If I want to run a MR job in YARN, how do I ask for x MB of memory for
>>>each
>>> mapper, and y MB for each reducer? I spent a while looking through the
>>> code and couldn't figure it out.
>>>
>>> thanks
>>> -Sandy
>>
>>
>>
>> --
>> Harsh J
>
>
>
>--
>Harsh J
Re: specify mapper and reducer requested memory
Posted by Harsh J <ha...@cloudera.com>.
I guess its better to type MR-AM than MRAM. The latter, when read,
always feels like a special type of RAM to me :)
On Thu, Nov 29, 2012 at 1:33 AM, Harsh J <ha...@cloudera.com> wrote:
> Hi,
>
> You can supply mapreduce.map.memory.mb and mapreduce.reduce.memory.mb
> in the Job's configuration, and the MRAM will use these values to
> configure the resource request.
>
> On Thu, Nov 29, 2012 at 12:53 AM, Sandy Ryza <sa...@cloudera.com> wrote:
>> If I want to run a MR job in YARN, how do I ask for x MB of memory for each
>> mapper, and y MB for each reducer? I spent a while looking through the
>> code and couldn't figure it out.
>>
>> thanks
>> -Sandy
>
>
>
> --
> Harsh J
--
Harsh J
Re: specify mapper and reducer requested memory
Posted by Harsh J <ha...@cloudera.com>.
Hi,
You can supply mapreduce.map.memory.mb and mapreduce.reduce.memory.mb
in the Job's configuration, and the MRAM will use these values to
configure the resource request.
On Thu, Nov 29, 2012 at 12:53 AM, Sandy Ryza <sa...@cloudera.com> wrote:
> If I want to run a MR job in YARN, how do I ask for x MB of memory for each
> mapper, and y MB for each reducer? I spent a while looking through the
> code and couldn't figure it out.
>
> thanks
> -Sandy
--
Harsh J