You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by Chen Song <ch...@gmail.com> on 2014/07/21 22:44:45 UTC

yarn container memory setting

I read a bit on documentation on yarn memory tuning and found that

It is suggested to set mapreduce.map.java.opts = 0.8 *
mapreduce.map.memory.mb.

I am wondering why is 0.8, but not 0.9 or higher?

-- 
Chen Song

Re: yarn container memory setting

Posted by Devaraj K <de...@apache.org>.

I assume you meant mapreduce.map.java.opts = -Xmx(0.8 *
mapreduce.map.memory.mb)M.

Here trying allocate this much memory for heap size. And we need to leave
the remaining memory for launching the Child container java process, native
memory, etc.

On Tue, Jul 22, 2014 at 2:14 AM, Chen Song <ch...@gmail.com> wrote:

> I read a bit on documentation on yarn memory tuning and found that
>
> It is suggested to set mapreduce.map.java.opts = 0.8 *
> mapreduce.map.memory.mb.
>
> I am wondering why is 0.8, but not 0.9 or higher?
>
> --
> Chen Song
>
>

-- 

Thanks
Devaraj K

Re: yarn container memory setting

Posted by Devaraj K <de...@apache.org>.

I assume you meant mapreduce.map.java.opts = -Xmx(0.8 *
mapreduce.map.memory.mb)M.

Here trying allocate this much memory for heap size. And we need to leave
the remaining memory for launching the Child container java process, native
memory, etc.

On Tue, Jul 22, 2014 at 2:14 AM, Chen Song <ch...@gmail.com> wrote:

> I read a bit on documentation on yarn memory tuning and found that
>
> It is suggested to set mapreduce.map.java.opts = 0.8 *
> mapreduce.map.memory.mb.
>
> I am wondering why is 0.8, but not 0.9 or higher?
>
> --
> Chen Song
>
>

-- 

Thanks
Devaraj K

Re: yarn container memory setting

Posted by Devaraj K <de...@apache.org>.

I assume you meant mapreduce.map.java.opts = -Xmx(0.8 *
mapreduce.map.memory.mb)M.

Here trying allocate this much memory for heap size. And we need to leave
the remaining memory for launching the Child container java process, native
memory, etc.

On Tue, Jul 22, 2014 at 2:14 AM, Chen Song <ch...@gmail.com> wrote:

> I read a bit on documentation on yarn memory tuning and found that
>
> It is suggested to set mapreduce.map.java.opts = 0.8 *
> mapreduce.map.memory.mb.
>
> I am wondering why is 0.8, but not 0.9 or higher?
>
> --
> Chen Song
>
>

-- 

Thanks
Devaraj K

Re: yarn container memory setting

Posted by Devaraj K <de...@apache.org>.

I assume you meant mapreduce.map.java.opts = -Xmx(0.8 *
mapreduce.map.memory.mb)M.

Here trying allocate this much memory for heap size. And we need to leave
the remaining memory for launching the Child container java process, native
memory, etc.

On Tue, Jul 22, 2014 at 2:14 AM, Chen Song <ch...@gmail.com> wrote:

> I read a bit on documentation on yarn memory tuning and found that
>
> It is suggested to set mapreduce.map.java.opts = 0.8 *
> mapreduce.map.memory.mb.
>
> I am wondering why is 0.8, but not 0.9 or higher?
>
> --
> Chen Song
>
>

-- 

Thanks
Devaraj K