Yarn Container Limit

[raghavendhra rahul <ra...@gmail.com>]

Hi,
            How to set the maximum number of containers to be executed in
each node.
            So that at a time only that much of containers will be running
in that node..

Re: Yarn Container Limit

[Ravi Prakash <ra...@gmail.com>]

>From what I know the number of containers will depend on the amount of
resources your node has. If it has 8 Gb RAM and each container has 2 Gb,
then there'll be a maximum of 4 containers.

On Tue, Jan 10, 2012 at 5:44 AM, raghavendhra rahul <
raghavendhrarahul@gmail.com> wrote:

> Hi,
>             How to set the maximum number of containers to be executed in
> each node.
>             So that at a time only that much of containers will be running
> in that node..
>

Re: Yarn Container Limit

[Vinod Kumar Vavilapalli <vi...@hortonworks.com>]

You can use yarn.nodemanager.resource.memory-mb to set the limit on
each NodeManager.

You should have a good look at
http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/ClusterSetup.html
. It has enough information to get you a good distance.

HTH.
+Vinod

On Tue, Jan 10, 2012 at 3:44 AM, raghavendhra rahul
<ra...@gmail.com> wrote:
> Hi,
>             How to set the maximum number of containers to be executed in
> each node.
>             So that at a time only that much of containers will be running
> in that node..

Re: Yarn Container Limit

[Vinod Kumar Vavilapalli <vi...@hortonworks.com>]

You can use yarn.nodemanager.resource.memory-mb to set the limit on
each NodeManager.

You should have a good look at
http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/ClusterSetup.html
. It has enough information to get you a good distance.

HTH.
+Vinod

On Tue, Jan 10, 2012 at 3:44 AM, raghavendhra rahul
<ra...@gmail.com> wrote:
> Hi,
>             How to set the maximum number of containers to be executed in
> each node.
>             So that at a time only that much of containers will be running
> in that node..