You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Zhaohui Xin (JIRA)" <ji...@apache.org> on 2018/11/21 15:19:00 UTC

[jira] [Updated] (YARN-9045) Container's cpu usage limit should be soft with a relaxation factor

     [ https://issues.apache.org/jira/browse/YARN-9045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhaohui Xin updated YARN-9045:
------------------------------
    Description: 
There are two modes in yarn container cpu limitation. The default is Shared mode which guarantees the requested resource and can also use other spare CPU if avaliable. Another one is Strict mode, container's resource is limited to allocated resource strictly.

If we want to limit the resource usage of the container and can use a certain percentage of spare CPU if available, the above two modes cannot satisfy our demand. We can define a relax coefficient(yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage.ratio) to relax the restrictions on resources in strict mode.

 

Share Mode,
  

  was:
There are two modes in yarn container cpu limitation. The default is Shared mode which guarantees the requested resource and can also use other spare CPU if avaliable. Another one is Strict mode, container's resource is limited to allocated resource strictly.

If we want to limit the resource usage of the container and can use a certain percentage of spare CPU if available, the above two modes cannot satisfy our demand. We can define a relax coefficient(yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage.ratio) to relax the restrictions on resources in strict mode.
 


> Container's cpu usage limit should be soft with a relaxation factor
> -------------------------------------------------------------------
>
>                 Key: YARN-9045
>                 URL: https://issues.apache.org/jira/browse/YARN-9045
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.6.0, 3.1.1
>            Reporter: Zhaohui Xin
>            Assignee: Zhaohui Xin
>            Priority: Major
>         Attachments: image-2018-11-21-23-18-41-366.png
>
>
> There are two modes in yarn container cpu limitation. The default is Shared mode which guarantees the requested resource and can also use other spare CPU if avaliable. Another one is Strict mode, container's resource is limited to allocated resource strictly.
> If we want to limit the resource usage of the container and can use a certain percentage of spare CPU if available, the above two modes cannot satisfy our demand. We can define a relax coefficient(yarn.nodemanager.linux-container-executor.cgroups.strict-resource-usage.ratio) to relax the restrictions on resources in strict mode.
>  
> Share Mode,
>   



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org