You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Feng Yuan (JIRA)" <ji...@apache.org> on 2017/03/07 03:48:33 UTC

[jira] [Commented] (YARN-2904) Use linux cgroups to enhance container tear down

    [ https://issues.apache.org/jira/browse/YARN-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898688#comment-15898688 ] 

Feng Yuan commented on YARN-2904:
---------------------------------

In my humble opinion,Task process leak but some unknowable reason(YARN-6276),and result to when deleteCgroup() will get os panic(this issue),so i add the relation here.

> Use linux cgroups to enhance container tear down
> ------------------------------------------------
>
>                 Key: YARN-2904
>                 URL: https://issues.apache.org/jira/browse/YARN-2904
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: nodemanager
>    Affects Versions: 2.6.0
>            Reporter: Nathan Roberts
>
> If we are launching yarn containers within cgroups, linux provides some guarantees that can help completely tear down a container.  Specifically, linux guarantees that tasks can't escape a cgroup. We can use this fact to tear down a yarn container without leaking tasks.
> Today, a SIGTERM is sent to the session (normally lead by bash). When the session leader exits, the LCE sees this and assumes all resources have been given back to the system. This is not guaranteed. Example: YARN-2809 implements a workaround that is only necessary because tasks are still lingering within the cgroup when the nodemanager attempts to delete it.  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org