[jira] [Resolved] (YARN-8385) Clean local directories when a container is killed

["Jason Lowe (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/YARN-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Lowe resolved YARN-8385.
------------------------------
    Resolution: Invalid

Closing this as invalid since YARN is deleting the container directory and leaving the application directory as designed.  This appears to be a problem with the application rather than a problem with YARN.

> Clean local directories when a container is killed
> --------------------------------------------------
>
>                 Key: YARN-8385
>                 URL: https://issues.apache.org/jira/browse/YARN-8385
>             Project: Hadoop YARN
>          Issue Type: Bug
>    Affects Versions: 2.7.0
>            Reporter: Marco Gaido
>            Priority: Major
>
> In long running applications, it may happen that many containers are created and killed. A use case is Spark Thrift Server when dynamic allocation is enabled. A lot of containers are killed and the application keeps running indefinitely.
> Currently, YARN seems to remove the local directories only when the whole application terminates. In the scenario described above, this can cause serious resource leakages. Please, check https://issues.apache.org/jira/browse/SPARK-22575.
> I think YARN should clean up all the local directories of a container when it is killed and not when the whole application terminates.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org