You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2014/04/09 17:32:24 UTC

[jira] [Updated] (YARN-1338) Recover localized resource cache state upon nodemanager restart

     [ https://issues.apache.org/jira/browse/YARN-1338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Lowe updated YARN-1338:
-----------------------------

    Attachment: YARN-1338v2.patch

Updating patch after YARN-1757 and other recent changes on trunk.

> Recover localized resource cache state upon nodemanager restart
> ---------------------------------------------------------------
>
>                 Key: YARN-1338
>                 URL: https://issues.apache.org/jira/browse/YARN-1338
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: nodemanager
>    Affects Versions: 2.3.0
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>         Attachments: YARN-1338.patch, YARN-1338v2.patch
>
>
> Today when node manager restarts we clean up all the distributed cache files from disk. This is definitely not ideal from 2 aspects.
> * For work preserving restart we definitely want them as running containers are using them
> * For even non work preserving restart this will be useful in the sense that we don't have to download them again if needed by future tasks.



--
This message was sent by Atlassian JIRA
(v6.2#6252)