You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-issues@hadoop.apache.org by "Jason Lowe (JIRA)" <ji...@apache.org> on 2014/06/21 00:24:24 UTC

[jira] [Created] (YARN-2185) Use pipes when localizing archives

Jason Lowe created YARN-2185:
--------------------------------

             Summary: Use pipes when localizing archives
                 Key: YARN-2185
                 URL: https://issues.apache.org/jira/browse/YARN-2185
             Project: Hadoop YARN
          Issue Type: Improvement
          Components: nodemanager
    Affects Versions: 2.4.0
            Reporter: Jason Lowe


Currently the nodemanager downloads an archive to a local file, unpacks it, and then removes it.  It would be more efficient to stream the data as it's being unpacked to avoid both the extra disk space requirements and the additional disk activity from storing the archive.



--
This message was sent by Atlassian JIRA
(v6.2#6252)