You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2015/05/06 05:39:44 UTC
[jira] [Updated] (MAPREDUCE-6111) Hadoop users' staging directories
should be under a user folder
[ https://issues.apache.org/jira/browse/MAPREDUCE-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allen Wittenauer updated MAPREDUCE-6111:
----------------------------------------
Labels: BB2015-05-TBR (was: )
> Hadoop users' staging directories should be under a user folder
> ---------------------------------------------------------------
>
> Key: MAPREDUCE-6111
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6111
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.5.0, 2.4.1
> Reporter: Jian Fang
> Labels: BB2015-05-TBR
> Attachments: MAPREDUCE-6111.2.patch
>
>
> Right now, Hadoop puts all users' staging directories under /tmp/hadoop-yarn/staging/, for example /tmp/hadoop-yarn/staging/hadoop for user hadoop, but the directory /tmp/hadoop-yarn/staging is also used for other purpose. For example, /tmp/hadoop-yarn/staging/history/ is used to hold finished JHS files. The shared parent /tmp/hadoop-yarn/staging makes it difficult to track all users' folders without adding extra logic to exclude other known folders.
> As a result, we should move all users' folders to a user sub-folder, i.e., /tmp/hadoop-yarn/staging/user/. In this case, user hadoop's staging folder becomes /tmp/hadoop-yarn/staging/user/hadoop/.staging.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)