[jira] [Updated] (TEZ-793) Staging directories accumulate and pollute the home directory

["Hitesh Shah (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hitesh Shah updated TEZ-793:
----------------------------

    Issue Type: Sub-task  (was: Improvement)
        Parent: TEZ-1217

> Staging directories accumulate and pollute the home directory
> -------------------------------------------------------------
>
>                 Key: TEZ-793
>                 URL: https://issues.apache.org/jira/browse/TEZ-793
>             Project: Apache Tez
>          Issue Type: Sub-task
>            Reporter: Mark Wagner
>
> Right now, most of the examples use 
> {noformat}
> Path stagingDir = new Path(fs.getWorkingDirectory(), UUID.randomUUID().toString());
> {noformat}
> to get the staging directory. This results in home directories filled with directories that have to be manually deleted one by one. The MRRSleep example is the only example which uses TEZ_AM_STAGING_DIR, but that defaults to '/tmp/tez/staging', which breaks for more than one user.
> It would be good to have a standardized way of handling staging directories for Tez. Optimally, it would be nice if Tez would handle the lifecycle of its staging directory itself.



--
This message was sent by Atlassian JIRA
(v6.2#6252)