You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Harsh J (JIRA)" <ji...@apache.org> on 2011/06/18 19:13:47 UTC

[jira] [Moved] (MAPREDUCE-2605) Hadoop Streaming (StreamJob) does not delete temporary job/package jar

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J moved HADOOP-7263 to MAPREDUCE-2605:
--------------------------------------------

    Affects Version/s:     (was: 0.20.4)
                           (was: 0.20.3)
                           (was: 0.20.2)
                           (was: 0.21.0)
                       0.20.2
                  Key: MAPREDUCE-2605  (was: HADOOP-7263)
              Project: Hadoop Map/Reduce  (was: Hadoop Common)

> Hadoop Streaming (StreamJob) does not delete temporary job/package jar
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2605
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2605
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.20.2
>            Reporter: Greg Wittel
>            Priority: Minor
>   Original Estimate: 5m
>  Remaining Estimate: 5m
>
> The streaming job driver (org.apache.hadoop.streaming.StreamJob) does not delete the temporary JAR file it generates after a job completes.  Without the fix, /var/tmp fills up  with streaming job jars until they get wiped.
> The jar name is stored in the class variable 'jar_'.  The JAR is generated in 'packageJobJar()' and the name stored in jar_.
> Fix:  run()/submitAndMonitorJob() should clean up the jar_ file when done.  Or the JAR could be generatd as a tempfile and cleaned up automatically.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira