[jira] [Commented] (PIG-3169) Remove temporary files that are not needed

["Mark Wagner (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13582529#comment-13582529 ] 

Mark Wagner commented on PIG-3169:
----------------------------------

Thanks for catching that, Cheolsoo. I only ran test-commit before, but have confirmed that the test fails now.

Unfortunately, the call in GruntParser only takes care of intermediate data from dump commands. The PigServer call handles all intermediate data for jobs that STORE from Grunt. Without the PigServer call, intermediate results will still be left in /tmp until a DUMP or the session ends. In general, "deleteTempFiles()" seems to be heavy-handed for this. I think it's better to build more granular controls into FileLocalizer.
                
> Remove temporary files that are not needed
> ------------------------------------------
>
>                 Key: PIG-3169
>                 URL: https://issues.apache.org/jira/browse/PIG-3169
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Mark Wagner
>            Assignee: Mark Wagner
>            Priority: Minor
>             Fix For: 0.12
>
>         Attachments: PIG-3169.1.patch, PIG-3169-hotfix.patch
>
>
> When using Grunt, intermediate data and distributed caches files are left in 'pig.temp.dir' until the session is closed. It would be nice to cleanup files as they are no longer needed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira