You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Vitalii Diravka (JIRA)" <ji...@apache.org> on 2016/03/30 14:31:25 UTC

[jira] [Comment Edited] (DRILL-2100) Drill not deleting spooling files

    [ https://issues.apache.org/jira/browse/DRILL-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15214433#comment-15214433 ] 

Vitalii Diravka edited comment on DRILL-2100 at 3/30/16 12:30 PM:
------------------------------------------------------------------

[~haozhu], 

Added deleting of the whole directory for SQL profile Id ("/tmp/drill/spill/2aa9600f-016a-5283-f98e-ef22942981c2" for example) when FileSystem is closed. 
Add closeSpillFileSytem method to Foreman.close().
https://github.com/vdiravka/drill/commit/a5f891dbba06c2f15c8478c7843394c809de25c0


was (Author: vitalii):
[~haozhu], 

Added deleting of the whole directory for SQL profile Id ("/tmp/drill/spill/2aa9600f-016a-5283-f98e-ef22942981c2" for example) when FileSystem is closed. 
https://github.com/vdiravka/drill/commit/a5f891dbba06c2f15c8478c7843394c809de25c0

> Drill not deleting spooling files
> ---------------------------------
>
>                 Key: DRILL-2100
>                 URL: https://issues.apache.org/jira/browse/DRILL-2100
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Execution - Relational Operators
>    Affects Versions: 0.8.0
>            Reporter: Abhishek Girish
>            Assignee: Vitalii Diravka
>             Fix For: Future
>
>
> Currently, after forcing queries to use an external sort by switching off hash join/agg causes spill-to-disk files accumulating. 
> This causes issues with disk space availability when the spill is configured to be on the local file system (/tmp/drill). Also not optimal when configured to use DFS (custom). 
> Drill must clean up all temporary files created after a query completes or after a drillbit restart. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)