[jira] [Created] (QUICKSTEP-35) Quickstep doesn't clean up on-disk temp blocks on crash

["Navneet Potti (JIRA)" <ji...@apache.org>]

Navneet Potti created QUICKSTEP-35:
--------------------------------------

             Summary: Quickstep doesn't clean up on-disk temp blocks on crash
                 Key: QUICKSTEP-35
                 URL: https://issues.apache.org/jira/browse/QUICKSTEP-35
             Project: Apache Quickstep
          Issue Type: Bug
          Components: Storage
            Reporter: Navneet Potti


After a crash, the *.qsb files corresponding to the temp blocks in the storage directory don't get cleaned up. This causes the storage directory size to grow, and eventually run out of disk space. 

I observed this when running TPCH SF100 many times over a weekend. The directory size eventually reached 300GB. 

Two possible fixes:
* Long term fix: Crashes should be handled using exceptions that are passed around and some destructor should clean up the temp blocks before exiting. 
* Hacky short term fix: Provide a flag that cleans up orphaned blocks from the storage directory on startup. It could also be a separate utility script.

The hacky fix should be easy for a newbie to complete in about a day.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)