[GitHub] [pinot] tibrewalpratik17 commented on issue #10467: _tmp folder not getting properly cleaned up leading to high disk usage

["tibrewalpratik17 (via GitHub)" <gi...@apache.org>]

tibrewalpratik17 commented on issue #10467:
URL: https://github.com/apache/pinot/issues/10467#issuecomment-1511651452

   @Jackie-Jiang we saw a case today where the `_tmp` folder created was huge in size (~60% disk size) and the total disk usage went up to 100%. The server crashed and during restart tries as the disk size was full, the server was unable to come back up. This led to the `_tmp` folder not getting deleted because of this change and we had to manually delete the folder to bring the server back up. 
   Any idea why we are seeing such huge `_tmp` folder sizes? I don't find anything suspicious from the logs. And how can we make sure that if segment seal fails or something, there is a proper cleanup of `_tmp` folder.
   PS: `_tmp` folder is not even reported in size on Pinot controller UI so debugging the right table responsible for high disk usage becomes tedious.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org