You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/10/28 03:25:13 UTC

[GitHub] [hudi] XuQianJin-Stars commented on pull request #6284: [HUDI-4526] Improve spillableMapBasePath disk directory is full

XuQianJin-Stars commented on PR #6284:
URL: https://github.com/apache/hudi/pull/6284#issuecomment-1294401196

   > let me explain my understanding. by default, we create spillable map dir files using `deleteOnExit`. So, only case is, if process crashed mid-way, those files are left as is.
   > 
   > So, irrespective of whether we chose "/tmp" or some other dir "X" chosen by user. there should be some other process that cleans up either /tmp" or "X" at regular cadence. if not, not sure how this would automatically solve the issue. thats the only way the spillable base path could get full.
   > 
   > or am I missing something here.
   
   This directory in yarn is now deleted when the app exits.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org