You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/02/10 11:31:14 UTC

[GitHub] [arrow-datafusion] mingmwang commented on issue #1780: Enable periodic cleanup of work_dir directories in ballista executor

mingmwang commented on issue #1780:
URL: https://github.com/apache/arrow-datafusion/issues/1780#issuecomment-1034810731


   > > preemptively
   > > @houqp
   > > Sorry for my confusion , You mean if a job has 3 stage, when stage3 is running, we can delete stage 1 first?
   
   IMO, I think when a SQL is finished, all the immediate shuffle data can be cleared except for the result data.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org