You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by subramgr <su...@gmail.com> on 2018/10/11 20:30:04 UTC

[Spark Structured Streaming] Running out of disk quota due to /work/tmp

We have a Spark Structured Streaming job which runs out of disk quota after
some days.

The primary reason is there are bunch of empty folders that are getting
created in the /work/tmp directory. 

Any idea how to prune them?



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org