You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Cody Koeninger <co...@koeninger.org> on 2014/12/22 19:19:42 UTC
cleaning up cache files left by SPARK-2713
Is there a reason not to go ahead and move the _cache and _lock files
created by Utils.fetchFiles into the work directory, so they can be cleaned
up more easily? I saw comments to that effect in the discussion of the PR
for 2713, but it doesn't look like it got done.
And no, I didn't just have a machine fill up the /tmp directory, why do you
ask? :)
Re: cleaning up cache files left by SPARK-2713
Posted by Josh Rosen <ro...@gmail.com>.
I reviewed and merged that PR, in case you want to try out the fix.
- Josh
On December 22, 2014 at 10:40:35 AM, Marcelo Vanzin (vanzin@cloudera.com) wrote:
https://github.com/apache/spark/pull/3705
On Mon, Dec 22, 2014 at 10:19 AM, Cody Koeninger <co...@koeninger.org> wrote:
> Is there a reason not to go ahead and move the _cache and _lock files
> created by Utils.fetchFiles into the work directory, so they can be cleaned
> up more easily? I saw comments to that effect in the discussion of the PR
> for 2713, but it doesn't look like it got done.
>
> And no, I didn't just have a machine fill up the /tmp directory, why do you
> ask? :)
--
Marcelo
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org
Re: cleaning up cache files left by SPARK-2713
Posted by Marcelo Vanzin <va...@cloudera.com>.
https://github.com/apache/spark/pull/3705
On Mon, Dec 22, 2014 at 10:19 AM, Cody Koeninger <co...@koeninger.org> wrote:
> Is there a reason not to go ahead and move the _cache and _lock files
> created by Utils.fetchFiles into the work directory, so they can be cleaned
> up more easily? I saw comments to that effect in the discussion of the PR
> for 2713, but it doesn't look like it got done.
>
> And no, I didn't just have a machine fill up the /tmp directory, why do you
> ask? :)
--
Marcelo
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org