You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by goi cto <go...@gmail.com> on 2014/03/03 11:34:16 UTC
Problem with "delete spark temp dir" on spark 0.8.1
Hi,
I am running a spark java program on a local machine. when I try to write
the output to a file (RDD.SaveAsTextFile) I am getting this exception:
Exception in thread "Delete Spark temp dir ..."
This is running on my local window machine.
Any ideas?
--
Eran | CTO
Re: Problem with "delete spark temp dir" on spark 0.8.1
Posted by goi cto <go...@gmail.com>.
Exception in thread "delete Spark temp dir C:\Users\..."
java.io.IOException: failed to delete: C:\Users\...\simple-project-1.0.jar"
at org.apache.spark.util.utils$.deleteRecursively(Utils.scala:495)
at
org.apache.spark.util.utils$$anonfun$deleteRecursively$1.apply(Utils.scala:491)
I deleted my temp dir as suggested and indeed all spark.. directories were
deleted. after which I run the program again and got the same error again.
also indeed a spark-... directory with the "simple-project-1.0.jar" was
found left on the file system.
I had no problem deleting this file once the program completed.
Eran
On Tue, Mar 4, 2014 at 11:36 AM, Akhil Das <ak...@mobipulse.in> wrote:
> Hi,
>
> Try to clean your temp dir, System.getProperty("java.io.tmpdir")
>
> Also, Can you paste a longer stacktrace?
>
>
>
>
> Thanks
> Best Regards
>
>
> On Tue, Mar 4, 2014 at 2:55 PM, goi cto <go...@gmail.com> wrote:
>
>> Hi,
>>
>> I am running a spark java program on a local machine. when I try to write
>> the output to a file (RDD.SaveAsTextFile) I am getting this exception:
>>
>> Exception in thread "Delete Spark temp dir ..."
>>
>> This is running on my local window machine.
>>
>> Any ideas?
>>
>> --
>> Eran | CTO
>>
>>
>>
>
>
> --
> Thanks
> Best Regards
>
--
Eran | CTO
Re: Problem with "delete spark temp dir" on spark 0.8.1
Posted by Akhil Das <ak...@mobipulse.in>.
Hi,
Try to clean your temp dir, System.getProperty("java.io.tmpdir")
Also, Can you paste a longer stacktrace?
Thanks
Best Regards
On Tue, Mar 4, 2014 at 2:55 PM, goi cto <go...@gmail.com> wrote:
> Hi,
>
> I am running a spark java program on a local machine. when I try to write
> the output to a file (RDD.SaveAsTextFile) I am getting this exception:
>
> Exception in thread "Delete Spark temp dir ..."
>
> This is running on my local window machine.
>
> Any ideas?
>
> --
> Eran | CTO
>
>
>
--
Thanks
Best Regards
Fwd: Problem with "delete spark temp dir" on spark 0.8.1
Posted by goi cto <go...@gmail.com>.
Hi,
I am running a spark java program on a local machine. when I try to write
the output to a file (RDD.SaveAsTextFile) I am getting this exception:
Exception in thread "Delete Spark temp dir ..."
This is running on my local window machine.
Any ideas?
--
Eran | CTO