You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Aniket Bhatnagar <an...@gmail.com> on 2014/09/01 08:18:54 UTC
[Stream] Checkpointing | chmod: cannot access `/cygdrive/d/tmp/spark/f8e594bf-d940-41cb-ab0e-0fd3710696cb/rdd-57/.part-00001-attempt-215':
No such file or directory
On my local (windows) dev environment, I have been trying to get spark
streaming running to test my real time(ish) jobs. I have set the checkpoint
directory as /tmp/spark and have installed latest cygwin. I keep getting
the following error:
org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
`/cygdrive/d/tmp/spark/f8e594bf-d940-41cb-ab0e-0fd3710696cb/rdd-57/.part-00001-attempt-215':
No such file or directory
Although nothing breaks but such errors are a bit annoying. Any clues on
how to fix the issue?
Re: [Stream] Checkpointing | chmod: cannot access `/cygdrive/d/tmp/spark/f8e594bf-d940-41cb-ab0e-0fd3710696cb/rdd-57/.part-00001-attempt-215':
No such file or directory
Posted by Aniket Bhatnagar <an...@gmail.com>.
Hi everyone
It turns out that I had chef installed and it's chmod has higher
preference than cygwin's chmod in the PATH. I fixed the environment
variable and now its working fine.
On 1 September 2014 11:48, Aniket Bhatnagar <an...@gmail.com>
wrote:
> On my local (windows) dev environment, I have been trying to get spark
> streaming running to test my real time(ish) jobs. I have set the checkpoint
> directory as /tmp/spark and have installed latest cygwin. I keep getting
> the following error:
>
> org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
> `/cygdrive/d/tmp/spark/f8e594bf-d940-41cb-ab0e-0fd3710696cb/rdd-57/.part-00001-attempt-215':
> No such file or directory
>
>
> Although nothing breaks but such errors are a bit annoying. Any clues on
> how to fix the issue?
>