You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Steve Lewis <lo...@gmail.com> on 2011/11/22 00:47:22 UTC
Gratuitous use of CHMOD in windows
I am running a job on a cluster launching from a windows box and "
fs.default.name" to point the job to the cluster.
Everything works until the last step where I say
FileSystem fileSystem = FileSystem.get(config); // this is hdfs
fileSystem.copyToLocalFile(src, dst); // local system
at this point RawLocalFileSystem tries to exec chmod which is not on
windows.
This looks like a bug - it seems that there should be a fallback system or
better yet a call to the
Java standard File.canWrite command before attempting to alter permissions
--
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com
Re: Gratuitous use of CHMOD in windows
Posted by Lance Norskog <go...@gmail.com>.
This is the only problem with running Hadoop on Windows without Cygwin.
Also, you might be able to install the 'core' package of 'gnuwin32' and add
the chmod.exe there to your path.
http://sourceforge.net/projects/gnuwin32/files/
On Mon, Nov 21, 2011 at 6:14 PM, Harsh J <ha...@cloudera.com> wrote:
> Steve,
>
> We do welcome improvement patches for better Windows support. Would you
> mind filing a JIRA and a patch for this under HADOOP?
>
> On 22-Nov-2011, at 5:17 AM, Steve Lewis wrote:
>
> I am running a job on a cluster launching from a windows box and "
> fs.default.name" to point the job to the cluster.
> Everything works until the last step where I say
>
> FileSystem fileSystem = FileSystem.get(config); // this is hdfs
> fileSystem.copyToLocalFile(src, dst); // local system
>
> at this point RawLocalFileSystem tries to exec chmod which is not on
> windows.
>
> This looks like a bug - it seems that there should be a fallback system or
> better yet a call to the
> Java standard File.canWrite command before attempting to alter permissions
>
> --
> Steven M. Lewis PhD
> 4221 105th Ave NE
> Kirkland, WA 98033
> 206-384-1340 (cell)
> Skype lordjoe_com
>
>
>
>
--
Lance Norskog
goksron@gmail.com
Re: Gratuitous use of CHMOD in windows
Posted by Harsh J <ha...@cloudera.com>.
Steve,
We do welcome improvement patches for better Windows support. Would you mind filing a JIRA and a patch for this under HADOOP?
On 22-Nov-2011, at 5:17 AM, Steve Lewis wrote:
> I am running a job on a cluster launching from a windows box and "fs.default.name" to point the job to the cluster.
> Everything works until the last step where I say
>
> FileSystem fileSystem = FileSystem.get(config); // this is hdfs
> fileSystem.copyToLocalFile(src, dst); // local system
>
> at this point RawLocalFileSystem tries to exec chmod which is not on windows.
>
> This looks like a bug - it seems that there should be a fallback system or better yet a call to the
> Java standard File.canWrite command before attempting to alter permissions
>
> --
> Steven M. Lewis PhD
> 4221 105th Ave NE
> Kirkland, WA 98033
> 206-384-1340 (cell)
> Skype lordjoe_com
>
>
Re: Gratuitous use of CHMOD in windows
Posted by Stephen Boesch <ja...@gmail.com>.
Hi,
you'll probably need to be running this under cygwin since windows native
is not supported.
2011/11/21 Steve Lewis <lo...@gmail.com>
> I am running a job on a cluster launching from a windows box and "
> fs.default.name" to point the job to the cluster.
> Everything works until the last step where I say
>
> FileSystem fileSystem = FileSystem.get(config); // this is hdfs
> fileSystem.copyToLocalFile(src, dst); // local system
>
> at this point RawLocalFileSystem tries to exec chmod which is not on
> windows.
>
> This looks like a bug - it seems that there should be a fallback system or
> better yet a call to the
> Java standard File.canWrite command before attempting to alter permissions
>
> --
> Steven M. Lewis PhD
> 4221 105th Ave NE
> Kirkland, WA 98033
> 206-384-1340 (cell)
> Skype lordjoe_com
>
>
>