You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Keith Thompson <kt...@binghamton.edu> on 2011/10/28 18:03:28 UTC
retrieving files from hdfs in cygwin
Hi,
I have used Hadoop with Linux successfully and am now trying to use it on a
Windows machine running Cygwin. I ran a job and am now trying to use
bin/hadoop fs -get <source> <destination>
to retrieve the files. I can an error saying "get: Access is denied." Any
insights into what may be causing this? The output is there and I was able
to view it using
bin/hadoop fs -text /path/to/output
Regards,
--
*Keith Thompson*
Graduate Research Associate, Xerox Corporation
SUNY Research Foundation
Dept. of Systems Science and Industrial Engineering
Binghamton University
work: 585-422-6587
Re: retrieving files from hdfs in cygwin
Posted by Masoud <ma...@agape.hanyang.ac.kr>.
Hi,
i have exactly same problem, hadoop saving any data in C:,
not in cygvin area, after one day i could not solve the problem yet,
thanks
On 10/29/2011 01:38 AM, Keith Thompson wrote:
> The destination is just a folder on my C: drive. C:/output/
> Since I could not get the file from the HDFS into that folder, I just re-ran
> the Hadoop job and had it put the output file directly onto the C drive
> instead of onto the HDFS. So, yes it wrote to that location during the
> reduce stage. But it just wouldn't -get from the HDFS and put the output in
> that location for some reason.
>
> Keith
>
> On Fri, Oct 28, 2011 at 12:26 PM, Mathijs Homminga<
> mathijs.homminga@knowlogy.nl> wrote:
>
>> What is the<destination> that you are using? Are you able to write to that
>> location?
>>
>> Mathijs Homminga
>>
>> On Oct 28, 2011, at 18:03, Keith Thompson<kt...@binghamton.edu> wrote:
>>
>>> Hi,
>>>
>>> I have used Hadoop with Linux successfully and am now trying to use it on
>> a
>>> Windows machine running Cygwin. I ran a job and am now trying to use
>>>
>>> bin/hadoop fs -get<source> <destination>
>>>
>>> to retrieve the files. I can an error saying "get: Access is denied."
>> Any
>>> insights into what may be causing this? The output is there and I was
>> able
>>> to view it using
>>>
>>> bin/hadoop fs -text /path/to/output
>>>
>>> Regards,
>>>
>>> --
>>> *Keith Thompson*
>>> Graduate Research Associate, Xerox Corporation
>>> SUNY Research Foundation
>>> Dept. of Systems Science and Industrial Engineering
>>> Binghamton University
>>> work: 585-422-6587
>
>
Re: retrieving files from hdfs in cygwin
Posted by Keith Thompson <kt...@binghamton.edu>.
The destination is just a folder on my C: drive. C:/output/
Since I could not get the file from the HDFS into that folder, I just re-ran
the Hadoop job and had it put the output file directly onto the C drive
instead of onto the HDFS. So, yes it wrote to that location during the
reduce stage. But it just wouldn't -get from the HDFS and put the output in
that location for some reason.
Keith
On Fri, Oct 28, 2011 at 12:26 PM, Mathijs Homminga <
mathijs.homminga@knowlogy.nl> wrote:
> What is the <destination> that you are using? Are you able to write to that
> location?
>
> Mathijs Homminga
>
> On Oct 28, 2011, at 18:03, Keith Thompson <kt...@binghamton.edu> wrote:
>
> > Hi,
> >
> > I have used Hadoop with Linux successfully and am now trying to use it on
> a
> > Windows machine running Cygwin. I ran a job and am now trying to use
> >
> > bin/hadoop fs -get <source> <destination>
> >
> > to retrieve the files. I can an error saying "get: Access is denied."
> Any
> > insights into what may be causing this? The output is there and I was
> able
> > to view it using
> >
> > bin/hadoop fs -text /path/to/output
> >
> > Regards,
> >
> > --
> > *Keith Thompson*
> > Graduate Research Associate, Xerox Corporation
> > SUNY Research Foundation
> > Dept. of Systems Science and Industrial Engineering
> > Binghamton University
> > work: 585-422-6587
>
--
*Keith Thompson*
Graduate Research Associate, Xerox Corporation
SUNY Research Foundation
Dept. of Systems Science and Industrial Engineering
Binghamton University
work: 585-422-6587
Re: retrieving files from hdfs in cygwin
Posted by Mathijs Homminga <ma...@knowlogy.nl>.
What is the <destination> that you are using? Are you able to write to that location?
Mathijs Homminga
On Oct 28, 2011, at 18:03, Keith Thompson <kt...@binghamton.edu> wrote:
> Hi,
>
> I have used Hadoop with Linux successfully and am now trying to use it on a
> Windows machine running Cygwin. I ran a job and am now trying to use
>
> bin/hadoop fs -get <source> <destination>
>
> to retrieve the files. I can an error saying "get: Access is denied." Any
> insights into what may be causing this? The output is there and I was able
> to view it using
>
> bin/hadoop fs -text /path/to/output
>
> Regards,
>
> --
> *Keith Thompson*
> Graduate Research Associate, Xerox Corporation
> SUNY Research Foundation
> Dept. of Systems Science and Industrial Engineering
> Binghamton University
> work: 585-422-6587