You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Farhan Iqbal <fa...@gmail.com> on 2015/10/30 17:27:16 UTC
New to hadoop. Need help
Hi guys
I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
https://wiki.apache.org/hadoop/Hadoop2OnWindows
Now my question is
How can I browse file in windows which are in hdfs system
e.g. when I executed this command
%HADOOP_PREFIX%\bin\yarn jar
%HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-examples-2.5.0.jar
wordcount /myfile.txt /out
where can I view this /out directory etc in windows.
I have pushed myfile.txt using
C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
Re: New to hadoop. Need help
Posted by Tenghuan He <te...@gmail.com>.
You can see the local location settings in your /etc/hadoop/hdfs.xml files
in the property *dfs.namenode.name.dir* for namenode and
*dfs.datanode.data.dir* for datanode
if you didn't configure these, on Windows 7 it may go to
*D:\tmp\hadoop-username\dfs* (in my case, with hadoop installed in *D:\*)
On Sat, Oct 31, 2015 at 4:05 AM, Caesar Samsi <cm...@hotmail.com> wrote:
> Hi Farhan,
>
>
>
> The file and directories are in Hadoop. To get it to Windows, you’d have
> to issue “hdfs dfs get hadoopfilename.txt windowsfilename.txt
>
>
>
> Hope this helps!
>
>
>
> Best, Caesar.
>
>
>
> *From:* Farhan Iqbal [mailto:farhan.iqbal@gmail.com]
> *Sent:* Friday, October 30, 2015 12:27 PM
> *To:* user@hadoop.apache.org
> *Subject:* New to hadoop. Need help
>
>
>
> Hi guys
>
> I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
>
>
>
> https://wiki.apache.org/hadoop/Hadoop2OnWindows
>
>
>
>
>
> Now my question is
>
>
>
> How can I browse file in windows which are in hdfs system
>
>
>
> e.g. when I executed this command
>
>
>
>
>
> %HADOOP_PREFIX%\bin\yarn jar %HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-example
>
> s-2.5.0.jar wordcount /myfile.txt /out
>
>
>
>
>
> where can I view this /out directory etc in windows.
>
>
>
> I have pushed myfile.txt using
>
>
>
> C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
>
>
Re: New to hadoop. Need help
Posted by Tenghuan He <te...@gmail.com>.
You can see the local location settings in your /etc/hadoop/hdfs.xml files
in the property *dfs.namenode.name.dir* for namenode and
*dfs.datanode.data.dir* for datanode
if you didn't configure these, on Windows 7 it may go to
*D:\tmp\hadoop-username\dfs* (in my case, with hadoop installed in *D:\*)
On Sat, Oct 31, 2015 at 4:05 AM, Caesar Samsi <cm...@hotmail.com> wrote:
> Hi Farhan,
>
>
>
> The file and directories are in Hadoop. To get it to Windows, you’d have
> to issue “hdfs dfs get hadoopfilename.txt windowsfilename.txt
>
>
>
> Hope this helps!
>
>
>
> Best, Caesar.
>
>
>
> *From:* Farhan Iqbal [mailto:farhan.iqbal@gmail.com]
> *Sent:* Friday, October 30, 2015 12:27 PM
> *To:* user@hadoop.apache.org
> *Subject:* New to hadoop. Need help
>
>
>
> Hi guys
>
> I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
>
>
>
> https://wiki.apache.org/hadoop/Hadoop2OnWindows
>
>
>
>
>
> Now my question is
>
>
>
> How can I browse file in windows which are in hdfs system
>
>
>
> e.g. when I executed this command
>
>
>
>
>
> %HADOOP_PREFIX%\bin\yarn jar %HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-example
>
> s-2.5.0.jar wordcount /myfile.txt /out
>
>
>
>
>
> where can I view this /out directory etc in windows.
>
>
>
> I have pushed myfile.txt using
>
>
>
> C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
>
>
Re: New to hadoop. Need help
Posted by Tenghuan He <te...@gmail.com>.
You can see the local location settings in your /etc/hadoop/hdfs.xml files
in the property *dfs.namenode.name.dir* for namenode and
*dfs.datanode.data.dir* for datanode
if you didn't configure these, on Windows 7 it may go to
*D:\tmp\hadoop-username\dfs* (in my case, with hadoop installed in *D:\*)
On Sat, Oct 31, 2015 at 4:05 AM, Caesar Samsi <cm...@hotmail.com> wrote:
> Hi Farhan,
>
>
>
> The file and directories are in Hadoop. To get it to Windows, you’d have
> to issue “hdfs dfs get hadoopfilename.txt windowsfilename.txt
>
>
>
> Hope this helps!
>
>
>
> Best, Caesar.
>
>
>
> *From:* Farhan Iqbal [mailto:farhan.iqbal@gmail.com]
> *Sent:* Friday, October 30, 2015 12:27 PM
> *To:* user@hadoop.apache.org
> *Subject:* New to hadoop. Need help
>
>
>
> Hi guys
>
> I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
>
>
>
> https://wiki.apache.org/hadoop/Hadoop2OnWindows
>
>
>
>
>
> Now my question is
>
>
>
> How can I browse file in windows which are in hdfs system
>
>
>
> e.g. when I executed this command
>
>
>
>
>
> %HADOOP_PREFIX%\bin\yarn jar %HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-example
>
> s-2.5.0.jar wordcount /myfile.txt /out
>
>
>
>
>
> where can I view this /out directory etc in windows.
>
>
>
> I have pushed myfile.txt using
>
>
>
> C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
>
>
Re: New to hadoop. Need help
Posted by Tenghuan He <te...@gmail.com>.
You can see the local location settings in your /etc/hadoop/hdfs.xml files
in the property *dfs.namenode.name.dir* for namenode and
*dfs.datanode.data.dir* for datanode
if you didn't configure these, on Windows 7 it may go to
*D:\tmp\hadoop-username\dfs* (in my case, with hadoop installed in *D:\*)
On Sat, Oct 31, 2015 at 4:05 AM, Caesar Samsi <cm...@hotmail.com> wrote:
> Hi Farhan,
>
>
>
> The file and directories are in Hadoop. To get it to Windows, you’d have
> to issue “hdfs dfs get hadoopfilename.txt windowsfilename.txt
>
>
>
> Hope this helps!
>
>
>
> Best, Caesar.
>
>
>
> *From:* Farhan Iqbal [mailto:farhan.iqbal@gmail.com]
> *Sent:* Friday, October 30, 2015 12:27 PM
> *To:* user@hadoop.apache.org
> *Subject:* New to hadoop. Need help
>
>
>
> Hi guys
>
> I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
>
>
>
> https://wiki.apache.org/hadoop/Hadoop2OnWindows
>
>
>
>
>
> Now my question is
>
>
>
> How can I browse file in windows which are in hdfs system
>
>
>
> e.g. when I executed this command
>
>
>
>
>
> %HADOOP_PREFIX%\bin\yarn jar %HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-example
>
> s-2.5.0.jar wordcount /myfile.txt /out
>
>
>
>
>
> where can I view this /out directory etc in windows.
>
>
>
> I have pushed myfile.txt using
>
>
>
> C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
>
>
RE: New to hadoop. Need help
Posted by Caesar Samsi <cm...@hotmail.com>.
Hi Farhan,
The file and directories are in Hadoop. To get it to Windows, you’d have to issue “hdfs dfs get hadoopfilename.txt windowsfilename.txt
Hope this helps!
Best, Caesar.
From: Farhan Iqbal [mailto:farhan.iqbal@gmail.com]
Sent: Friday, October 30, 2015 12:27 PM
To: user@hadoop.apache.org
Subject: New to hadoop. Need help
Hi guys
I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
https://wiki.apache.org/hadoop/Hadoop2OnWindows
Now my question is
How can I browse file in windows which are in hdfs system
e.g. when I executed this command
%HADOOP_PREFIX%\bin\yarn jar %HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-example
s-2.5.0.jar wordcount /myfile.txt /out
where can I view this /out directory etc in windows.
I have pushed myfile.txt using
C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
Re: New to hadoop. Need help
Posted by Muhammad Atif <ma...@gmail.com>.
You can browse the out files by going to http://http//localhost:8080/.They
are stored in hadoop file system which is different from windows file system
On Fri, Oct 30, 2015 at 12:36 PM, Farhan Iqbal <fa...@gmail.com>
wrote:
> No sir, my question is can I browse these files in windows? Like what is
> the physical location of these files in windows?
>
>
>
> Farhan Iqbal
>
> On Fri, Oct 30, 2015 at 10:28 AM, Namikaze Minato <ll...@gmail.com>
> wrote:
>
>> %HADOOP_PREFIX%\bin\hdfs dfs -ls /
>> %HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
>>
>> ?
>>
>> Regards,
>> LLoyd
>>
>
>
Re: New to hadoop. Need help
Posted by Muhammad Atif <ma...@gmail.com>.
You can browse the out files by going to http://http//localhost:8080/.They
are stored in hadoop file system which is different from windows file system
On Fri, Oct 30, 2015 at 12:36 PM, Farhan Iqbal <fa...@gmail.com>
wrote:
> No sir, my question is can I browse these files in windows? Like what is
> the physical location of these files in windows?
>
>
>
> Farhan Iqbal
>
> On Fri, Oct 30, 2015 at 10:28 AM, Namikaze Minato <ll...@gmail.com>
> wrote:
>
>> %HADOOP_PREFIX%\bin\hdfs dfs -ls /
>> %HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
>>
>> ?
>>
>> Regards,
>> LLoyd
>>
>
>
Re: New to hadoop. Need help
Posted by Muhammad Atif <ma...@gmail.com>.
You can browse the out files by going to http://http//localhost:8080/.They
are stored in hadoop file system which is different from windows file system
On Fri, Oct 30, 2015 at 12:36 PM, Farhan Iqbal <fa...@gmail.com>
wrote:
> No sir, my question is can I browse these files in windows? Like what is
> the physical location of these files in windows?
>
>
>
> Farhan Iqbal
>
> On Fri, Oct 30, 2015 at 10:28 AM, Namikaze Minato <ll...@gmail.com>
> wrote:
>
>> %HADOOP_PREFIX%\bin\hdfs dfs -ls /
>> %HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
>>
>> ?
>>
>> Regards,
>> LLoyd
>>
>
>
Re: New to hadoop. Need help
Posted by Muhammad Atif <ma...@gmail.com>.
You can browse the out files by going to http://http//localhost:8080/.They
are stored in hadoop file system which is different from windows file system
On Fri, Oct 30, 2015 at 12:36 PM, Farhan Iqbal <fa...@gmail.com>
wrote:
> No sir, my question is can I browse these files in windows? Like what is
> the physical location of these files in windows?
>
>
>
> Farhan Iqbal
>
> On Fri, Oct 30, 2015 at 10:28 AM, Namikaze Minato <ll...@gmail.com>
> wrote:
>
>> %HADOOP_PREFIX%\bin\hdfs dfs -ls /
>> %HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
>>
>> ?
>>
>> Regards,
>> LLoyd
>>
>
>
Re: New to hadoop. Need help
Posted by Farhan Iqbal <fa...@gmail.com>.
No sir, my question is can I browse these files in windows? Like what is
the physical location of these files in windows?
Farhan Iqbal
On Fri, Oct 30, 2015 at 10:28 AM, Namikaze Minato <ll...@gmail.com>
wrote:
> %HADOOP_PREFIX%\bin\hdfs dfs -ls /
> %HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
>
> ?
>
> Regards,
> LLoyd
>
Re: New to hadoop. Need help
Posted by Farhan Iqbal <fa...@gmail.com>.
No sir, my question is can I browse these files in windows? Like what is
the physical location of these files in windows?
Farhan Iqbal
On Fri, Oct 30, 2015 at 10:28 AM, Namikaze Minato <ll...@gmail.com>
wrote:
> %HADOOP_PREFIX%\bin\hdfs dfs -ls /
> %HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
>
> ?
>
> Regards,
> LLoyd
>
Re: New to hadoop. Need help
Posted by Farhan Iqbal <fa...@gmail.com>.
No sir, my question is can I browse these files in windows? Like what is
the physical location of these files in windows?
Farhan Iqbal
On Fri, Oct 30, 2015 at 10:28 AM, Namikaze Minato <ll...@gmail.com>
wrote:
> %HADOOP_PREFIX%\bin\hdfs dfs -ls /
> %HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
>
> ?
>
> Regards,
> LLoyd
>
Re: New to hadoop. Need help
Posted by Farhan Iqbal <fa...@gmail.com>.
No sir, my question is can I browse these files in windows? Like what is
the physical location of these files in windows?
Farhan Iqbal
On Fri, Oct 30, 2015 at 10:28 AM, Namikaze Minato <ll...@gmail.com>
wrote:
> %HADOOP_PREFIX%\bin\hdfs dfs -ls /
> %HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
>
> ?
>
> Regards,
> LLoyd
>
Re: New to hadoop. Need help
Posted by Namikaze Minato <ll...@gmail.com>.
%HADOOP_PREFIX%\bin\hdfs dfs -ls /
%HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
?
Regards,
LLoyd
RE: New to hadoop. Need help
Posted by Caesar Samsi <cm...@hotmail.com>.
Hi Farhan,
The file and directories are in Hadoop. To get it to Windows, you’d have to issue “hdfs dfs get hadoopfilename.txt windowsfilename.txt
Hope this helps!
Best, Caesar.
From: Farhan Iqbal [mailto:farhan.iqbal@gmail.com]
Sent: Friday, October 30, 2015 12:27 PM
To: user@hadoop.apache.org
Subject: New to hadoop. Need help
Hi guys
I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
https://wiki.apache.org/hadoop/Hadoop2OnWindows
Now my question is
How can I browse file in windows which are in hdfs system
e.g. when I executed this command
%HADOOP_PREFIX%\bin\yarn jar %HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-example
s-2.5.0.jar wordcount /myfile.txt /out
where can I view this /out directory etc in windows.
I have pushed myfile.txt using
C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
RE: New to hadoop. Need help
Posted by Caesar Samsi <cm...@hotmail.com>.
Hi Farhan,
The file and directories are in Hadoop. To get it to Windows, you’d have to issue “hdfs dfs get hadoopfilename.txt windowsfilename.txt
Hope this helps!
Best, Caesar.
From: Farhan Iqbal [mailto:farhan.iqbal@gmail.com]
Sent: Friday, October 30, 2015 12:27 PM
To: user@hadoop.apache.org
Subject: New to hadoop. Need help
Hi guys
I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
https://wiki.apache.org/hadoop/Hadoop2OnWindows
Now my question is
How can I browse file in windows which are in hdfs system
e.g. when I executed this command
%HADOOP_PREFIX%\bin\yarn jar %HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-example
s-2.5.0.jar wordcount /myfile.txt /out
where can I view this /out directory etc in windows.
I have pushed myfile.txt using
C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
Re: New to hadoop. Need help
Posted by Namikaze Minato <ll...@gmail.com>.
%HADOOP_PREFIX%\bin\hdfs dfs -ls /
%HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
?
Regards,
LLoyd
Re: New to hadoop. Need help
Posted by Namikaze Minato <ll...@gmail.com>.
%HADOOP_PREFIX%\bin\hdfs dfs -ls /
%HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
?
Regards,
LLoyd
RE: New to hadoop. Need help
Posted by Caesar Samsi <cm...@hotmail.com>.
Hi Farhan,
The file and directories are in Hadoop. To get it to Windows, you’d have to issue “hdfs dfs get hadoopfilename.txt windowsfilename.txt
Hope this helps!
Best, Caesar.
From: Farhan Iqbal [mailto:farhan.iqbal@gmail.com]
Sent: Friday, October 30, 2015 12:27 PM
To: user@hadoop.apache.org
Subject: New to hadoop. Need help
Hi guys
I am new to Hadoop. I just installed Hadoop 2.7.1 in windows 7 using
https://wiki.apache.org/hadoop/Hadoop2OnWindows
Now my question is
How can I browse file in windows which are in hdfs system
e.g. when I executed this command
%HADOOP_PREFIX%\bin\yarn jar %HADOOP_PREFIX%\share\hadoop\mapreduce\hadoop-mapreduce-example
s-2.5.0.jar wordcount /myfile.txt /out
where can I view this /out directory etc in windows.
I have pushed myfile.txt using
C:\deploy>%HADOOP_PREFIX%\bin\hdfs dfs -put myfile.txt /
Re: New to hadoop. Need help
Posted by Namikaze Minato <ll...@gmail.com>.
%HADOOP_PREFIX%\bin\hdfs dfs -ls /
%HADOOP_PREFIX%\bin\hdfs dfs -cat /myfile.txt
?
Regards,
LLoyd