You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by John Wang <jo...@gmail.com> on 2006/11/24 03:11:33 UTC

configuration question

Hi:

   After startind HDFS, I am able to create directories via the Hadoop api
and the shell app.

   However I am not able to create a new file: I keep on getting problems
connecting to the data node. (on locahost:50010)

   By going to the admin UI, I see Live Datanodes listed to be correct to be
listed: localhost:50010.

   And in the data node log, I see the line:
2006-11-24 10:05:07,261 INFO org.apache.hadoop.dfs.DataNode: Opened server
at 50
010

   So looks like the data node is alive.

    Also, by clocking on the Browse the filesystem link in the admin ui, I
am taken to the address:

http://192.168.1.3:65535/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F

    Which is not resolved.

    Any suggestions would be greatly appreciated.

Thanks

-John

Re: configuration question

Posted by howard chen <ho...@gmail.com>.
On 11/24/06, John Wang <jo...@gmail.com> wrote:
> Hi:
>
>    After startind HDFS, I am able to create directories via the Hadoop api
> and the shell app.
>
>    However I am not able to create a new file: I keep on getting problems
> connecting to the data node. (on locahost:50010)
>
>    By going to the admin UI, I see Live Datanodes listed to be correct to be
> listed: localhost:50010.
>
>    And in the data node log, I see the line:
> 2006-11-24 10:05:07,261 INFO org.apache.hadoop.dfs.DataNode: Opened server
> at 50
> 010
>
>    So looks like the data node is alive.
>
>     Also, by clocking on the Browse the filesystem link in the admin ui, I
> am taken to the address:
>
> http://192.168.1.3:65535/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F
>
>     Which is not resolved.
>
>     Any suggestions would be greatly appreciated.
>
> Thanks
>
> -John
>
>

can you show the commands used?

howa

Re: configuration question

Posted by John Wang <jo...@gmail.com>.
I started HDFS by running start-dfs.sh (also tried start-all.sh, but makes
no difference).

I was able to create directories by running: haddop dfs -mkdir <dir>
and using the hadoop java api, e.g. getting a FileSystem instance and do:
fs.mkdirs().

While trying to do FileSystem.createNewFile, I get: "Waiting to find target
node:" messages. By stepping into the source code, I see the client could
not connect to the data node.

Thanks for your help.

-John

On 11/24/06, John Wang <jo...@gmail.com> wrote:
>
> Hi:
>
>    After startind HDFS, I am able to create directories via the Hadoop api
> and the shell app.
>
>    However I am not able to create a new file: I keep on getting problems
> connecting to the data node. (on locahost:50010)
>
>    By going to the admin UI, I see Live Datanodes listed to be correct to
> be listed: localhost:50010.
>
>    And in the data node log, I see the line:
> 2006-11-24 10:05:07,261 INFO org.apache.hadoop.dfs.DataNode : Opened
> server at 50
> 010
>
>    So looks like the data node is alive.
>
>     Also, by clocking on the Browse the filesystem link in the admin ui, I
> am taken to the address:
>
>
> http://192.168.1.3:65535/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F
>
>     Which is not resolved.
>
>     Any suggestions would be greatly appreciated.
>
> Thanks
>
> -John
>
>

Re: configuration question

Posted by John Wang <jo...@gmail.com>.
In the namenode log, it does show it has lost heartbeat to the datanode. But
data node log looks fine, no errors there.

Any ideas?

thanks

-John


On 11/28/06, Raghu Angadi <ra...@yahoo-inc.com> wrote:
>
> John Wang wrote:
> >   And in the data node log, I see the line:
> > 2006-11-24 10:05:07,261 INFO org.apache.hadoop.dfs.DataNode: Opened
> server
> > at 50
> > 010
> >
> >   So looks like the data node is alive.
> >
> >    Also, by clocking on the Browse the filesystem link in the admin ui,
> I
> > am taken to the address:
> >
> >
> http://192.168.1.3:65535/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F
>
> This is fixed in the latest trunk. For now try replacing the port 65535
> with 50075.
>
> regd the original problem, look for any error messages in namenode log
> also.
>
> Raghu.
>

Re: configuration question

Posted by Raghu Angadi <ra...@yahoo-inc.com>.
John Wang wrote:
>   And in the data node log, I see the line:
> 2006-11-24 10:05:07,261 INFO org.apache.hadoop.dfs.DataNode: Opened server
> at 50
> 010
> 
>   So looks like the data node is alive.
> 
>    Also, by clocking on the Browse the filesystem link in the admin ui, I
> am taken to the address:
> 
> http://192.168.1.3:65535/browseDirectory.jsp?namenodeInfoPort=50070&dir=%2F

This is fixed in the latest trunk. For now try replacing the port 65535 
with 50075.

regd the original problem, look for any error messages in namenode log also.

Raghu.