You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Simon Willnauer <si...@googlemail.com> on 2009/08/24 18:46:15 UTC
Re: IP address or host name
You can either try to set the "master.com" name in your /etc/hosts
file or if that does not work for some reason you can try to set the
name in your configured DNS server.
You should make sure that you hostname is not mapped to 127.0.0.1
otherwise hadoop will bind its sockets to loopback. That would explain
why your local datanode can connect but others can't.
Make sure you format you dfs again otherwise you will get the same FS
exception again.
simon
On Mon, Aug 24, 2009 at 6:25 PM, Nelson, William<wn...@email.uky.edu> wrote:
> I'm new to hadoop.
> I'm running 0.19.2 on a Centos 5.2 cluster.
> I have been having problems with the nodes connecting to the master (even when the firewall is off) using the hostname in the hadoop-site.xml but it will connect using the IP address.
> This is also true trying to connect to port 9000 with telnet. If I start hadoop with hostnames in the hadoop-site.xml, I get Connection refused. When I use IP addresses in the hadoop-site.xml I can connect with telnet using either the IP address or hostname.
> The datanode running on the master node can connect with either IP address or hostname in the hadoop-site.xml.
> I have found this problem posted a couple of time but have not found the answer yet.
>
>
> Datanodes on slaves can't connect but the datanode on master can connect.
> <property>
> <name>fs.default.name</name>
> <value>hdfs://master.com:9000</value>
> </property>
>
> Everybody can connect.
> <property>
> <name>fs.default.name</name>
> <value>hdfs://192.68.42.221:9000</value>
> </property>
>
> Unfortunately using IP addresses creates another problem when I try to run the job: Wrong FS exception
>
>
> Previous posts refer to https://issues.apache.org/jira/browse/HADOOP-5191 but it appears the work around is to switch back to host names, which I can't get to work.
>
>
>
> Thanks in advance for any help.
>
>
>
> Bill
>
>
>
>
>
Re: IP address or host name
Posted by Simon Willnauer <si...@googlemail.com>.
happy to help :)
simon
On Mon, Aug 24, 2009 at 7:21 PM, Nelson, William<wn...@email.uky.edu> wrote:
> Thanks for the quick reply. The host name on the master was bound to the loopback connecter.
> All is well.
> Bill
>
> -----Original Message-----
> From: Simon Willnauer [mailto:simon.willnauer@googlemail.com]
> Sent: Monday, August 24, 2009 12:46 PM
> To: common-user@hadoop.apache.org
> Subject: Re: IP address or host name
>
> You can either try to set the "master.com" name in your /etc/hosts
> file or if that does not work for some reason you can try to set the
> name in your configured DNS server.
> You should make sure that you hostname is not mapped to 127.0.0.1
> otherwise hadoop will bind its sockets to loopback. That would explain
> why your local datanode can connect but others can't.
> Make sure you format you dfs again otherwise you will get the same FS
> exception again.
>
> simon
>
> On Mon, Aug 24, 2009 at 6:25 PM, Nelson, William<wn...@email.uky.edu> wrote:
>> I'm new to hadoop.
>> I'm running 0.19.2 on a Centos 5.2 cluster.
>> I have been having problems with the nodes connecting to the master (even when the firewall is off) using the hostname in the hadoop-site.xml but it will connect using the IP address.
>> This is also true trying to connect to port 9000 with telnet. If I start hadoop with hostnames in the hadoop-site.xml, I get Connection refused. When I use IP addresses in the hadoop-site.xml I can connect with telnet using either the IP address or hostname.
>> The datanode running on the master node can connect with either IP address or hostname in the hadoop-site.xml.
>> I have found this problem posted a couple of time but have not found the answer yet.
>>
>>
>> Datanodes on slaves can't connect but the datanode on master can connect.
>> <property>
>> <name>fs.default.name</name>
>> <value>hdfs://master.com:9000</value>
>> </property>
>>
>> Everybody can connect.
>> <property>
>> <name>fs.default.name</name>
>> <value>hdfs://192.68.42.221:9000</value>
>> </property>
>>
>> Unfortunately using IP addresses creates another problem when I try to run the job: Wrong FS exception
>>
>>
>> Previous posts refer to https://issues.apache.org/jira/browse/HADOOP-5191 but it appears the work around is to switch back to host names, which I can't get to work.
>>
>>
>>
>> Thanks in advance for any help.
>>
>>
>>
>> Bill
>>
>>
>>
>>
>>
>
RE: IP address or host name
Posted by "Nelson, William" <wn...@email.uky.edu>.
Thanks for the quick reply. The host name on the master was bound to the loopback connecter.
All is well.
Bill
-----Original Message-----
From: Simon Willnauer [mailto:simon.willnauer@googlemail.com]
Sent: Monday, August 24, 2009 12:46 PM
To: common-user@hadoop.apache.org
Subject: Re: IP address or host name
You can either try to set the "master.com" name in your /etc/hosts
file or if that does not work for some reason you can try to set the
name in your configured DNS server.
You should make sure that you hostname is not mapped to 127.0.0.1
otherwise hadoop will bind its sockets to loopback. That would explain
why your local datanode can connect but others can't.
Make sure you format you dfs again otherwise you will get the same FS
exception again.
simon
On Mon, Aug 24, 2009 at 6:25 PM, Nelson, William<wn...@email.uky.edu> wrote:
> I'm new to hadoop.
> I'm running 0.19.2 on a Centos 5.2 cluster.
> I have been having problems with the nodes connecting to the master (even when the firewall is off) using the hostname in the hadoop-site.xml but it will connect using the IP address.
> This is also true trying to connect to port 9000 with telnet. If I start hadoop with hostnames in the hadoop-site.xml, I get Connection refused. When I use IP addresses in the hadoop-site.xml I can connect with telnet using either the IP address or hostname.
> The datanode running on the master node can connect with either IP address or hostname in the hadoop-site.xml.
> I have found this problem posted a couple of time but have not found the answer yet.
>
>
> Datanodes on slaves can't connect but the datanode on master can connect.
> <property>
> <name>fs.default.name</name>
> <value>hdfs://master.com:9000</value>
> </property>
>
> Everybody can connect.
> <property>
> <name>fs.default.name</name>
> <value>hdfs://192.68.42.221:9000</value>
> </property>
>
> Unfortunately using IP addresses creates another problem when I try to run the job: Wrong FS exception
>
>
> Previous posts refer to https://issues.apache.org/jira/browse/HADOOP-5191 but it appears the work around is to switch back to host names, which I can't get to work.
>
>
>
> Thanks in advance for any help.
>
>
>
> Bill
>
>
>
>
>