NFS mounted home, host RSA keys, localhost, strict sshds and bad mojo.

[Colin Freas <co...@gmail.com>]

i'm working to set up a cluster across several machines where users' home
dirs are on an nfs mount.

i setup key authentication for the hadoop user, install all the software on
one node, get everything running, and move on to another node.

once there, however, my sshd complains because the host key associated with
"localhost" is a different machine, and it refuses the connection.

i'm just testing here, so I can remove the localhost entry from
.ssh/known_hosts, but, is this going to be an issue going forward if the
home dirs are shared like this?

can i get hadoop to use the ip or the hostname instead of localhost?  i
scanned the config files, but it didn't jump out at me.


-colin

Re: NFS mounted home, host RSA keys, localhost, strict sshds and bad mojo.

[Colin Freas <co...@gmail.com>]

ah, yes.  that worked.  thanks!

On Fri, Mar 21, 2008 at 12:48 PM, Natarajan, Senthil <se...@pitt.edu>
wrote:

> I guess the following file might have localhost entry, change to hostname
>
> <HADOOP_INSTALL>/conf/masters
> <HADOOP_INSTALL>/conf/slaves
>
>
> -----Original Message-----
> From: Colin Freas [mailto:colinfreas@gmail.com]
> Sent: Friday, March 21, 2008 12:25 PM
> To: core-user@hadoop.apache.org
> Subject: NFS mounted home, host RSA keys, localhost, strict sshds and bad
> mojo.
>
> i'm working to set up a cluster across several machines where users' home
> dirs are on an nfs mount.
>
> i setup key authentication for the hadoop user, install all the software
> on
> one node, get everything running, and move on to another node.
>
> once there, however, my sshd complains because the host key associated
> with
> "localhost" is a different machine, and it refuses the connection.
>
> i'm just testing here, so I can remove the localhost entry from
> .ssh/known_hosts, but, is this going to be an issue going forward if the
> home dirs are shared like this?
>
> can i get hadoop to use the ip or the hostname instead of localhost?  i
> scanned the config files, but it didn't jump out at me.
>
>
> -colin
>

RE: NFS mounted home, host RSA keys, localhost, strict sshds and bad mojo.

["Natarajan, Senthil" <se...@pitt.edu>]

I guess the following file might have localhost entry, change to hostname

<HADOOP_INSTALL>/conf/masters
<HADOOP_INSTALL>/conf/slaves


-----Original Message-----
From: Colin Freas [mailto:colinfreas@gmail.com]
Sent: Friday, March 21, 2008 12:25 PM
To: core-user@hadoop.apache.org
Subject: NFS mounted home, host RSA keys, localhost, strict sshds and bad mojo.

i'm working to set up a cluster across several machines where users' home
dirs are on an nfs mount.

i setup key authentication for the hadoop user, install all the software on
one node, get everything running, and move on to another node.

once there, however, my sshd complains because the host key associated with
"localhost" is a different machine, and it refuses the connection.

i'm just testing here, so I can remove the localhost entry from
.ssh/known_hosts, but, is this going to be an issue going forward if the
home dirs are shared like this?

can i get hadoop to use the ip or the hostname instead of localhost?  i
scanned the config files, but it didn't jump out at me.


-colin

RE: NFS mounted home, host RSA keys, localhost, strict sshds andbad mojo.

[Peeyush Bishnoi <pe...@yahoo-inc.com>]

Hi ,

Yeah!!! you can tell hadoop to use the IP or hostname instead of localhost by specifying in hadoop configuration file i.e hadoop-site.xml . The parameters for hadoop-site.xml you can copy from hadoop-default.xml .

For NameNode:

<name>fs.default.name</name>
  <value><IP/Hostname>:54310</value>

For JobTracker:

 <name>mapred.job.tracker</name>
  <value><IP/Hostname>:54311</value>


For ssh related problem follow some nice online tutorial for enabling the passwordless connection across machines using same key. If you still not able to solve the problem . Let me know .

Thanks ,

---
Peeyush



-----Original Message-----
From: Andreas Kostyrka [mailto:andreas@kostyrka.org]
Sent: Sat 3/22/2008 2:01 AM
To: core-user@hadoop.apache.org
Subject: Re: NFS mounted home, host RSA keys, localhost, strict sshds andbad mojo.
 
Add a .ssh/config file and make it stop doing the hostkey check for
localhost.

Andreas


Am Freitag, den 21.03.2008, 12:25 -0400 schrieb Colin Freas:
> i'm working to set up a cluster across several machines where users' home
> dirs are on an nfs mount.
> 
> i setup key authentication for the hadoop user, install all the software on
> one node, get everything running, and move on to another node.
> 
> once there, however, my sshd complains because the host key associated with
> "localhost" is a different machine, and it refuses the connection.
> 
> i'm just testing here, so I can remove the localhost entry from
> .ssh/known_hosts, but, is this going to be an issue going forward if the
> home dirs are shared like this?
> 
> can i get hadoop to use the ip or the hostname instead of localhost?  i
> scanned the config files, but it didn't jump out at me.
> 
> 
> -colin

Re: NFS mounted home, host RSA keys, localhost, strict sshds and bad mojo.

[Andreas Kostyrka <an...@kostyrka.org>]

Add a .ssh/config file and make it stop doing the hostkey check for
localhost.

Andreas


Am Freitag, den 21.03.2008, 12:25 -0400 schrieb Colin Freas:
> i'm working to set up a cluster across several machines where users' home
> dirs are on an nfs mount.
> 
> i setup key authentication for the hadoop user, install all the software on
> one node, get everything running, and move on to another node.
> 
> once there, however, my sshd complains because the host key associated with
> "localhost" is a different machine, and it refuses the connection.
> 
> i'm just testing here, so I can remove the localhost entry from
> .ssh/known_hosts, but, is this going to be an issue going forward if the
> home dirs are shared like this?
> 
> can i get hadoop to use the ip or the hostname instead of localhost?  i
> scanned the config files, but it didn't jump out at me.
> 
> 
> -colin