You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by John Clarke <cl...@gmail.com> on 2009/09/02 17:59:56 UTC

Script for cluster setup

Hi,

Can someone point me to a script that I can use to setup different sizes of
Hadoop cluster?

The main issues I see are
1) ssh setup so the master can ssh to each of the slaves
2) updating the conf/slaves file on the master to contain the IP for each
slave.
3) updating each slaves hadoop-site.xml to reference the namenode's IP
address

How do people normally set up clusters greater than a few machines?

thanks,
John