You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by John Kane <jo...@kane.net> on 2009/05/09 20:51:33 UTC
Re-Addressing a cluster
I have a situation that I have not been able to find in the mail archives.
I have an active cluster that was built on a private switch with private IP
address space (192.168.*.*)
I need to relocate the cluster into "real" address space.
Assuming that I have working DNS, is there an issue? Do I just need to be
sure that I utilize hostnames for everything and then be fat, dumb and
happy? Or are IP Addresses tracked by the namenode, etc?
Thanks
Re: Re-Addressing a cluster
Posted by Steve Loughran <st...@apache.org>.
jason hadoop wrote:
> Now that I think about it, the reverse lookups in my clusters work.
and you have made sure that IPv6 is turned off, right?
Re: Re-Addressing a cluster
Posted by jason hadoop <ja...@gmail.com>.
Now that I think about it, the reverse lookups in my clusters work.
On Mon, May 11, 2009 at 3:07 AM, Steve Loughran <st...@apache.org> wrote:
> jason hadoop wrote:
>
>> You should be able to relocate the cluster's IP space by stopping the
>> cluster, modifying the configuration files, resetting the dns and starting
>> the cluster.
>> Be best to verify connectivity with the new IP addresses before starting
>> the
>> cluster.
>>
>> to the best of my knowledge the namenode doesn't care about the ip
>> addresses
>> of the datanodes, only what blocks they report as having. The namenode
>> does
>> care about loosing contact with a connected datanode, replicating the
>> blocks that are now under replicated.
>>
>> I prefer IP addresses in my configuration files but that is a personal
>> preference not a requirement.
>>
>
>
> I do deployments on to Virtual clusters without fully functional reverse
> DNS, things do work badly in that situation. Hadoop assumes that if a
> machine looks up its hostname, it can pass that to peers and they can
> resolve it, the "well managed network infrastructure" assumption.
>
--
Alpha Chapters of my book on Hadoop are available
http://www.apress.com/book/view/9781430219422
www.prohadoopbook.com a community for Hadoop Professionals
Re: Re-Addressing a cluster
Posted by Steve Loughran <st...@apache.org>.
jason hadoop wrote:
> You should be able to relocate the cluster's IP space by stopping the
> cluster, modifying the configuration files, resetting the dns and starting
> the cluster.
> Be best to verify connectivity with the new IP addresses before starting the
> cluster.
>
> to the best of my knowledge the namenode doesn't care about the ip addresses
> of the datanodes, only what blocks they report as having. The namenode does
> care about loosing contact with a connected datanode, replicating the
> blocks that are now under replicated.
>
> I prefer IP addresses in my configuration files but that is a personal
> preference not a requirement.
I do deployments on to Virtual clusters without fully functional reverse
DNS, things do work badly in that situation. Hadoop assumes that if a
machine looks up its hostname, it can pass that to peers and they can
resolve it, the "well managed network infrastructure" assumption.
Re: Re-Addressing a cluster
Posted by jason hadoop <ja...@gmail.com>.
You should be able to relocate the cluster's IP space by stopping the
cluster, modifying the configuration files, resetting the dns and starting
the cluster.
Be best to verify connectivity with the new IP addresses before starting the
cluster.
to the best of my knowledge the namenode doesn't care about the ip addresses
of the datanodes, only what blocks they report as having. The namenode does
care about loosing contact with a connected datanode, replicating the
blocks that are now under replicated.
I prefer IP addresses in my configuration files but that is a personal
preference not a requirement.
On Sat, May 9, 2009 at 11:51 AM, John Kane <jo...@kane.net> wrote:
> I have a situation that I have not been able to find in the mail archives.
>
> I have an active cluster that was built on a private switch with private IP
> address space (192.168.*.*)
>
> I need to relocate the cluster into "real" address space.
>
> Assuming that I have working DNS, is there an issue? Do I just need to be
> sure that I utilize hostnames for everything and then be fat, dumb and
> happy? Or are IP Addresses tracked by the namenode, etc?
>
> Thanks
>
--
Alpha Chapters of my book on Hadoop are available
http://www.apress.com/book/view/9781430219422
www.prohadoopbook.com a community for Hadoop Professionals