hadoop fail over

[Thiago Veiga <th...@gmail.com>]

Hi ,

i would like to create a hadoop fail over system , mainly for the
master node in my hadoop cluster.
I can t use the linux HA so i have been trying another approach
I thought zookeeper wold be a good option , but i am not sure about that
Does someone have a suggestion ?

thanks

thiago

Re: hadoop fail over

[Gerrit Jansen van Vuuren <ge...@gmail.com>]

HI,

Zookeeper + Book Keeper seems to be a good candidate for this.
I've recently changed http://code.google.com/p/bigstreams from using
hazelcast to using zookeeper, it uses zookeeper to keep track of realtime
file transfers, and have found zookeeper to work great, failover is decent
and predictable also.

Cheers,


On Tue, Jul 19, 2011 at 9:22 PM, Thiago Veiga <th...@gmail.com> wrote:

> Hi ,
>
> i would like to create a hadoop fail over system , mainly for the
> master node in my hadoop cluster.
> I can t use the linux HA so i have been trying another approach
> I thought zookeeper wold be a good option , but i am not sure about that
> Does someone have a suggestion ?
>
> thanks
>
> thiago
>

Re: hadoop fail over

[jagaran das <ja...@yahoo.co.in>]

Try Avatar Node

- JD


________________________________
From: Thiago Veiga <th...@gmail.com>
To: user@pig.apache.org
Sent: Tuesday, 19 July 2011 12:22 PM
Subject: hadoop fail over

Hi ,

i would like to create a hadoop fail over system , mainly for the
master node in my hadoop cluster.
I can t use the linux HA so i have been trying another approach
I thought zookeeper wold be a good option , but i am not sure about that
Does someone have a suggestion ?

thanks

thiago