yarn vs zookeeper

[Vikas Parashar <vi...@fosteringlinux.com>]

Hi,

I am new for Big Data. Have configure a setup, where i am crawling some
data from different source and putting it on HDFS.

Now, for search i have configured solr on an instance and it's working
perfectly fine. Both things(Data & Index), we are putting on hdfs. So, i
have data and index on different (fully distributed)nodes.  But my pain
point is here that i don't have solr high-availability. When i am
searching, i am not sure it's distributed or not.

May zookeeper help on this, or yarn automatically take care of this.

-- 
Thanks & Regards:-
Vikas Parashar
Sr. Linux administrator Cum Developer
Mobile: +91 958 208 8852
Email: vikas.parashar@fosteringlinglinux.com

Re: yarn vs zookeeper

[omkar joshi <om...@gmail.com>]

yarn (if HA is enabled) will use zookeeper for HA. But this is only for
YARN framework and it does nothing for application's HA. Application's
should have their own logic for this. Zookeeper may be useful for this.


On Mon, Dec 2, 2013 at 11:28 PM, Vikas Parashar <
vikas.parashar@fosteringlinux.com> wrote:

> Hi,
>
> I am new for Big Data. Have configure a setup, where i am crawling some
> data from different source and putting it on HDFS.
>
> Now, for search i have configured solr on an instance and it's working
> perfectly fine. Both things(Data & Index), we are putting on hdfs. So, i
> have data and index on different (fully distributed)nodes.  But my pain
> point is here that i don't have solr high-availability. When i am
> searching, i am not sure it's distributed or not.
>
> May zookeeper help on this, or yarn automatically take care of this.
>
> --
> Thanks & Regards:-
> Vikas Parashar
> Sr. Linux administrator Cum Developer
> Mobile: +91 958 208 8852
> Email: vikas.parashar@fosteringlinglinux.com
>