You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by jimtronic <ji...@gmail.com> on 2013/03/19 20:01:38 UTC
Zookeeper specs
I understand this may be a better question for the zookeeper list, but I'm
asking here because I'm not completely clear how much load zookeeper takes
on in a solr cloud setup.
I'm trying to determine what specs my zookeeper boxes should be. I'm on EC2,
so what I'm curious about is whether zookeeper should have high I/O, high
memory, or high CPU.
I've been running my zookeeper on micro instances with no problem, but want
to understand what the potential bottlenecks might be.
Thanks for any input!
Jim
--
View this message in context: http://lucene.472066.n3.nabble.com/Zookeeper-specs-tp4049058.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Zookeeper specs
Posted by Michael Della Bitta <mi...@appinions.com>.
We're running 3 c1.mediums, but mostly because we had spare
reservations for them. They barely break a sweat with our small
clusters (7 nodes total at the moment).
Michael Della Bitta
------------------------------------------------
Appinions
18 East 41st Street, 2nd Floor
New York, NY 10017-6271
www.appinions.com
Where Influence Isn’t a Game
On Tue, Mar 19, 2013 at 3:54 PM, jimtronic <ji...@gmail.com> wrote:
> I like the sound of spinning up a few hundred nodes! Thanks, Mark!
>
> On Tue, Mar 19, 2013 at 2:08 PM, Mark Miller-3 [via Lucene] <
> ml-node+s472066n4049060h76@n3.nabble.com> wrote:
>
>> In a steady state, a SolrCloud cluster puts no load on ZooKeeper other
>> than maintaining heart beats for the most part.
>>
>> The heaviest load might be when you start up a few hundred nodes and they
>> all keep loading and receiving state rapidly at the same time. ZooKeeper
>> handles that pretty easily though.
>>
>> In my experience, SolrCloud is a walk in the park for ZK, so you probably
>> don't need to go crazy.
>>
>> - Mark
>>
>> On Mar 19, 2013, at 3:01 PM, jimtronic <[hidden email]<http://user/SendEmail.jtp?type=node&node=4049060&i=0>>
>> wrote:
>>
>> > I understand this may be a better question for the zookeeper list, but
>> I'm
>> > asking here because I'm not completely clear how much load zookeeper
>> takes
>> > on in a solr cloud setup.
>> >
>> > I'm trying to determine what specs my zookeeper boxes should be. I'm on
>> EC2,
>> > so what I'm curious about is whether zookeeper should have high I/O,
>> high
>> > memory, or high CPU.
>> >
>> > I've been running my zookeeper on micro instances with no problem, but
>> want
>> > to understand what the potential bottlenecks might be.
>> >
>> > Thanks for any input!
>> >
>> > Jim
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> http://lucene.472066.n3.nabble.com/Zookeeper-specs-tp4049058.html
>> > Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>>
>> ------------------------------
>> If you reply to this email, your message will be added to the discussion
>> below:
>> http://lucene.472066.n3.nabble.com/Zookeeper-specs-tp4049058p4049060.html
>> To unsubscribe from Zookeeper specs, click here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4049058&code=amltdHJvbmljQGdtYWlsLmNvbXw0MDQ5MDU4fDEzMjQ4NDk0MTQ=>
>> .
>> NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Zookeeper-specs-tp4049058p4049072.html
> Sent from the Solr - User mailing list archive at Nabble.com.
Re: Zookeeper specs
Posted by jimtronic <ji...@gmail.com>.
I like the sound of spinning up a few hundred nodes! Thanks, Mark!
On Tue, Mar 19, 2013 at 2:08 PM, Mark Miller-3 [via Lucene] <
ml-node+s472066n4049060h76@n3.nabble.com> wrote:
> In a steady state, a SolrCloud cluster puts no load on ZooKeeper other
> than maintaining heart beats for the most part.
>
> The heaviest load might be when you start up a few hundred nodes and they
> all keep loading and receiving state rapidly at the same time. ZooKeeper
> handles that pretty easily though.
>
> In my experience, SolrCloud is a walk in the park for ZK, so you probably
> don't need to go crazy.
>
> - Mark
>
> On Mar 19, 2013, at 3:01 PM, jimtronic <[hidden email]<http://user/SendEmail.jtp?type=node&node=4049060&i=0>>
> wrote:
>
> > I understand this may be a better question for the zookeeper list, but
> I'm
> > asking here because I'm not completely clear how much load zookeeper
> takes
> > on in a solr cloud setup.
> >
> > I'm trying to determine what specs my zookeeper boxes should be. I'm on
> EC2,
> > so what I'm curious about is whether zookeeper should have high I/O,
> high
> > memory, or high CPU.
> >
> > I've been running my zookeeper on micro instances with no problem, but
> want
> > to understand what the potential bottlenecks might be.
> >
> > Thanks for any input!
> >
> > Jim
> >
> >
> >
> > --
> > View this message in context:
> http://lucene.472066.n3.nabble.com/Zookeeper-specs-tp4049058.html
> > Sent from the Solr - User mailing list archive at Nabble.com.
>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://lucene.472066.n3.nabble.com/Zookeeper-specs-tp4049058p4049060.html
> To unsubscribe from Zookeeper specs, click here<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4049058&code=amltdHJvbmljQGdtYWlsLmNvbXw0MDQ5MDU4fDEzMjQ4NDk0MTQ=>
> .
> NAML<http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
View this message in context: http://lucene.472066.n3.nabble.com/Zookeeper-specs-tp4049058p4049072.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Zookeeper specs
Posted by Mark Miller <ma...@gmail.com>.
In a steady state, a SolrCloud cluster puts no load on ZooKeeper other than maintaining heart beats for the most part.
The heaviest load might be when you start up a few hundred nodes and they all keep loading and receiving state rapidly at the same time. ZooKeeper handles that pretty easily though.
In my experience, SolrCloud is a walk in the park for ZK, so you probably don't need to go crazy.
- Mark
On Mar 19, 2013, at 3:01 PM, jimtronic <ji...@gmail.com> wrote:
> I understand this may be a better question for the zookeeper list, but I'm
> asking here because I'm not completely clear how much load zookeeper takes
> on in a solr cloud setup.
>
> I'm trying to determine what specs my zookeeper boxes should be. I'm on EC2,
> so what I'm curious about is whether zookeeper should have high I/O, high
> memory, or high CPU.
>
> I've been running my zookeeper on micro instances with no problem, but want
> to understand what the potential bottlenecks might be.
>
> Thanks for any input!
>
> Jim
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/Zookeeper-specs-tp4049058.html
> Sent from the Solr - User mailing list archive at Nabble.com.