You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by "ZAROGKIKAS,GIORGOS" <g....@multirama.gr> on 2010/01/22 15:35:03 UTC
solr with tomcat in cluster mode
Hi
I'm using solr 1.4 with tomcat in a single pc
and I want to turn it in cluster mode with 2 nodes and load
balancing
But I can't find info how to do
Is there any manual or a recorded procedure on the internet to
do that
Or is there anyone to help me ?
Thanks in advance
Ps : I use windows server 2008 for OS
Re: solr with tomcat in cluster mode
Posted by Lance Norskog <go...@gmail.com>.
Ah, ok. There may be a load-balancer program for Windows. Also, the
SolrJ client library includes a feature to load-balance its requests.
If you write your app using this library, you're set.
On Thu, Jan 28, 2010 at 2:17 AM, ZAROGKIKAS,GIORGOS
<g....@multirama.gr> wrote:
> Windows ????
> I mention below that I user windows server 2008
>
> -----Original Message-----
> From: Lance Norskog [mailto:goksron@gmail.com]
> Sent: Thursday, January 28, 2010 3:46 AM
> To: solr-user@lucene.apache.org
> Subject: Re: solr with tomcat in cluster mode
>
> Linux includes a load-balancer program 'balance'. You set it up at a
> third port and configure it to use 'localhost:8180' and
> 'localhost:8280'.
>
> On Wed, Jan 27, 2010 at 4:06 AM, ZAROGKIKAS,GIORGOS
> <g....@multirama.gr> wrote:
>> Hi again
>> I finally setup my solr Cluster with tomcat6
>> The configuration I user is two tomcat servers on the same server in different ports(ex localhost:8180/solr and
>> Localhost:8280/solr for testing purposes) with different indexes on each server and index replication through replication handler of solr , and its working fine for me and very quick
>>
>> Now I want to use load balance for these two tomcat servers but without using apache http server
>> Is there any solution for that ???
>>
>>
>>
>>
>>
>>
>> -----Original Message-----
>> From: Matt Mitchell [mailto:goodieboy@gmail.com]
>> Sent: Friday, January 22, 2010 9:33 PM
>> To: solr-user@lucene.apache.org
>> Subject: Re: solr with tomcat in cluster mode
>>
>> Hey Otis,
>>
>> We're indexing on a separate machine because we want to keep our production
>> nodes away from processes like indexing. The indexing server also has a ton
>> of resources available, more so than the production nodes. We set it up as
>> an indexing server at one point and have decided to stick with it.
>>
>> We're not indexing the same index as the search indexes because we want to
>> be able to step back a day or two if needed. So we do the SWAP when things
>> are done and OK.
>>
>> So that last part you mentioned about the searchers needing to re-open will
>> happen with a SWAP right? Is your concern that there will be a lag time,
>> making it so the slaves will be out of sync for some small period of time?
>>
>> Would it be simpler/better to move to using Solrs native slave/master
>> feature?
>>
>> I'd love to hear any suggestions you might have.
>>
>> Thanks,
>>
>> Matt
>>
>> On Fri, Jan 22, 2010 at 1:58 PM, Otis Gospodnetic <
>> otis_gospodnetic@yahoo.com> wrote:
>>
>>> This should work fine.
>>> But why are you indexing to a separate index/core? Why not index in the
>>> very same index you are searching?
>>> Slaves won't see changes until their searchers re-open.
>>>
>>> Otis
>>> --
>>> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>>>
>>>
>>>
>>> ----- Original Message ----
>>> > From: Matt Mitchell <go...@gmail.com>
>>> > To: solr-user@lucene.apache.org
>>> > Sent: Fri, January 22, 2010 9:44:03 AM
>>> > Subject: Re: solr with tomcat in cluster mode
>>> >
>>> > We have a similar setup and I'd be curious to see how folks are doing
>>> this
>>> > as well.
>>> >
>>> > Our setup: A few servers and an F5 load balancer. Each Solr instance
>>> points
>>> > to a shared index. We use a separate server for indexing. When the index
>>> is
>>> > complete, we do some juggling using the Core Admin SWAP function and
>>> update
>>> > the shared index. I've wondered about having a shared index across
>>> multiple
>>> > instances of (read-only) Solr -- any problems there?
>>> >
>>> > Matt
>>> >
>>> > On Fri, Jan 22, 2010 at 9:35 AM, ZAROGKIKAS,GIORGOS <
>>> > g.zarogkikas@multirama.gr> wrote:
>>> >
>>> > > Hi
>>> > > I'm using solr 1.4 with tomcat in a single pc
>>> > > and I want to turn it in cluster mode with 2 nodes and load
>>> > > balancing
>>> > > But I can't find info how to do
>>> > > Is there any manual or a recorded procedure on the internet to
>>> > > do that
>>> > > Or is there anyone to help me ?
>>> > >
>>> > > Thanks in advance
>>> > >
>>> > >
>>> > > Ps : I use windows server 2008 for OS
>>> > >
>>> > >
>>> > >
>>> > >
>>> > >
>>>
>>>
>>
>
>
>
> --
> Lance Norskog
> goksron@gmail.com
>
--
Lance Norskog
goksron@gmail.com
RE: solr with tomcat in cluster mode
Posted by "ZAROGKIKAS,GIORGOS" <g....@multirama.gr>.
Windows ????
I mention below that I user windows server 2008
-----Original Message-----
From: Lance Norskog [mailto:goksron@gmail.com]
Sent: Thursday, January 28, 2010 3:46 AM
To: solr-user@lucene.apache.org
Subject: Re: solr with tomcat in cluster mode
Linux includes a load-balancer program 'balance'. You set it up at a
third port and configure it to use 'localhost:8180' and
'localhost:8280'.
On Wed, Jan 27, 2010 at 4:06 AM, ZAROGKIKAS,GIORGOS
<g....@multirama.gr> wrote:
> Hi again
> I finally setup my solr Cluster with tomcat6
> The configuration I user is two tomcat servers on the same server in different ports(ex localhost:8180/solr and
> Localhost:8280/solr for testing purposes) with different indexes on each server and index replication through replication handler of solr , and its working fine for me and very quick
>
> Now I want to use load balance for these two tomcat servers but without using apache http server
> Is there any solution for that ???
>
>
>
>
>
>
> -----Original Message-----
> From: Matt Mitchell [mailto:goodieboy@gmail.com]
> Sent: Friday, January 22, 2010 9:33 PM
> To: solr-user@lucene.apache.org
> Subject: Re: solr with tomcat in cluster mode
>
> Hey Otis,
>
> We're indexing on a separate machine because we want to keep our production
> nodes away from processes like indexing. The indexing server also has a ton
> of resources available, more so than the production nodes. We set it up as
> an indexing server at one point and have decided to stick with it.
>
> We're not indexing the same index as the search indexes because we want to
> be able to step back a day or two if needed. So we do the SWAP when things
> are done and OK.
>
> So that last part you mentioned about the searchers needing to re-open will
> happen with a SWAP right? Is your concern that there will be a lag time,
> making it so the slaves will be out of sync for some small period of time?
>
> Would it be simpler/better to move to using Solrs native slave/master
> feature?
>
> I'd love to hear any suggestions you might have.
>
> Thanks,
>
> Matt
>
> On Fri, Jan 22, 2010 at 1:58 PM, Otis Gospodnetic <
> otis_gospodnetic@yahoo.com> wrote:
>
>> This should work fine.
>> But why are you indexing to a separate index/core? Why not index in the
>> very same index you are searching?
>> Slaves won't see changes until their searchers re-open.
>>
>> Otis
>> --
>> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>>
>>
>>
>> ----- Original Message ----
>> > From: Matt Mitchell <go...@gmail.com>
>> > To: solr-user@lucene.apache.org
>> > Sent: Fri, January 22, 2010 9:44:03 AM
>> > Subject: Re: solr with tomcat in cluster mode
>> >
>> > We have a similar setup and I'd be curious to see how folks are doing
>> this
>> > as well.
>> >
>> > Our setup: A few servers and an F5 load balancer. Each Solr instance
>> points
>> > to a shared index. We use a separate server for indexing. When the index
>> is
>> > complete, we do some juggling using the Core Admin SWAP function and
>> update
>> > the shared index. I've wondered about having a shared index across
>> multiple
>> > instances of (read-only) Solr -- any problems there?
>> >
>> > Matt
>> >
>> > On Fri, Jan 22, 2010 at 9:35 AM, ZAROGKIKAS,GIORGOS <
>> > g.zarogkikas@multirama.gr> wrote:
>> >
>> > > Hi
>> > > I'm using solr 1.4 with tomcat in a single pc
>> > > and I want to turn it in cluster mode with 2 nodes and load
>> > > balancing
>> > > But I can't find info how to do
>> > > Is there any manual or a recorded procedure on the internet to
>> > > do that
>> > > Or is there anyone to help me ?
>> > >
>> > > Thanks in advance
>> > >
>> > >
>> > > Ps : I use windows server 2008 for OS
>> > >
>> > >
>> > >
>> > >
>> > >
>>
>>
>
--
Lance Norskog
goksron@gmail.com
Re: solr with tomcat in cluster mode
Posted by Lance Norskog <go...@gmail.com>.
Linux includes a load-balancer program 'balance'. You set it up at a
third port and configure it to use 'localhost:8180' and
'localhost:8280'.
On Wed, Jan 27, 2010 at 4:06 AM, ZAROGKIKAS,GIORGOS
<g....@multirama.gr> wrote:
> Hi again
> I finally setup my solr Cluster with tomcat6
> The configuration I user is two tomcat servers on the same server in different ports(ex localhost:8180/solr and
> Localhost:8280/solr for testing purposes) with different indexes on each server and index replication through replication handler of solr , and its working fine for me and very quick
>
> Now I want to use load balance for these two tomcat servers but without using apache http server
> Is there any solution for that ???
>
>
>
>
>
>
> -----Original Message-----
> From: Matt Mitchell [mailto:goodieboy@gmail.com]
> Sent: Friday, January 22, 2010 9:33 PM
> To: solr-user@lucene.apache.org
> Subject: Re: solr with tomcat in cluster mode
>
> Hey Otis,
>
> We're indexing on a separate machine because we want to keep our production
> nodes away from processes like indexing. The indexing server also has a ton
> of resources available, more so than the production nodes. We set it up as
> an indexing server at one point and have decided to stick with it.
>
> We're not indexing the same index as the search indexes because we want to
> be able to step back a day or two if needed. So we do the SWAP when things
> are done and OK.
>
> So that last part you mentioned about the searchers needing to re-open will
> happen with a SWAP right? Is your concern that there will be a lag time,
> making it so the slaves will be out of sync for some small period of time?
>
> Would it be simpler/better to move to using Solrs native slave/master
> feature?
>
> I'd love to hear any suggestions you might have.
>
> Thanks,
>
> Matt
>
> On Fri, Jan 22, 2010 at 1:58 PM, Otis Gospodnetic <
> otis_gospodnetic@yahoo.com> wrote:
>
>> This should work fine.
>> But why are you indexing to a separate index/core? Why not index in the
>> very same index you are searching?
>> Slaves won't see changes until their searchers re-open.
>>
>> Otis
>> --
>> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>>
>>
>>
>> ----- Original Message ----
>> > From: Matt Mitchell <go...@gmail.com>
>> > To: solr-user@lucene.apache.org
>> > Sent: Fri, January 22, 2010 9:44:03 AM
>> > Subject: Re: solr with tomcat in cluster mode
>> >
>> > We have a similar setup and I'd be curious to see how folks are doing
>> this
>> > as well.
>> >
>> > Our setup: A few servers and an F5 load balancer. Each Solr instance
>> points
>> > to a shared index. We use a separate server for indexing. When the index
>> is
>> > complete, we do some juggling using the Core Admin SWAP function and
>> update
>> > the shared index. I've wondered about having a shared index across
>> multiple
>> > instances of (read-only) Solr -- any problems there?
>> >
>> > Matt
>> >
>> > On Fri, Jan 22, 2010 at 9:35 AM, ZAROGKIKAS,GIORGOS <
>> > g.zarogkikas@multirama.gr> wrote:
>> >
>> > > Hi
>> > > I'm using solr 1.4 with tomcat in a single pc
>> > > and I want to turn it in cluster mode with 2 nodes and load
>> > > balancing
>> > > But I can't find info how to do
>> > > Is there any manual or a recorded procedure on the internet to
>> > > do that
>> > > Or is there anyone to help me ?
>> > >
>> > > Thanks in advance
>> > >
>> > >
>> > > Ps : I use windows server 2008 for OS
>> > >
>> > >
>> > >
>> > >
>> > >
>>
>>
>
--
Lance Norskog
goksron@gmail.com
RE: solr with tomcat in cluster mode
Posted by "ZAROGKIKAS,GIORGOS" <g....@multirama.gr>.
Hi again
I finally setup my solr Cluster with tomcat6
The configuration I user is two tomcat servers on the same server in different ports(ex localhost:8180/solr and
Localhost:8280/solr for testing purposes) with different indexes on each server and index replication through replication handler of solr , and its working fine for me and very quick
Now I want to use load balance for these two tomcat servers but without using apache http server
Is there any solution for that ???
-----Original Message-----
From: Matt Mitchell [mailto:goodieboy@gmail.com]
Sent: Friday, January 22, 2010 9:33 PM
To: solr-user@lucene.apache.org
Subject: Re: solr with tomcat in cluster mode
Hey Otis,
We're indexing on a separate machine because we want to keep our production
nodes away from processes like indexing. The indexing server also has a ton
of resources available, more so than the production nodes. We set it up as
an indexing server at one point and have decided to stick with it.
We're not indexing the same index as the search indexes because we want to
be able to step back a day or two if needed. So we do the SWAP when things
are done and OK.
So that last part you mentioned about the searchers needing to re-open will
happen with a SWAP right? Is your concern that there will be a lag time,
making it so the slaves will be out of sync for some small period of time?
Would it be simpler/better to move to using Solrs native slave/master
feature?
I'd love to hear any suggestions you might have.
Thanks,
Matt
On Fri, Jan 22, 2010 at 1:58 PM, Otis Gospodnetic <
otis_gospodnetic@yahoo.com> wrote:
> This should work fine.
> But why are you indexing to a separate index/core? Why not index in the
> very same index you are searching?
> Slaves won't see changes until their searchers re-open.
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>
>
>
> ----- Original Message ----
> > From: Matt Mitchell <go...@gmail.com>
> > To: solr-user@lucene.apache.org
> > Sent: Fri, January 22, 2010 9:44:03 AM
> > Subject: Re: solr with tomcat in cluster mode
> >
> > We have a similar setup and I'd be curious to see how folks are doing
> this
> > as well.
> >
> > Our setup: A few servers and an F5 load balancer. Each Solr instance
> points
> > to a shared index. We use a separate server for indexing. When the index
> is
> > complete, we do some juggling using the Core Admin SWAP function and
> update
> > the shared index. I've wondered about having a shared index across
> multiple
> > instances of (read-only) Solr -- any problems there?
> >
> > Matt
> >
> > On Fri, Jan 22, 2010 at 9:35 AM, ZAROGKIKAS,GIORGOS <
> > g.zarogkikas@multirama.gr> wrote:
> >
> > > Hi
> > > I'm using solr 1.4 with tomcat in a single pc
> > > and I want to turn it in cluster mode with 2 nodes and load
> > > balancing
> > > But I can't find info how to do
> > > Is there any manual or a recorded procedure on the internet to
> > > do that
> > > Or is there anyone to help me ?
> > >
> > > Thanks in advance
> > >
> > >
> > > Ps : I use windows server 2008 for OS
> > >
> > >
> > >
> > >
> > >
>
>
Re: solr with tomcat in cluster mode
Posted by Matt Mitchell <go...@gmail.com>.
Hey Otis,
We're indexing on a separate machine because we want to keep our production
nodes away from processes like indexing. The indexing server also has a ton
of resources available, more so than the production nodes. We set it up as
an indexing server at one point and have decided to stick with it.
We're not indexing the same index as the search indexes because we want to
be able to step back a day or two if needed. So we do the SWAP when things
are done and OK.
So that last part you mentioned about the searchers needing to re-open will
happen with a SWAP right? Is your concern that there will be a lag time,
making it so the slaves will be out of sync for some small period of time?
Would it be simpler/better to move to using Solrs native slave/master
feature?
I'd love to hear any suggestions you might have.
Thanks,
Matt
On Fri, Jan 22, 2010 at 1:58 PM, Otis Gospodnetic <
otis_gospodnetic@yahoo.com> wrote:
> This should work fine.
> But why are you indexing to a separate index/core? Why not index in the
> very same index you are searching?
> Slaves won't see changes until their searchers re-open.
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
>
>
>
> ----- Original Message ----
> > From: Matt Mitchell <go...@gmail.com>
> > To: solr-user@lucene.apache.org
> > Sent: Fri, January 22, 2010 9:44:03 AM
> > Subject: Re: solr with tomcat in cluster mode
> >
> > We have a similar setup and I'd be curious to see how folks are doing
> this
> > as well.
> >
> > Our setup: A few servers and an F5 load balancer. Each Solr instance
> points
> > to a shared index. We use a separate server for indexing. When the index
> is
> > complete, we do some juggling using the Core Admin SWAP function and
> update
> > the shared index. I've wondered about having a shared index across
> multiple
> > instances of (read-only) Solr -- any problems there?
> >
> > Matt
> >
> > On Fri, Jan 22, 2010 at 9:35 AM, ZAROGKIKAS,GIORGOS <
> > g.zarogkikas@multirama.gr> wrote:
> >
> > > Hi
> > > I'm using solr 1.4 with tomcat in a single pc
> > > and I want to turn it in cluster mode with 2 nodes and load
> > > balancing
> > > But I can't find info how to do
> > > Is there any manual or a recorded procedure on the internet to
> > > do that
> > > Or is there anyone to help me ?
> > >
> > > Thanks in advance
> > >
> > >
> > > Ps : I use windows server 2008 for OS
> > >
> > >
> > >
> > >
> > >
>
>
Re: solr with tomcat in cluster mode
Posted by Otis Gospodnetic <ot...@yahoo.com>.
This should work fine.
But why are you indexing to a separate index/core? Why not index in the very same index you are searching?
Slaves won't see changes until their searchers re-open.
Otis
--
Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch
----- Original Message ----
> From: Matt Mitchell <go...@gmail.com>
> To: solr-user@lucene.apache.org
> Sent: Fri, January 22, 2010 9:44:03 AM
> Subject: Re: solr with tomcat in cluster mode
>
> We have a similar setup and I'd be curious to see how folks are doing this
> as well.
>
> Our setup: A few servers and an F5 load balancer. Each Solr instance points
> to a shared index. We use a separate server for indexing. When the index is
> complete, we do some juggling using the Core Admin SWAP function and update
> the shared index. I've wondered about having a shared index across multiple
> instances of (read-only) Solr -- any problems there?
>
> Matt
>
> On Fri, Jan 22, 2010 at 9:35 AM, ZAROGKIKAS,GIORGOS <
> g.zarogkikas@multirama.gr> wrote:
>
> > Hi
> > I'm using solr 1.4 with tomcat in a single pc
> > and I want to turn it in cluster mode with 2 nodes and load
> > balancing
> > But I can't find info how to do
> > Is there any manual or a recorded procedure on the internet to
> > do that
> > Or is there anyone to help me ?
> >
> > Thanks in advance
> >
> >
> > Ps : I use windows server 2008 for OS
> >
> >
> >
> >
> >
Re: solr with tomcat in cluster mode
Posted by Matt Mitchell <go...@gmail.com>.
We have a similar setup and I'd be curious to see how folks are doing this
as well.
Our setup: A few servers and an F5 load balancer. Each Solr instance points
to a shared index. We use a separate server for indexing. When the index is
complete, we do some juggling using the Core Admin SWAP function and update
the shared index. I've wondered about having a shared index across multiple
instances of (read-only) Solr -- any problems there?
Matt
On Fri, Jan 22, 2010 at 9:35 AM, ZAROGKIKAS,GIORGOS <
g.zarogkikas@multirama.gr> wrote:
> Hi
> I'm using solr 1.4 with tomcat in a single pc
> and I want to turn it in cluster mode with 2 nodes and load
> balancing
> But I can't find info how to do
> Is there any manual or a recorded procedure on the internet to
> do that
> Or is there anyone to help me ?
>
> Thanks in advance
>
>
> Ps : I use windows server 2008 for OS
>
>
>
>
>