Embedded Solr Clustering

[born2fish <ts...@yahoo.com>]

Hi everyone,

We have a web app that uses embedded solr for better performance. Now we are
trying to deploy the app to a clustered environment. My question is:

1. Can we configure the embedded solr instances to share the same index on
the network?
2. If the answer to question 1 is no, can we configure embedded solr
instances to replicate indexes in a master / slave fashion just like normal
web based Solr?

Thanks,

born2fish
-- 
View this message in context: http://www.nabble.com/Embedded-Solr-Clustering-tp24891931p24891931.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Embedded Solr Clustering

[Shalin Shekhar Mangar <sh...@gmail.com>]

On Mon, Aug 10, 2009 at 3:57 AM, born2fish <ts...@yahoo.com> wrote:

>
> Hi everyone,
>
> We have a web app that uses embedded solr for better performance.


I would advise against it. We use Solr on sites with millions of page views
a month on HTTP. With HTTP keep-alives, the overhead of an http request is
minimal as compared to the actual search. You have the advantages of
replication as well as the option of adding a http cache in front of Solr.

 Is there a performance problem you're trying to solve by using embedded
solr?


> Now we are
> trying to deploy the app to a clustered environment. My question is:
>
> 1. Can we configure the embedded solr instances to share the same index on
> the network?


Yes. It may be very slow though. Best to benchmark it before going to
production. Also, you'll need to make sure that only one Solr instance is
writing to the index at one time. It is better to have separate indexes.


>
> 2. If the answer to question 1 is no, can we configure embedded solr
> instances to replicate indexes in a master / slave fashion just like normal
> web based Solr?
>

Yes you can use the script based replication. You'd need to expose a way to
call commit on your application if you use embedded solr.

-- 
Regards,
Shalin Shekhar Mangar.

Re: Embedded Solr Clustering

[Chris Hostetter <ho...@fucit.org>]

: Yes we are using Solr for a non-traditional search purpose and the
: performance is critical. However it sounds like that sharing the same index
: could slow down reading / writing to the index. And access synchronization
: is tricky as well.

no matter how you use Solr (HTTP or Embedded) only one SOlrCore can be 
writting to an index at a time.

: Therefore, we might have to use a single web based Solr instance or use
: multiple embedded Solr instances and setup the script based replication.

not clear if this is what you mena: but you can always have a single solr 
"master" (which might be embedded or it might be the war) and then use 
script replication or shared disk to make that index available for 
numerous additional solr instance (again: either embedded or war based) 
for queries.



-Hoss

Re: Embedded Solr Clustering

[born2fish <ts...@yahoo.com>]

Thanks Shalin and Avlesh for your responses.

Yes we are using Solr for a non-traditional search purpose and the
performance is critical. However it sounds like that sharing the same index
could slow down reading / writing to the index. And access synchronization
is tricky as well.

Therefore, we might have to use a single web based Solr instance or use
multiple embedded Solr instances and setup the script based replication.

Thanks again for your help!




born2fish wrote:
> 
> Hi everyone,
> 
> We have a web app that uses embedded solr for better performance. Now we
> are trying to deploy the app to a clustered environment. My question is:
> 
> 1. Can we configure the embedded solr instances to share the same index on
> the network?
> 2. If the answer to question 1 is no, can we configure embedded solr
> instances to replicate indexes in a master / slave fashion just like
> normal web based Solr?
> 
> Thanks,
> 
> born2fish
> 

-- 
View this message in context: http://www.nabble.com/Embedded-Solr-Clustering-tp24891931p24900854.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Embedded Solr Clustering

[Avlesh Singh <av...@gmail.com>]

>
> Can we configure the embedded solr instances to share the same index on the
> network?
>
Yes, multiple EmbeddedSolrServer instances can point to the same core.

Cheers
Avlesh

On Mon, Aug 10, 2009 at 3:57 AM, born2fish <ts...@yahoo.com> wrote:

>
> Hi everyone,
>
> We have a web app that uses embedded solr for better performance. Now we
> are
> trying to deploy the app to a clustered environment. My question is:
>
> 1. Can we configure the embedded solr instances to share the same index on
> the network?
> 2. If the answer to question 1 is no, can we configure embedded solr
> instances to replicate indexes in a master / slave fashion just like normal
> web based Solr?
>
> Thanks,
>
> born2fish
> --
> View this message in context:
> http://www.nabble.com/Embedded-Solr-Clustering-tp24891931p24891931.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>