Solr, Multiple processes running

["Owens, Martin" <Ma...@merrillcorp.com>]

Hello everyone,

The system we're moving from (dtSearch) allows each of our clients to have a search index. So far I have yet to find the options required to set this, it seems I can only set the directory path before run time.

Each of the indexes uses the same schema, same configuration just different data in each; what kind of performance penalty would I have from running a new solr instance per required database? what is the best way to track what port or what index is being used? would I be able to run 1,000 or more solr instances without performance degradation?

Thanks for your help.

Best regards, Martin Owens

Re: Solr, Multiple processes running

[Chris Hostetter <ho...@fucit.org>]

: Subject: Solr, Multiple processes running
: References: <F7...@EVS02.adminsys.mrll.com>
:      <1E...@gmail.com>
:     <F7...@EVS02.adminsys.mrll.com>
	...

http://people.apache.org/~hossman/#threadhijack

Thread Hijacking on Mailing Lists

When starting a new discussion on a mailing list, please do not reply to 
an existing message, instead start a fresh email.  Even if you change the 
subject line of your email, other mail headers still track which thread 
you replied to and your question is "hidden" in that thread and gets less 
attention.   It makes following discussions in the mailing list archives 
particularly difficult.
See Also:  http://en.wikipedia.org/wiki/Thread_hijacking




-Hoss

RE: Solr, Multiple processes running

["Owens, Martin" <Ma...@merrillcorp.com>]

>> When replying, the number of documents is almost, but not quite
>> totally, useless unless combined with the number of fields you're
>> storing per doc, the average length of each field, etc <G>.....

2 million documents, 3 fields (1 content, 1 unique, 1 object id) per index

The content field is between 200k and 2MB of text.

Just to fill in any gaps.

Best Regards, Martin Owens

Re: Solr, Multiple processes running

[Erick Erickson <er...@gmail.com>]

How much data are we talking about here? Because it seems *much* simpler
to just index a field with each document indicating the user and then just
AND that user's ID in with your query.

Or think about facets (although I admit I don't know enough about facets
to weigh in on its merits, it's just been mentioned a lot).

Keeping track of 1,000+ indexes seems like a maintenance headache, but
much depends upon how much data you're talking about.

When replying, the number of documents is almost, but not quite
totally, useless unless combined with the number of fields you're
storing per doc, the average length of each field, etc <G>.....

Erick

On Dec 11, 2007 4:01 PM, Owens, Martin <Ma...@merrillcorp.com> wrote:

> Hello everyone,
>
> The system we're moving from (dtSearch) allows each of our clients to have
> a search index. So far I have yet to find the options required to set this,
> it seems I can only set the directory path before run time.
>
> Each of the indexes uses the same schema, same configuration just
> different data in each; what kind of performance penalty would I have from
> running a new solr instance per required database? what is the best way to
> track what port or what index is being used? would I be able to run 1,000 or
> more solr instances without performance degradation?
>
> Thanks for your help.
>
> Best regards, Martin Owens
>

Re: Solr, Multiple processes running

[Walter Underwood <wu...@netflix.com>]

Since they all use the same schema, can you add a client ID to each document
when it is indexed? Filter by "clientid:4" and you get a subset of the
index.

wunder

On 12/11/07 1:01 PM, "Owens, Martin" <Ma...@merrillcorp.com> wrote:

> Hello everyone,
> 
> The system we're moving from (dtSearch) allows each of our clients to have a
> search index. So far I have yet to find the options required to set this, it
> seems I can only set the directory path before run time.
> 
> Each of the indexes uses the same schema, same configuration just different
> data in each; what kind of performance penalty would I have from running a new
> solr instance per required database? what is the best way to track what port
> or what index is being used? would I be able to run 1,000 or more solr
> instances without performance degradation?
> 
> Thanks for your help.
> 
> Best regards, Martin Owens