You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by shacky <sh...@gmail.com> on 2011/06/15 18:55:53 UTC
Multiple indexes
Hi.
How to have multiple indexes in SOLR, with different fields and
different types of data?
Thank you very much!
Bye.
RE: Multiple indexes
Posted by Kai Gülzau <kg...@novomind.com>.
> > (for example if you need separate TFs for each document type).
>
> I wonder if in this precise case it wouldn't be pertinent to
> have a single index with the various document types each
> having each their own fields set. Isn't TF calculated field by field ?
Oh, you are right :)
So i will start testing with one "mixed type" index and
perhaps use IndexReaderFactory afterwards in comparison.
Thanks,
Kai Gülzau
RE: Multiple indexes
Posted by Pierre GOSSE <pi...@arisem.com>.
> I think there are reasons to use seperate indexes for each document type
> but do combined searches on these indexes
> (for example if you need separate TFs for each document type).
I wonder if in this precise case it wouldn't be pertinent to have a single index with the various document types each having each their own fields set. Isn't TF calculated field by field ?
RE: Multiple indexes
Posted by Kai Gülzau <kg...@novomind.com>.
Are there any plans to support a kind of federated search
in a future solr version?
I think there are reasons to use seperate indexes for each document type
but do combined searches on these indexes
(for example if you need separate TFs for each document type).
I am aware of http://wiki.apache.org/solr/DistributedSearch
and a workaround to do federated search with sharding
http://stackoverflow.com/questions/2139030/search-multiple-solr-cores-and-return-one-result-set
but this seems to be too much network- and maintenance overhead.
Perhaps it is worth a try to use an IndexReaderFactory which
returns a lucene MultiReader!?
Is the IndexReaderFactory still Experimental?
https://issues.apache.org/jira/browse/SOLR-1366
Regards,
Kai Gülzau
> -----Original Message-----
> From: Jonathan Rochkind [mailto:rochkind@jhu.edu]
> Sent: Wednesday, June 15, 2011 8:43 PM
> To: solr-user@lucene.apache.org
> Subject: Re: Multiple indexes
>
> Next, however, I predict you're going to ask how you do a 'join' or
> otherwise query accross both these cores at once though. You can't do
> that in Solr.
>
> On 6/15/2011 1:00 PM, Frank Wesemann wrote:
> > You'll configure multiple cores:
> > http://wiki.apache.org/solr/CoreAdmin
> >> Hi.
> >>
> >> How to have multiple indexes in SOLR, with different fields and
> >> different types of data?
> >>
> >> Thank you very much!
> >> Bye.
> >
> >
>
Re: Multiple indexes
Posted by Jonathan Rochkind <ro...@jhu.edu>.
Next, however, I predict you're going to ask how you do a 'join' or
otherwise query accross both these cores at once though. You can't do
that in Solr.
On 6/15/2011 1:00 PM, Frank Wesemann wrote:
> You'll configure multiple cores:
> http://wiki.apache.org/solr/CoreAdmin
>> Hi.
>>
>> How to have multiple indexes in SOLR, with different fields and
>> different types of data?
>>
>> Thank you very much!
>> Bye.
>
>
Re: Multiple indexes
Posted by Frank Wesemann <f....@fotofinder.net>.
You'll configure multiple cores:
http://wiki.apache.org/solr/CoreAdmin
> Hi.
>
> How to have multiple indexes in SOLR, with different fields and
> different types of data?
>
> Thank you very much!
> Bye.
>
--
mit freundlichem Gruß,
Frank Wesemann
Fotofinder GmbH USt-IdNr. DE812854514
Software Entwicklung Web: http://www.fotofinder.com/
Potsdamer Str. 96 Tel: +49 30 25 79 28 90
10785 Berlin Fax: +49 30 25 79 28 999
Sitz: Berlin
Amtsgericht Berlin Charlottenburg (HRB 73099)
Geschäftsführer: Ali Paczensky
Re: Multiple indexes
Posted by lee carroll <le...@googlemail.com>.
your data is being used to build an inverted index rather than being
stored as a set of records. de-normalising is fine in most cases. what
is your use case which requires a normalised set of indices ?
2011/6/18 François Schiettecatte <fs...@gmail.com>:
> You would need to run two independent searches and then 'join' the results.
>
> It is best not to apply a 'sql' mindset to SOLR when it comes to (de)normalization, whereas you strive for normalization in sql, that is usually counter-productive in SOLR. For example, I am working on a project with 30+ normalized tables, but only 4 cores.
>
> Perhaps describing what you are trying to achieve would give us greater insight and thus be able to make more concrete recommendation?
>
> Cheers
>
> François
>
> On Jun 18, 2011, at 2:36 PM, shacky wrote:
>
>> Il 18 giugno 2011 20:27, François Schiettecatte
>> <fs...@gmail.com> ha scritto:
>>> Sure.
>>
>> So I can have some searches similar to JOIN on MySQL?
>> The problem is that I need at least two tables in which search data..
>
>
Re: Multiple indexes
Posted by François Schiettecatte <fs...@gmail.com>.
You would need to run two independent searches and then 'join' the results.
It is best not to apply a 'sql' mindset to SOLR when it comes to (de)normalization, whereas you strive for normalization in sql, that is usually counter-productive in SOLR. For example, I am working on a project with 30+ normalized tables, but only 4 cores.
Perhaps describing what you are trying to achieve would give us greater insight and thus be able to make more concrete recommendation?
Cheers
François
On Jun 18, 2011, at 2:36 PM, shacky wrote:
> Il 18 giugno 2011 20:27, François Schiettecatte
> <fs...@gmail.com> ha scritto:
>> Sure.
>
> So I can have some searches similar to JOIN on MySQL?
> The problem is that I need at least two tables in which search data..
Re: Multiple indexes
Posted by shacky <sh...@gmail.com>.
Il 18 giugno 2011 20:27, François Schiettecatte
<fs...@gmail.com> ha scritto:
> Sure.
So I can have some searches similar to JOIN on MySQL?
The problem is that I need at least two tables in which search data..
Re: Multiple indexes
Posted by François Schiettecatte <fs...@gmail.com>.
Sure.
François
On Jun 18, 2011, at 2:25 PM, shacky wrote:
> 2011/6/15 Edoardo Tosca <e....@sourcesense.com>:
>> Try to use multiple cores:
>> http://wiki.apache.org/solr/CoreAdmin
>
> Can I do concurrent searches on multiple cores?
Re: Multiple indexes
Posted by shacky <sh...@gmail.com>.
2011/6/15 Edoardo Tosca <e....@sourcesense.com>:
> Try to use multiple cores:
> http://wiki.apache.org/solr/CoreAdmin
Can I do concurrent searches on multiple cores?
Re: Multiple indexes
Posted by Edoardo Tosca <e....@sourcesense.com>.
Try to use multiple cores:
http://wiki.apache.org/solr/CoreAdmin
On Wed, Jun 15, 2011 at 5:55 PM, shacky <sh...@gmail.com> wrote:
> Hi.
>
> How to have multiple indexes in SOLR, with different fields and
> different types of data?
>
> Thank you very much!
> Bye.
>
--
Edoardo Tosca
Sourcesense - making sense of Open Source: http://www.sourcesense.com