Solr Join in 3.3.x

[Cameron Hurst <wa...@z33k.com>]

Hello all,

I was looking into finding a way to do filtering of documents based on 
fields of other documents in the index. In particular I have a document 
that will update very frequently and hundreds that will very rarely 
change, but the rarely changing documents have a field that will change 
often that is denormalized from the frequently changing document. The 
brute force method I have is to reindex all the documents every time 
that field changes, but this at times is a huge load on my server at a 
critical time that I am trying to avoid.

To avoid this hit I was trying to implement patch SOLR-2272. This opens 
up a join feature to map fields of 1 document onto another (or so my 
understanding is). This would allow me to only update that 1 document 
and have the change applied to all others that rely on it. There is a 
number of spots that this patch fails to apply and I was wondering if 
anyone has tried to use join in 3.3 or any other released version of 
SOLR or if I the only way to do it is use 4.0.

Also while I found this patch, I am also open to any other ideas that 
people have on how to accomplish what I need, this just seemed like the 
most direct method.

Thanks for the help,

Cameron

Re: Solr Join in 3.3.x

[Michael McCandless <lu...@mikemccandless.com>]

Unfortunately Solr's join impl hasn't been backported to 3.x, as far as I know.

You might want to look at ElasticSearch; it has a join implementation
already.... or use Solr 4.0.

Mike McCandless

http://blog.mikemccandless.com

On Wed, Aug 17, 2011 at 7:40 PM, Cameron Hurst <wa...@z33k.com> wrote:
> Hello all,
>
> I was looking into finding a way to do filtering of documents based on
> fields of other documents in the index. In particular I have a document that
> will update very frequently and hundreds that will very rarely change, but
> the rarely changing documents have a field that will change often that is
> denormalized from the frequently changing document. The brute force method I
> have is to reindex all the documents every time that field changes, but this
> at times is a huge load on my server at a critical time that I am trying to
> avoid.
>
> To avoid this hit I was trying to implement patch SOLR-2272. This opens up a
> join feature to map fields of 1 document onto another (or so my
> understanding is). This would allow me to only update that 1 document and
> have the change applied to all others that rely on it. There is a number of
> spots that this patch fails to apply and I was wondering if anyone has tried
> to use join in 3.3 or any other released version of SOLR or if I the only
> way to do it is use 4.0.
>
> Also while I found this patch, I am also open to any other ideas that people
> have on how to accomplish what I need, this just seemed like the most direct
> method.
>
> Thanks for the help,
>
> Cameron
>