You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by da...@ontrenet.com on 2010/10/21 13:33:31 UTC
MoreLikeThis explanation?
Hi,
Does the latest Solr provide an explanation for results returned by MLT?
I want to get the interesting terms for each result that overlap with the
source document. This set of terms will vary from result to result
possibly.
Thanks!
Darren
DistributedSearchDesign and multiple requests
Posted by Jeff Wartes <jw...@whitepages.com>.
I'm using Solr 1.4. My observations and this page http://wiki.apache.org/solr/DistributedSearchDesign#line-254 indicate that the general strategy for Distributed Search is something like:
1. Query the shards with the user's query and "fl=unique_field,score"
2. Re-query (maybe a subset of) the shards for certain documents by unique_field with the field list the user requested.
3. Maybe re-query the shards again to flesh out faceting info.
I'm encountering a significant performance penalty using DistributedSearch due to these additional queries, and it seems like there are some obvious optimizations that could avoid them in certain cases.
For example, a way to say "I claim the fields I'm requesting are small enough that querying again for stored fields is worse than just getting the stored fields in the first request". (assert_tiny_data=true&fl=tiny_stored_field,unique_field)
Or, "If the field list of the original query is contained in the first round of shard requests, don't bother querying again for more fields". (fl=unique_field,score)
Has anyone else looked into this? I'd be interested to learn if there are issues that makes these kind of shortcuts difficult before I dig in.
Thanks,
-Jeff Wartes
Re: MoreLikeThis explanation?
Posted by Darren Govoni <da...@ontrenet.com>.
Thank you!
On Thu, 2010-10-21 at 23:03 +0900, Koji Sekiguchi wrote:
> (10/10/21 20:33), darren@ontrenet.com wrote:
> > Hi,
> > Does the latest Solr provide an explanation for results returned by MLT?
>
> No, but there is an open issue:
>
> https://issues.apache.org/jira/browse/SOLR-860
>
> Koji
>
Re: MoreLikeThis explanation?
Posted by Koji Sekiguchi <ko...@r.email.ne.jp>.
Hi Darren,
Usually patches are written for the latest trunk branch at the time.
I've just updated the patch. Try it for the current trunk if you prefer.
Koji
--
http://www.rondhuit.com/en/
(10/10/22 19:10), Darren Govoni wrote:
> Hi Koji,
> I tried to apply your patch to the 1.4.0 tagged branch, but it didn't
> take completely.
> What branch does it work for?
>
> Darren
>
> On Thu, 2010-10-21 at 23:03 +0900, Koji Sekiguchi wrote:
>
>> (10/10/21 20:33), darren@ontrenet.com wrote:
>>> Hi,
>>> Does the latest Solr provide an explanation for results returned by MLT?
>>
>> No, but there is an open issue:
>>
>> https://issues.apache.org/jira/browse/SOLR-860
>>
>> Koji
>>
>
>
>
Re: MoreLikeThis explanation?
Posted by Darren Govoni <da...@ontrenet.com>.
Hi Koji,
I tried to apply your patch to the 1.4.0 tagged branch, but it didn't
take completely.
What branch does it work for?
Darren
On Thu, 2010-10-21 at 23:03 +0900, Koji Sekiguchi wrote:
> (10/10/21 20:33), darren@ontrenet.com wrote:
> > Hi,
> > Does the latest Solr provide an explanation for results returned by MLT?
>
> No, but there is an open issue:
>
> https://issues.apache.org/jira/browse/SOLR-860
>
> Koji
>
Re: MoreLikeThis explanation?
Posted by Koji Sekiguchi <ko...@r.email.ne.jp>.
(10/10/21 20:33), darren@ontrenet.com wrote:
> Hi,
> Does the latest Solr provide an explanation for results returned by MLT?
No, but there is an open issue:
https://issues.apache.org/jira/browse/SOLR-860
Koji
--
http://www.rondhuit.com/en/