Re: Best way to gather span/token positions from query?

[Grant Ingersoll <gs...@apache.org>]

I've been thinking about how to add spans to Solr, but haven't  
actually codified it yet.  I see no reason why a query parser can't  
support some syntax and the "dump spans" method approach can't be co- 
opted to write out the spans to the response.  Seems like it would  
need to be an additional part of the QueryComponent, plus some  
addition to the query parsers.  We can more easily add it to the  
Dismax parser, but if we add it to the Lucene one, then we should make  
that change in Lucene.


-Grant

On Apr 29, 2009, at 7:06 PM, Sean O'Connor wrote:

> Hello,
>   I'm trying to find a decent approach for getting token positions  
> out of (or is that into?) solr query results. Is the best approach  
> to extend a QueryComponent and/or HighlightComponent? I'm new to  
> solr, and still on fairly shaky ground soany pointers or suggestions  
> are quite welcome.
>
>   As a little BACKGROUND:
>   I am trying to migrate a custom  lucene-only content anaylsys  
> project to solr. The 'old' system programmatically runs a few  
> thousand predefined queries against a corpus, and then analyzes the  
> results. The lucene score is good, but the actual position of the  
> hits is also quite important.
>
>   My previous system did a simple query parsing to create  
> SpanQuerys, and then used a modified dumpSpans() to get the token  
> position from the spans. Now I am trying to find how to use solr's  
> goodness (and MemoryIndex approach?) to get the span positions in a  
> more logical manner. I think the answer is in the highlighter, but  
> I'm getting a little twisted around, and could use a pointer.
>
>   I am using a recent Solr nightly snapshot, grails, Aduna Aperture,  
> and Intellij (if any of that matters)
> Thanks,
>
> Sean
>

--------------------------
Grant Ingersoll
http://www.lucidimagination.com/

Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids)  
using Solr/Lucene:
http://www.lucidimagination.com/search