You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-dev@lucene.apache.org by "Yonik Seeley (JIRA)" <ji...@apache.org> on 2009/05/13 23:36:45 UTC

[jira] Created: (SOLR-1165) use skipping on filters to improve search performance

use skipping on filters to improve search performance
-----------------------------------------------------

                 Key: SOLR-1165
                 URL: https://issues.apache.org/jira/browse/SOLR-1165
             Project: Solr
          Issue Type: Improvement
            Reporter: Yonik Seeley
            Assignee: Yonik Seeley
             Fix For: 1.4


Solr should use filters to skip scorers to improve search performance.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (SOLR-1165) use skipping on filters to improve search performance

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yonik Seeley updated SOLR-1165:
-------------------------------

    Attachment: SOLR-1165.patch

OK, here's the patch to use Lucene Filters with the search methods so that filtering is done before score() is called and filter/scorer leapfrogging is done, lowering the cost for expensive scorers.

I'll commit soon.

> use skipping on filters to improve search performance
> -----------------------------------------------------
>
>                 Key: SOLR-1165
>                 URL: https://issues.apache.org/jira/browse/SOLR-1165
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Yonik Seeley
>            Assignee: Yonik Seeley
>             Fix For: 1.4
>
>         Attachments: SOLR-1165.patch
>
>
> Solr should use filters to skip scorers to improve search performance.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (SOLR-1165) use skipping on filters to improve search performance

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yonik Seeley resolved SOLR-1165.
--------------------------------

    Resolution: Fixed

committed.

> use skipping on filters to improve search performance
> -----------------------------------------------------
>
>                 Key: SOLR-1165
>                 URL: https://issues.apache.org/jira/browse/SOLR-1165
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Yonik Seeley
>            Assignee: Yonik Seeley
>             Fix For: 1.4
>
>         Attachments: SOLR-1165.patch
>
>
> Solr should use filters to skip scorers to improve search performance.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (SOLR-1165) use skipping on filters to improve search performance

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12711822#action_12711822 ] 

Yonik Seeley commented on SOLR-1165:
------------------------------------

OK, now that the two sub-issues related to DocSets and Filters are ironed out, we can move on to restructuring the search code in SolrIndexSearcher to use lucene Filters and the new Lucene Collector classes.

> use skipping on filters to improve search performance
> -----------------------------------------------------
>
>                 Key: SOLR-1165
>                 URL: https://issues.apache.org/jira/browse/SOLR-1165
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Yonik Seeley
>            Assignee: Yonik Seeley
>             Fix For: 1.4
>
>
> Solr should use filters to skip scorers to improve search performance.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (SOLR-1165) use skipping on filters to improve search performance

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709138#action_12709138 ] 

Yonik Seeley commented on SOLR-1165:
------------------------------------

Leapfrogging a filter and a scorer has been done in Lucene since 2.4.
We'll get it for free if we start using a Lucene Filter (which means we need the docids in sorted order)


> use skipping on filters to improve search performance
> -----------------------------------------------------
>
>                 Key: SOLR-1165
>                 URL: https://issues.apache.org/jira/browse/SOLR-1165
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Yonik Seeley
>            Assignee: Yonik Seeley
>             Fix For: 1.4
>
>
> Solr should use filters to skip scorers to improve search performance.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (SOLR-1165) use skipping on filters to improve search performance

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12709138#action_12709138 ] 

Yonik Seeley edited comment on SOLR-1165 at 5/13/09 2:44 PM:
-------------------------------------------------------------

Leapfrogging a filter and a scorer has been done in Lucene since 2.4.
We'll get it for free if we start using a Lucene Filter (which means we need the docids in sorted order)

The other benefit of using Filter is that score() won't be called for items that don't match the filter... important for expensive functions (like geo distance functions, etc).

      was (Author: yseeley@gmail.com):
    Leapfrogging a filter and a scorer has been done in Lucene since 2.4.
We'll get it for free if we start using a Lucene Filter (which means we need the docids in sorted order)

  
> use skipping on filters to improve search performance
> -----------------------------------------------------
>
>                 Key: SOLR-1165
>                 URL: https://issues.apache.org/jira/browse/SOLR-1165
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Yonik Seeley
>            Assignee: Yonik Seeley
>             Fix For: 1.4
>
>
> Solr should use filters to skip scorers to improve search performance.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.