You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael McCandless (JIRA)" <ji...@apache.org> on 2009/03/11 12:25:50 UTC

[jira] Created: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Make constant-score rewrite the default for multi-term queries
--------------------------------------------------------------

                 Key: LUCENE-1557
                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
             Project: Lucene - Java
          Issue Type: Improvement
    Affects Versions: 2.4.1
            Reporter: Michael McCandless
            Assignee: Michael McCandless
            Priority: Minor
             Fix For: 3.0


For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).

Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.

In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.

This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776127#action_12776127 ] 

Robert Muir commented on LUCENE-1557:
-------------------------------------

bq. I want to get out 3.0.

+1

> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>         Attachments: LUCENE-1557.patch
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Closed: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Uwe Schindler closed LUCENE-1557.
---------------------------------

    Resolution: Invalid

This issue is no longer relevant. All classes were deprecated and there is nothing to change anymore.

> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Uwe Schindler updated LUCENE-1557:
----------------------------------

    Attachment: LUCENE-1557.patch

Thats all, will commit as soon as relevant tests were run.

> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>         Attachments: LUCENE-1557.patch
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776128#action_12776128 ] 

Uwe Schindler commented on LUCENE-1557:
---------------------------------------

Sorry, the SpanRegExQuery must stay unmodified, because it relays on BooleanQuery.

> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>         Attachments: LUCENE-1557.patch
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776122#action_12776122 ] 

Uwe Schindler commented on LUCENE-1557:
---------------------------------------

It is almost obsolete. Fuzzy is fixed to boolean rewrite. The other queries have no longer any other modes. Only at some places in contrib are fixed rewrite setting, whcih I simply remove.

Everywhere else, the defaults are already correct, RangeQuery & Co are gone (deprecated) and the new ones were already in auto mode. The patch only contains cleanup. We can close this soon.

I want to get out 3.0.

> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Commented: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776120#action_12776120 ] 

Robert Muir commented on LUCENE-1557:
-------------------------------------

Uwe,  I am a little confused about this issue. The MultiTermQuery now has a lot of smarts with regards to this. I feel it is obselete

Is this kept open just for the FuzzyQuery? 

> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Issue Comment Edited: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12776131#action_12776131 ] 

Uwe Schindler edited comment on LUCENE-1557 at 11/10/09 10:51 PM:
------------------------------------------------------------------

This issue is no longer relevant. All classes were deprecated in 2.9 and now removed and there is nothing to change anymore.

      was (Author: thetaphi):
    This issue is no longer relevant. All classes were deprecated and there is nothing to change anymore.
  
> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Assigned: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Uwe Schindler reassigned LUCENE-1557:
-------------------------------------

    Assignee: Uwe Schindler  (was: Michael McCandless)

I take this, will provide a patch soon.

> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org


[jira] Updated: (LUCENE-1557) Make constant-score rewrite the default for multi-term queries

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Uwe Schindler updated LUCENE-1557:
----------------------------------

    Attachment:     (was: LUCENE-1557.patch)

> Make constant-score rewrite the default for multi-term queries
> --------------------------------------------------------------
>
>                 Key: LUCENE-1557
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1557
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 2.4.1
>            Reporter: Michael McCandless
>            Assignee: Uwe Schindler
>            Priority: Minor
>             Fix For: 3.0
>
>
> For queries that expand to multiple terms (PrefixQuery, RangeQuery, FuzzyQuery, WildcardQuery), the default now is to rewrite to a BooleanQuery, which scales poorly, and can hit the dreaded TooManyClauses (ungraceful degradation).
> Except for FuzzyQuery (which we should fix with this issue), they all support setConstantScoreRewrite, which scales better.
> In 3.0 we should make constantScoreRewrite the default, and leave an option to turn it off.
> This is a spinoff from LUCENE-998.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org