You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Neil Hooey (JIRA)" <ji...@apache.org> on 2011/05/05 17:27:04 UTC

[jira] [Created] (SOLR-2498) Stop consolidating boosts for values of multivalued fields

Stop consolidating boosts for values of multivalued fields
----------------------------------------------------------

                 Key: SOLR-2498
                 URL: https://issues.apache.org/jira/browse/SOLR-2498
             Project: Solr
          Issue Type: Improvement
    Affects Versions: 3.1, 4.0, Next
            Reporter: Neil Hooey


Currently, if you boost a value in a multivalued field during index time, the boosts are consolidated for every field, and the individual values are lost.

So, for example, given a list of photos with a multivalue field "keywords", and a boost for a keyword assigned to a photo corresponds to the number of times that photo was downloaded after searching for that particular keyword.

{code}
photo1: Photo of a cat by itself:
keywords: [ cat:600 feline:100 ]
=> boost total = 700

photo2: Photo of a cat driving a truck:
keywords: [ cat:100 feline:90 animal:80 truck:1000 ]
=> boost total = 1270
{code}

If you search for "cat feline", photo2 will rank higher, since the boost of "cat-like" words was consolidated for the "truck" boost anomoly to score a total of 1270. Whereas photo1, which has more "cat feline" downloads, only gets a score of 700, and ranks lower.

*Intuitively the boosts should be separate, so only the boosts for the terms searched will be counted.*

Given the current behaviour, you are forced to do one of the following:
1. Assemble all of the multi-values into a string, and use payloads in place of boosts.
2. Use dynamic fields, such as keyword_*, and boost them independently.

Neither of these solutions are ideal, as using payloads requires writing your own BoostingTermQuery, and defining a new dynamic field per multi-value makes searching more difficult than with mutlivalued fields.

There's a blog link that describes the current behaviour:
http://blog.kapilchhabra.com/2008/01/solr-index-time-boost-facts-2

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Closed] (SOLR-2498) Stop consolidating boosts for values of multivalued fields

Posted by "Neil Hooey (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Neil Hooey closed SOLR-2498.
----------------------------

    Resolution: Duplicate

> Stop consolidating boosts for values of multivalued fields
> ----------------------------------------------------------
>
>                 Key: SOLR-2498
>                 URL: https://issues.apache.org/jira/browse/SOLR-2498
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Neil Hooey
>
> I accidentally double-submitted this bug when my browser crashed.
> Here is the real one:
> https://issues.apache.org/jira/browse/SOLR-2499

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-2498) Stop consolidating boosts for values of multivalued fields

Posted by "Neil Hooey (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Neil Hooey updated SOLR-2498:
-----------------------------

               Labels:   (was: boost multivalue multivalued)
          Description: 
I accidentally double-submitted this bug when my browser crashed.

Here is the real one:
https://issues.apache.org/jira/browse/SOLR-2499

  was:
Currently, if you boost a value in a multivalued field during index time, the boosts are consolidated for every field, and the individual values are lost.

So, for example, given a list of photos with a multivalue field "keywords", and a boost for a keyword assigned to a photo corresponds to the number of times that photo was downloaded after searching for that particular keyword.

{code}
photo1: Photo of a cat by itself:
keywords: [ cat:600 feline:100 ]
=> boost total = 700

photo2: Photo of a cat driving a truck:
keywords: [ cat:100 feline:90 animal:80 truck:1000 ]
=> boost total = 1270
{code}

If you search for "cat feline", photo2 will rank higher, since the boost of "cat-like" words was consolidated for the "truck" boost anomoly to score a total of 1270. Whereas photo1, which has more "cat feline" downloads, only gets a score of 700, and ranks lower.

*Intuitively the boosts should be separate, so only the boosts for the terms searched will be counted.*

Given the current behaviour, you are forced to do one of the following:
1. Assemble all of the multi-values into a string, and use payloads in place of boosts.
2. Use dynamic fields, such as keyword_*, and boost them independently.

Neither of these solutions are ideal, as using payloads requires writing your own BoostingTermQuery, and defining a new dynamic field per multi-value makes searching more difficult than with mutlivalued fields.

There's a blog link that describes the current behaviour:
http://blog.kapilchhabra.com/2008/01/solr-index-time-boost-facts-2

    Affects Version/s:     (was: Next)
                           (was: 4.0)
                           (was: 3.1)

> Stop consolidating boosts for values of multivalued fields
> ----------------------------------------------------------
>
>                 Key: SOLR-2498
>                 URL: https://issues.apache.org/jira/browse/SOLR-2498
>             Project: Solr
>          Issue Type: Improvement
>            Reporter: Neil Hooey
>
> I accidentally double-submitted this bug when my browser crashed.
> Here is the real one:
> https://issues.apache.org/jira/browse/SOLR-2499

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org