You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@lucene.apache.org by "Aleksandr Popitich (Jira)" <ji...@apache.org> on 2021/10/06 22:16:00 UTC
[jira] [Updated] (LUCENE-10156) BlendedInfixSuggester incorrectly
scores items with high and low weights
[ https://issues.apache.org/jira/browse/LUCENE-10156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aleksandr Popitich updated LUCENE-10156:
----------------------------------------
Description:
After fix LUCENE-8343 BlendedInfixSuggester applies additional 1 / LINEAR_COEF coefficient for the weight that falls to (-10, 10) range. Where LINEAR_COEF = 0.1
Link to the changes: [Code|https://github.com/apache/lucene/commit/e0232f104509f28126d9ce060663f87508366338]
Whilst it fixes zero score issues, it causes incorrect scoring between item with weight < 10 and item with weight > 10.
*Example:*
Blender - POSITION_RECIPROCAL (weight / (1 + position))
||Item||Weight||Score||
|AAA|8|8 * (1 / 0.1) * (1 / (1 + 0)) = 80|
|AAB|11|11 * (1 / (1 + 0)) = 11|
So item AAA with the same position, but with lower weight bubbled up, but in fact, AAA must be on the bottom.
was:
After LUCENE-8343 fix BlendedInfixSuggester applies additional 1 / LINEAR_COEF coefficient for weight that fall to (-10, 10) range. Where LINEAR_COEF = 0.1
Link to the changes: [Code|https://github.com/apache/lucene/commit/e0232f104509f28126d9ce060663f87508366338]
Whilst it fixes zero score issues, it causes incorrect scoring between item with weight < 10 and item with weight > 10.
*Example:*
Blender - POSITION_RECIPROCAL (weight / (1 + position))
||Item||Weight||Score||
|AAA|8|8 * (1 / 0.1) * (1 / (1 + 0)) = 80|
|AAB|11|11 * (1 / (1 + 0)) = 11|
So item AAA with the same position, but with lower weight bubbled up, but in fact if should be on bottom.
> BlendedInfixSuggester incorrectly scores items with high and low weights
> ------------------------------------------------------------------------
>
> Key: LUCENE-10156
> URL: https://issues.apache.org/jira/browse/LUCENE-10156
> Project: Lucene - Core
> Issue Type: Bug
> Components: core/search
> Affects Versions: 8.10
> Reporter: Aleksandr Popitich
> Priority: Major
>
> After fix LUCENE-8343 BlendedInfixSuggester applies additional 1 / LINEAR_COEF coefficient for the weight that falls to (-10, 10) range. Where LINEAR_COEF = 0.1
> Link to the changes: [Code|https://github.com/apache/lucene/commit/e0232f104509f28126d9ce060663f87508366338]
> Whilst it fixes zero score issues, it causes incorrect scoring between item with weight < 10 and item with weight > 10.
> *Example:*
> Blender - POSITION_RECIPROCAL (weight / (1 + position))
> ||Item||Weight||Score||
> |AAA|8|8 * (1 / 0.1) * (1 / (1 + 0)) = 80|
> |AAB|11|11 * (1 / (1 + 0)) = 11|
> So item AAA with the same position, but with lower weight bubbled up, but in fact, AAA must be on the bottom.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org