You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Antony Scerri (JIRA)" <ji...@apache.org> on 2016/05/17 15:05:12 UTC
[jira] [Updated] (SOLR-9122) ExactStatsCache doesn't share all
stats
[ https://issues.apache.org/jira/browse/SOLR-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Antony Scerri updated SOLR-9122:
--------------------------------
Attachment: SOLR-9122.patch
The attached patch demonstrates the problem by adding more exhaustive tests, including disabling caching used in the old ones. The test also improved the information being checked and also removed some of the randomness built into the older tests when creating the indexes by now creating all permutations. It also contains a fix for the problem. There may be alternative approaches to solving this but may require more work in other areas. Additional logging has also been added.
The patch is against the 5.x branch but should be straightforward to apply to the master.
> ExactStatsCache doesn't share all stats
> ---------------------------------------
>
> Key: SOLR-9122
> URL: https://issues.apache.org/jira/browse/SOLR-9122
> Project: Solr
> Issue Type: Bug
> Components: Server
> Affects Versions: 5.5, 6.0
> Reporter: Antony Scerri
> Labels: ExactStatsCache
> Fix For: 5.5.1, 6.0.1
>
> Attachments: SOLR-9122.patch
>
>
> The exact stats cache doesn't distribute stats due to an restrictive optimization which meant that in some cases document counts (required for IDF) were not being sent back. This caused TF/IDF calculations to be missing some information that leads to differences depending on distribution of documents and terms in shards.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org