[jira] [Created] (LUCENE-8027) Do not cache clauses if they might make the query more than X times slower

["Adrien Grand (JIRA)" <ji...@apache.org>]

Adrien Grand created LUCENE-8027:
------------------------------------

             Summary: Do not cache clauses if they might make the query more than X times slower
                 Key: LUCENE-8027
                 URL: https://issues.apache.org/jira/browse/LUCENE-8027
             Project: Lucene - Core
          Issue Type: Improvement
            Reporter: Adrien Grand
            Priority: Minor


Query caching can have a negative impact on tail latencies as the clause that is cached needs to be entirely consumed. Maybe we could leverage the fact that we can know the lead cost from any scorer now (LUCENE-7897) in order to implement heuristics that would look  like "do not cache clause X if its cost is 10x greater than the cost of the entire query". This would make sure that a fast query can not become absurdly slow just because it had to cache a costly filter. The filter will need to wait for a more costly query to be cached, or might never be cached at all.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org