[jira] [Created] (LUCENE-9002) query caching leads to absurdly slow queries

["Guoqiang Jiang (Jira)" <ji...@apache.org>]

Guoqiang Jiang created LUCENE-9002:
--------------------------------------

             Summary: query caching leads to absurdly slow queries
                 Key: LUCENE-9002
                 URL: https://issues.apache.org/jira/browse/LUCENE-9002
             Project: Lucene - Core
          Issue Type: Improvement
          Components: core/search
    Affects Versions: 8.2, 7.7.2
            Reporter: Guoqiang Jiang


*Description*
We have dozens of ES clusters(based on Lucene) for metric scenarios. Most of the queries are like this: _host_ip:10.10.10.10 AND timestamp:[2019-10-01 00:00:00 TO 2019-10-05 23:59:59]_. And we frequently encounter some absurdly slow queries.

*Solution*
For a long time range query(e.g. 5 days), each range query will consume tens of megabytes of memory and spend hundreds of milliseconds to cache, but the benefits are not obvious. And those large cache entries will cause frequent cache eviction. So it's better to  skip the caching action directly when large range query appears with a selective lead iterator.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@lucene.apache.org
For additional commands, e-mail: issues-help@lucene.apache.org