[jira] [Created] (SOLR-4589) 4.x + enableLazyFieldLoading + large nultivalued fields + varying fl = pathalogical CPU load & response time

["Hoss Man (JIRA)" <ji...@apache.org>]

Hoss Man created SOLR-4589:
------------------------------

             Summary: 4.x + enableLazyFieldLoading + large nultivalued fields + varying fl = pathalogical CPU load & response time
                 Key: SOLR-4589
                 URL: https://issues.apache.org/jira/browse/SOLR-4589
             Project: Solr
          Issue Type: Bug
    Affects Versions: 4.2, 4.1, 4.0
            Reporter: Hoss Man


Following up on a [user report of exterme CPU usage in 4.1|http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201302.mbox/%3C1362019882934-4043543.post@n3.nabble.com%3E], I've discovered that the following combination of factors can result in extreme CPU usage and excessively HTTP response times...

* Solr 4.x (tested 3.6.1, 4.0.0, and 4.2.0)
* enableLazyFieldLoading == true (included in example solrconfig.xml)
* documents with a large number of values in multivalued fields (eg: tested ~10-15K values)
* multiple requests returning the same doc with different "fl" lists

I haven't dug into the route cause yet, but the essential observations is: if lazyloading is used in 4.x, then once a document has been fetched with an initial fl list X, subsequent requests for that document using a differnet fl list Y can be many orders of magnitute slower (while pegging the CPU) -- even if those same requests using fl Y uncached (or w/o lazy laoding) would be extremely fast.


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org