[jira] [Created] (SOLR-9592) decorateDocValues cause serious performance issue because of using slowCompositeReaderWrapper

["Takahiro Ishikawa (JIRA)" <ji...@apache.org>]

Takahiro Ishikawa created SOLR-9592:
---------------------------------------

             Summary: decorateDocValues cause serious performance issue because of using slowCompositeReaderWrapper
                 Key: SOLR-9592
                 URL: https://issues.apache.org/jira/browse/SOLR-9592
             Project: Solr
          Issue Type: Improvement
      Security Level: Public (Default Security Level. Issues are Public)
          Components: Response Writers, search
    Affects Versions: 6.2, 6.1, 6.0
            Reporter: Takahiro Ishikawa
             Fix For: 6.3, master (7.0)


I have serious performance issue using AtomicUpdate (and RealtimeGet) with non stored docValues.
Because decorateDocValues try to merge each leafLeader on the fly via slowCompositeReaderWrapper and it’s extremely slow (> 10sec).
Simply access docValues via nonCompositeReader could resolve this issue.(patch) 

AtomicUpdate performance(or RealtimeGet performance)
* Environment
** solr version : 6.0.0
** schema ~ 100 fields(90% docValues, some of those are multi valued)
** index : 5,000,000
* Performance
** original :  > 10sec per query
** patched : at least 100msec per query

This patch will also enhance search performance, because DocStreamer also fetch docValues via decorateDocValues.
Though it depends on each environment, I could take 20% search performance gain.

(This patch originally written for solr 6.0.0, and now rewritten for master)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org