You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@lucene.apache.org by Apache Wiki <wi...@apache.org> on 2014/09/19 22:57:07 UTC

[Solr Wiki] Trivial Update of "SolrPerformanceData" by TokeEskildsen

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Solr Wiki" for change notification.

The "SolrPerformanceData" page has been changed by TokeEskildsen:
https://wiki.apache.org/solr/SolrPerformanceData?action=diff&rev1=28&rev2=29

Comment:
Corrected library->archive

  
  Search is handled by a single dedicated 16 core CentOS machine with 256GB RAM (currently ~130GB free for disk cache). Each shard has its own Solr instance running in Tomcat with a Xmx of 9GB and resides on a dedicated SSD (Samsung 840). All instances are in a single SolrCloud. There are 25 SSDs in the machine and it is currently undecided if the setup will be scaled up (more RAM, more SSDs) or out (another similar machine), when we reach that number of shards.
  
- Access to the library is limited and at most 2 or 3 users are active at a time. Searches are faceted on 6 fields: URL (nearly 5 billion unique values), domain, host and 3 smaller ones. With Solr 4.8 and [[https://issues.apache.org/jira/browse/SOLR-5894|SOLR-5894]], median and average response times during load testing are currently below ½ second and expected to stay below 1 second as the index grows. Special searches, such as *:*, take up to 2 minutes. For non-faceted searches, IOWait get as high as 10%. For faceted searches, IOWait stays below 0.5% and CPU-load is high. It has not been determined if the high CPU-load is due to processing (easily scalable) or memory access congestion (not easily scalable). See [[http://sbdevel.wordpress.com/2014/09/11/even-sparse-faceting-is-limited/|Even sparse faceting is limited]] for most recent performance figures.
+ Access to the archive is limited and at most 2 or 3 users are active at a time. Searches are faceted on 6 fields: URL (nearly 5 billion unique values), domain, host and 3 smaller ones. With Solr 4.8 and [[https://issues.apache.org/jira/browse/SOLR-5894|SOLR-5894]], median and average response times during load testing are currently below ½ second and expected to stay below 1 second as the index grows. Special searches, such as *:*, take up to 2 minutes. For non-faceted searches, IOWait get as high as 10%. For faceted searches, IOWait stays below 0.5% and CPU-load is high. It has not been determined if the high CPU-load is due to processing (easily scalable) or memory access congestion (not easily scalable). See [[http://sbdevel.wordpress.com/2014/09/11/even-sparse-faceting-is-limited/|Even sparse faceting is limited]] for most recent performance figures.