You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael Sun (JIRA)" <ji...@apache.org> on 2015/11/10 19:48:11 UTC

[jira] [Created] (SOLR-8272) Allow user to specify actions allowed for each field

Michael Sun created SOLR-8272:
---------------------------------

             Summary: Allow user to specify actions allowed for each field
                 Key: SOLR-8272
                 URL: https://issues.apache.org/jira/browse/SOLR-8272
             Project: Solr
          Issue Type: New Feature
          Components: Schema and Analysis
    Affects Versions: 5.3
            Reporter: Michael Sun


Some actions can be very expensive for some specific fields. For example, in my test, a facet query on a text field blow up a few servers in minutes. The reason is probably Solr does 'uninversion' on this field for facet which uses large amount of field cache. Several Solr servers in turn go into back to back full GC cycles and eventually OOM. To prevent scenarios like this, it's useful to add an option to allow user to decide if some action is allowed for a specific field, particularly for actions using field cache.

There are two ways to design the switch. It can be either for specific action, such as facet, statistic, sorting or for a group of actions, such as all actions doing 'uninversion'.

Some more details about my test. It is a 33-node Solr cluster There is one collection on HDFS with 2.6 billion documents in 30 shards.  




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org