Re: Estimating peak memory use for UnInvertedField faceting

[iker huerga <ik...@gmail.com>]

Hi,

A similar issue happened to us a while ago and we got around it using
facet.method=enum, see
http://wiki.apache.org/solr/SimpleFacetParameters#facet.method

By default I think it uses the Field Cache to do the grouping/counting which
is very memory intensive.

Enum could take longer than fc but I guess it depends on your requirements
whether that's acceptable or not.

Re. profiling jvm usage etc, I tend to use jstat which gives (at least to
me) a clear picture of what's going n inside the jvm. In this specific case
you will see that most of the memory is being used in the Old Generation
space that's way the only way to clean it up is a full GC
http://docs.oracle.com/javase/1.5.0/docs/tooldocs/share/jstat.html

I use the following command

/usr/bin/java/jdk_.../jstat  -gc 3s pid > /path/to/file

Hope this helps

Best
Iker



--
View this message in context: http://lucene.472066.n3.nabble.com/Estimating-peak-memory-use-for-UnInvertedField-faceting-tp4100044p4114771.html
Sent from the Lucene - Java Developer mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org