You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Francis Yakin <fy...@liquid.com> on 2009/06/18 04:57:40 UTC
OutOfMemory error on solrslaves
We are experiencing "OutOfMemory" error frequently on our slaves, this is the error:
SEVERE: Error during auto-warming of key:org.apache.solr.search.QueryResultKey@a8c6f867:java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5120080, Num elements: 1280015
java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5968, Num elements: 2974
java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 3736, Num elements: 1859
Exception in thread "DynamicListenThread[Default]" java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 8208, Num elements: 8192
We need to bounce our weblogic and solr application when that happened to clear the java "OutOfMemory" error.
Some people suggested me to made change on "queryResultCache"
Currently se to:
<queryResultCache
class="solr.LRUCache"
size="512"
initialSize="512"
autowarmCount="256"/>
So the recommendation is:
<queryResultCache
class="solr.LRUCache"
size="1024"
initialSize="512"
autowarmCount="256"/>
We are still running solr 1.2.0 version, do you upgrade to higher version will also resolve the issue.
Any inputs will be much appreciated.
Thanks
Francis
Re: OutOfMemory error on solrslaves
Posted by Koji Sekiguchi <ko...@r.email.ne.jp>.
Francis Yakin wrote:
> Ok Thanks Koji!
>
> We have a test machine that currently running 1.3.0, I see the <queryResultMaxDocsCached>200</queryResultMaxDocsCached>
>
> This set to "200" by default, should I increase it, if yes what should I set to?
>
>
Francis,
It depends. To know what the parameter is, please see:
https://issues.apache.org/jira/browse/SOLR-291
Thank you,
Koji
> Regards,
>
> Francis
>
> -----Original Message-----
> From: Koji Sekiguchi [mailto:koji@r.email.ne.jp]
> Sent: Wednesday, June 17, 2009 8:28 PM
> To: solr-user@lucene.apache.org
> Subject: Re: OutOfMemory error on solrslaves
>
> Francis Yakin wrote:
>
>> We are experiencing "OutOfMemory" error frequently on our slaves, this is the error:
>>
>> SEVERE: Error during auto-warming of key:org.apache.solr.search.QueryResultKey@a8c6f867:java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5120080, Num elements: 1280015
>> java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5968, Num elements: 2974
>> java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 3736, Num elements: 1859
>> Exception in thread "DynamicListenThread[Default]" java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 8208, Num elements: 8192
>>
>> We need to bounce our weblogic and solr application when that happened to clear the java "OutOfMemory" error.
>>
>> Some people suggested me to made change on "queryResultCache"
>>
>> Currently se to:
>>
>> <queryResultCache
>> class="solr.LRUCache"
>> size="512"
>> initialSize="512"
>> autowarmCount="256"/>
>>
>> So the recommendation is:
>>
>> <queryResultCache
>> class="solr.LRUCache"
>> size="1024"
>> initialSize="512"
>> autowarmCount="256"/>
>>
>>
>>
> I don't think the change solves your problem... Since the error occured
> during auto-warming,
> autowarmingCount="0" might help. But...
>
>
>> We are still running solr 1.2.0 version, do you upgrade to higher version will also resolve the issue.
>>
>>
>>
> Solr 1.3 has queryResultMaxDocsCached parameter in solrconfig.xml.
> I'd expect it works for you.
>
> Koji
>
>> Any inputs will be much appreciated.
>>
>> Thanks
>>
>> Francis
>>
>>
>>
>>
>>
>
>
>
RE: OutOfMemory error on solrslaves
Posted by Francis Yakin <fy...@liquid.com>.
Ok Thanks Koji!
We have a test machine that currently running 1.3.0, I see the <queryResultMaxDocsCached>200</queryResultMaxDocsCached>
This set to "200" by default, should I increase it, if yes what should I set to?
Regards,
Francis
-----Original Message-----
From: Koji Sekiguchi [mailto:koji@r.email.ne.jp]
Sent: Wednesday, June 17, 2009 8:28 PM
To: solr-user@lucene.apache.org
Subject: Re: OutOfMemory error on solrslaves
Francis Yakin wrote:
> We are experiencing "OutOfMemory" error frequently on our slaves, this is the error:
>
> SEVERE: Error during auto-warming of key:org.apache.solr.search.QueryResultKey@a8c6f867:java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5120080, Num elements: 1280015
> java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5968, Num elements: 2974
> java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 3736, Num elements: 1859
> Exception in thread "DynamicListenThread[Default]" java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 8208, Num elements: 8192
>
> We need to bounce our weblogic and solr application when that happened to clear the java "OutOfMemory" error.
>
> Some people suggested me to made change on "queryResultCache"
>
> Currently se to:
>
> <queryResultCache
> class="solr.LRUCache"
> size="512"
> initialSize="512"
> autowarmCount="256"/>
>
> So the recommendation is:
>
> <queryResultCache
> class="solr.LRUCache"
> size="1024"
> initialSize="512"
> autowarmCount="256"/>
>
>
I don't think the change solves your problem... Since the error occured
during auto-warming,
autowarmingCount="0" might help. But...
> We are still running solr 1.2.0 version, do you upgrade to higher version will also resolve the issue.
>
>
Solr 1.3 has queryResultMaxDocsCached parameter in solrconfig.xml.
I'd expect it works for you.
Koji
> Any inputs will be much appreciated.
>
> Thanks
>
> Francis
>
>
>
>
Re: OutOfMemory error on solrslaves
Posted by Koji Sekiguchi <ko...@r.email.ne.jp>.
Francis Yakin wrote:
> We are experiencing "OutOfMemory" error frequently on our slaves, this is the error:
>
> SEVERE: Error during auto-warming of key:org.apache.solr.search.QueryResultKey@a8c6f867:java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5120080, Num elements: 1280015
> java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 5968, Num elements: 2974
> java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 3736, Num elements: 1859
> Exception in thread "DynamicListenThread[Default]" java.lang.OutOfMemoryError: allocLargeObjectOrArray - Object size: 8208, Num elements: 8192
>
> We need to bounce our weblogic and solr application when that happened to clear the java "OutOfMemory" error.
>
> Some people suggested me to made change on "queryResultCache"
>
> Currently se to:
>
> <queryResultCache
> class="solr.LRUCache"
> size="512"
> initialSize="512"
> autowarmCount="256"/>
>
> So the recommendation is:
>
> <queryResultCache
> class="solr.LRUCache"
> size="1024"
> initialSize="512"
> autowarmCount="256"/>
>
>
I don't think the change solves your problem... Since the error occured
during auto-warming,
autowarmingCount="0" might help. But...
> We are still running solr 1.2.0 version, do you upgrade to higher version will also resolve the issue.
>
>
Solr 1.3 has queryResultMaxDocsCached parameter in solrconfig.xml.
I'd expect it works for you.
Koji
> Any inputs will be much appreciated.
>
> Thanks
>
> Francis
>
>
>
>