You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Umesh Prasad <um...@gmail.com> on 2013/11/15 09:58:07 UTC
Solr Core Reload causing JVM Memory Leak through FieldCache/LRUCache/LFUCache
Hi All,
We are seeing memory leaks in our Search application whenever core
reload happens after replication.
We are using Solr 3.6.2 and I have observed this consistently on all
servers.
The leak suspect analysis from MAT is attached with the mail.
<#> Problem Suspect 1
One instance of *"org.apache.lucene.search.FieldCacheImpl"*loaded by
*"org.apache.catalina.loader.WebappClassLoader
@ 0x7f7b0a5b8b30"* occupies *8,726,099,312 (35.49%)* bytes. The memory is
accumulated in one instance of*"java.util.HashMap$Entry[]"* loaded by *"<system
class loader>"*.
*Keywords*
org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
java.util.HashMap$Entry[]
org.apache.lucene.search.FieldCacheImpl
Problem Suspect 2
69 instances of *"org.apache.solr.util.ConcurrentLRUCache"*, loaded by
*"org.apache.catalina.loader.WebappClassLoader
@ 0x7f7b0a5b8b30"* occupy *6,309,187,392 (25.66%)* bytes.
Biggest instances:
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7fe74ef120 - 755,575,672
(3.07%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7e74b7a068 - 728,731,344
(2.96%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7d0a6bd1b8 - 711,828,392
(2.90%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7c6c12e800 - 708,657,624
(2.88%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7fcb092058 - 568,473,352
(2.31%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7f268cb2f0 - 568,400,040
(2.31%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7e31b60c58 - 544,078,600
(2.21%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7e65c2b2d8 - 489,578,480
(1.99%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7d81ea8538 - 467,833,720
(1.90%) bytes.
- org.apache.solr.util.ConcurrentLRUCache @ 0x7f7f31996508 - 444,383,992
(1.81%) bytes.
*Keywords*
org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
org.apache.solr.util.ConcurrentLRUCache
Details » <pages/24.html>
194 instances of *"org.apache.solr.util.ConcurrentLFUCache"*, loaded
by *"org.apache.catalina.loader.WebappClassLoader
@ 0x7f7b0a5b8b30"* occupy *4,583,727,104 (18.64%)* bytes.
Biggest instances:
- org.apache.solr.util.ConcurrentLFUCache @ 0x7f7cdd4735a0 - 410,628,176
(1.67%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @ 0x7f7c7d48e180 - 390,690,864
(1.59%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @ 0x7f7f1edfd008 - 348,193,312
(1.42%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @ 0x7f7f37b01990 - 340,595,920
(1.39%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @ 0x7f7fe02d8dd8 - 274,611,632
(1.12%) bytes.
- org.apache.solr.util.ConcurrentLFUCache @ 0x7f7fa9dcfb20 - 253,848,232
(1.03%) bytes.
*Keywords*
org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
org.apache.solr.util.ConcurrentLFUCache
---
Thanks & Regards
Umesh Prasad
SDE @ Flipkart : The Online Megastore at your doorstep ..
Re: Solr Core Reload causing JVM Memory Leak through FieldCache/LRUCache/LFUCache
Posted by Umesh Prasad <um...@gmail.com>.
Mailing list by default removes attachments. So uploaded it to google drive
..
https://drive.google.com/file/d/0B-RnB4e-vaJhX280NVllMUdHYWs/edit?usp=sharing
On Fri, Nov 15, 2013 at 2:28 PM, Umesh Prasad <um...@gmail.com> wrote:
> Hi All,
> We are seeing memory leaks in our Search application whenever core
> reload happens after replication.
> We are using Solr 3.6.2 and I have observed this consistently on all
> servers.
>
> The leak suspect analysis from MAT is attached with the mail.
>
> <#1425afb4a706064b_> Problem Suspect 1
>
> One instance of *"org.apache.lucene.search.FieldCacheImpl"*loaded by *"org.apache.catalina.loader.WebappClassLoader
> @ 0x7f7b0a5b8b30"* occupies *8,726,099,312 (35.49%)* bytes. The memory is
> accumulated in one instance of*"java.util.HashMap$Entry[]"* loaded by *"<system
> class loader>"*.
>
> *Keywords*
> org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
> java.util.HashMap$Entry[]
> org.apache.lucene.search.FieldCacheImpl
>
> Problem Suspect 2
>
> 69 instances of *"org.apache.solr.util.ConcurrentLRUCache"*, loaded by *"org.apache.catalina.loader.WebappClassLoader
> @ 0x7f7b0a5b8b30"* occupy *6,309,187,392 (25.66%)* bytes.
>
> Biggest instances:
>
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7fe74ef120 - 755,575,672 (3.07%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7e74b7a068 - 728,731,344 (2.96%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7d0a6bd1b8 - 711,828,392 (2.90%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7c6c12e800 - 708,657,624 (2.88%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7fcb092058 - 568,473,352 (2.31%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7f268cb2f0 - 568,400,040 (2.31%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7e31b60c58 - 544,078,600 (2.21%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7e65c2b2d8 - 489,578,480 (1.99%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7d81ea8538 - 467,833,720 (1.90%) bytes.
> - org.apache.solr.util.ConcurrentLRUCache @
> 0x7f7f31996508 - 444,383,992 (1.81%) bytes.
>
>
>
> *Keywords*
> org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
> org.apache.solr.util.ConcurrentLRUCache
> Details » <http://pages/24.html>
>
> 194 instances of *"org.apache.solr.util.ConcurrentLFUCache"*, loaded by *"org.apache.catalina.loader.WebappClassLoader
> @ 0x7f7b0a5b8b30"* occupy *4,583,727,104 (18.64%)* bytes.
>
> Biggest instances:
>
> - org.apache.solr.util.ConcurrentLFUCache @
> 0x7f7cdd4735a0 - 410,628,176 (1.67%) bytes.
> - org.apache.solr.util.ConcurrentLFUCache @
> 0x7f7c7d48e180 - 390,690,864 (1.59%) bytes.
> - org.apache.solr.util.ConcurrentLFUCache @
> 0x7f7f1edfd008 - 348,193,312 (1.42%) bytes.
> - org.apache.solr.util.ConcurrentLFUCache @
> 0x7f7f37b01990 - 340,595,920 (1.39%) bytes.
> - org.apache.solr.util.ConcurrentLFUCache @
> 0x7f7fe02d8dd8 - 274,611,632 (1.12%) bytes.
> - org.apache.solr.util.ConcurrentLFUCache @
> 0x7f7fa9dcfb20 - 253,848,232 (1.03%) bytes.
>
>
>
> *Keywords*
> org.apache.catalina.loader.WebappClassLoader @ 0x7f7b0a5b8b30
> org.apache.solr.util.ConcurrentLFUCache
>
>
> ---
> Thanks & Regards
> Umesh Prasad
>
> SDE @ Flipkart : The Online Megastore at your doorstep ..
>
--
---
Thanks & Regards
Umesh Prasad