You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@uima.apache.org by Jörn Kottmann <ko...@gmail.com> on 2010/04/15 16:22:21 UTC
Memory leak in UIMA-AS ?
Hi everyone,
after running a UIMA-AS node for 6 days I noticed
that there are around 400K instances of
org.apache.uima.aae.jmx.ServicePerformance
objects consuming around 80 MB of memory.
In our production system the UIMA-AS worker nodes
fail after a few weeks with an OutOfMemoryException
and I would like to know if the huge amount of ServicePerformance
objects might be linked to that failure.
Jörn
Re: Memory leak in UIMA-AS ?
Posted by Jörn Kottmann <ko...@gmail.com>.
After analyzing the memory dump and the uima-as code a little more
I think it is this map which keeps a reference for every processed CAS:
org.apache.uima.aae.controller.BaseAnalysisEngineController.statsMap
I am not sure when/how it should be cleared. Would be nice if someone
else can have a look.
Jörn
Jörn Kottmann wrote:
> Maybe there is one more memory leak.
>
> In the memory dump are 2M instances of ConcurrentHashMap.HashEntry
> objects.
> The HashEntry objects have a String key and a Long value.
>
> Here is a sample:
> Key: 4d8fb444:128083b6841:-48ddinQ_HBaseWriter_1.3
> Value: 21472428254191715
> <../object/0x7fbc287f8200>
> Jörn
Re: Memory leak in UIMA-AS ?
Posted by Jörn Kottmann <ko...@gmail.com>.
Maybe there is one more memory leak.
In the memory dump are 2M instances of ConcurrentHashMap.HashEntry objects.
The HashEntry objects have a String key and a Long value.
Here is a sample:
Key: 4d8fb444:128083b6841:-48ddinQ_HBaseWriter_1.3
Value: 21472428254191715
<../object/0x7fbc287f8200>
Jörn
Re: Memory leak in UIMA-AS ?
Posted by Jaroslaw Cwiklik <ui...@gmail.com>.
Indeed, this seems to confirm my suspicion. Will create JIRA for this soon.
Thanks
Jerry C
On Thu, Apr 15, 2010 at 11:11 AM, Jörn Kottmann <ko...@gmail.com> wrote:
> Jaroslaw Cwiklik wrote:
>
>> Jorn, I will try to find a source of this leakage today. There is a per
>> CAS
>> statistic cached in a Map in the UIMA AS service and most likely this Map
>> is
>> not being cleaned up every time a CAS is returned to a client. I will
>> create
>> JIRA for this once I confirm the problem.
>> Thanks
>>
>>
> All ServicePerformance objects I manually checked where referenced by a
> ConcurrentHashMap.HashEntry object where the key is
> a string which looks like this "-73ca03a4:127b9341087:1dd3".
>
> Sounds like the map you are talking about.
>
> Jörn
>
Re: Memory leak in UIMA-AS ?
Posted by Jörn Kottmann <ko...@gmail.com>.
Jaroslaw Cwiklik wrote:
> Jorn, I will try to find a source of this leakage today. There is a per CAS
> statistic cached in a Map in the UIMA AS service and most likely this Map is
> not being cleaned up every time a CAS is returned to a client. I will create
> JIRA for this once I confirm the problem.
> Thanks
>
All ServicePerformance objects I manually checked where referenced by a
ConcurrentHashMap.HashEntry object where the key is
a string which looks like this "-73ca03a4:127b9341087:1dd3".
Sounds like the map you are talking about.
Jörn
Re: Memory leak in UIMA-AS ?
Posted by Jaroslaw Cwiklik <ui...@gmail.com>.
Jorn, I will try to find a source of this leakage today. There is a per CAS
statistic cached in a Map in the UIMA AS service and most likely this Map is
not being cleaned up every time a CAS is returned to a client. I will create
JIRA for this once I confirm the problem.
Thanks
Jerry C
On Thu, Apr 15, 2010 at 10:22 AM, Jörn Kottmann <ko...@gmail.com> wrote:
> Hi everyone,
>
> after running a UIMA-AS node for 6 days I noticed
> that there are around 400K instances of
> org.apache.uima.aae.jmx.ServicePerformance
> objects consuming around 80 MB of memory.
>
> In our production system the UIMA-AS worker nodes
> fail after a few weeks with an OutOfMemoryException
> and I would like to know if the huge amount of ServicePerformance
> objects might be linked to that failure.
>
> Jörn
>