You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@lucenenet.apache.org by Floyd Wu <fl...@gmail.com> on 2008/10/09 03:59:54 UTC
Huge memory usage
Hi all,
It seems that issue, http://issues.apache.org/jira/browse/LUCENENET-106still
not being fully fixed.
My observation of memory usage still getting increasing.
By using two profilers(YourKits profiler and MS .Net CLR Profiler), I found
that "Lucene.Net.Index.SegmentReader/Norm" and "Lucene.Net.Index.FieldInfo"
will be increased 41 object(both these two classes) instances when searching
index(yes, sort is involved).
These increased object instances won't be grabage-collected and as result my
system will soon reached memory limitation and fire CLR recycle whole
process.
My Lucene.Net version is 2.3.1.2 and source is grab from SVN.
Please help on this.
Best regards,
Floyd
RE: Huge memory usage
Posted by Digy <di...@gmail.com>.
Can you send a simple test case showing the bug?
DIGY
-----Original Message-----
From: Floyd Wu [mailto:floyd.wu@gmail.com]
Sent: Friday, October 10, 2008 7:46 PM
To: lucene-net-user@incubator.apache.org
Subject: Re: Huge memory usage
Hi Digy
I've applied the patched you provided and still got this problem, which is
using lots memory.
It seems that after applying patch, memory uasge got improvement.
Proved by profiler, I;m sure that I still got memory leakage and probably
come from SegmentReader and caused FieldInfo object instance increased.
Thanks for your reply and help.
2008/10/9 Digy <di...@gmail.com>
> Can you try the patch LUCENENET-106 "Paches for v2.3.1.rar"?
> It contains 3 patches and a new class "WeakHashTable".
>
> There is also another patch (WeakHashTable+FieldCacheImpl.rar) for
> Lucene.Net 2.1
>
> DIGY
>
> -----Original Message-----
> From: Floyd Wu [mailto:floyd.wu@gmail.com]
> Sent: Thursday, October 09, 2008 5:00 AM
> To: lucene-net-user@incubator.apache.org
> Subject: Huge memory usage
>
> Hi all,
> It seems that issue,
> http://issues.apache.org/jira/browse/LUCENENET-106still
>
> not being fully fixed.
> My observation of memory usage still getting increasing.
>
> By using two profilers(YourKits profiler and MS .Net CLR Profiler), I
found
> that "Lucene.Net.Index.SegmentReader/Norm" and
"Lucene.Net.Index.FieldInfo"
>
> will be increased 41 object(both these two classes) instances when
> searching
>
> index(yes, sort is involved).
>
> These increased object instances won't be grabage-collected and as result
> my
> system will soon reached memory limitation and fire CLR recycle whole
> process.
> My Lucene.Net version is 2.3.1.2 and source is grab from SVN.
> Please help on this.
> Best regards,
> Floyd
>
>
Re: Huge memory usage
Posted by Floyd Wu <fl...@gmail.com>.
Hi Digy
I've applied the patched you provided and still got this problem, which is
using lots memory.
It seems that after applying patch, memory uasge got improvement.
Proved by profiler, I;m sure that I still got memory leakage and probably
come from SegmentReader and caused FieldInfo object instance increased.
Thanks for your reply and help.
2008/10/9 Digy <di...@gmail.com>
> Can you try the patch LUCENENET-106 "Paches for v2.3.1.rar"?
> It contains 3 patches and a new class "WeakHashTable".
>
> There is also another patch (WeakHashTable+FieldCacheImpl.rar) for
> Lucene.Net 2.1
>
> DIGY
>
> -----Original Message-----
> From: Floyd Wu [mailto:floyd.wu@gmail.com]
> Sent: Thursday, October 09, 2008 5:00 AM
> To: lucene-net-user@incubator.apache.org
> Subject: Huge memory usage
>
> Hi all,
> It seems that issue,
> http://issues.apache.org/jira/browse/LUCENENET-106still
>
> not being fully fixed.
> My observation of memory usage still getting increasing.
>
> By using two profilers(YourKits profiler and MS .Net CLR Profiler), I found
> that "Lucene.Net.Index.SegmentReader/Norm" and "Lucene.Net.Index.FieldInfo"
>
> will be increased 41 object(both these two classes) instances when
> searching
>
> index(yes, sort is involved).
>
> These increased object instances won't be grabage-collected and as result
> my
> system will soon reached memory limitation and fire CLR recycle whole
> process.
> My Lucene.Net version is 2.3.1.2 and source is grab from SVN.
> Please help on this.
> Best regards,
> Floyd
>
>
RE: Huge memory usage
Posted by Digy <di...@gmail.com>.
Can you try the patch LUCENENET-106 "Paches for v2.3.1.rar"?
It contains 3 patches and a new class "WeakHashTable".
There is also another patch (WeakHashTable+FieldCacheImpl.rar) for
Lucene.Net 2.1
DIGY
-----Original Message-----
From: Floyd Wu [mailto:floyd.wu@gmail.com]
Sent: Thursday, October 09, 2008 5:00 AM
To: lucene-net-user@incubator.apache.org
Subject: Huge memory usage
Hi all,
It seems that issue, http://issues.apache.org/jira/browse/LUCENENET-106still
not being fully fixed.
My observation of memory usage still getting increasing.
By using two profilers(YourKits profiler and MS .Net CLR Profiler), I found
that "Lucene.Net.Index.SegmentReader/Norm" and "Lucene.Net.Index.FieldInfo"
will be increased 41 object(both these two classes) instances when searching
index(yes, sort is involved).
These increased object instances won't be grabage-collected and as result my
system will soon reached memory limitation and fire CLR recycle whole
process.
My Lucene.Net version is 2.3.1.2 and source is grab from SVN.
Please help on this.
Best regards,
Floyd
Re: Huge memory usage
Posted by Jokin Cuadrado <jo...@gmail.com>.
ups, I think you already know that, forget my message.
On 10/9/08, Jokin Cuadrado <jo...@gmail.com> wrote:
> the trunk version is still in development, if you want an stable one,
> compile and use the code on /tags/2.1
>
> On 10/9/08, Floyd Wu <fl...@gmail.com> wrote:
>> Hi all,
>> It seems that issue,
>> http://issues.apache.org/jira/browse/LUCENENET-106still
>>
>> not being fully fixed.
>> My observation of memory usage still getting increasing.
>>
>> By using two profilers(YourKits profiler and MS .Net CLR Profiler), I
>> found
>> that "Lucene.Net.Index.SegmentReader/Norm" and
>> "Lucene.Net.Index.FieldInfo"
>>
>> will be increased 41 object(both these two classes) instances when
>> searching
>>
>> index(yes, sort is involved).
>>
>> These increased object instances won't be grabage-collected and as result
>> my
>> system will soon reached memory limitation and fire CLR recycle whole
>> process.
>> My Lucene.Net version is 2.3.1.2 and source is grab from SVN.
>> Please help on this.
>> Best regards,
>> Floyd
>>
>
Re: Huge memory usage
Posted by Jokin Cuadrado <jo...@gmail.com>.
the trunk version is still in development, if you want an stable one,
compile and use the code on /tags/2.1
On 10/9/08, Floyd Wu <fl...@gmail.com> wrote:
> Hi all,
> It seems that issue, http://issues.apache.org/jira/browse/LUCENENET-106still
>
> not being fully fixed.
> My observation of memory usage still getting increasing.
>
> By using two profilers(YourKits profiler and MS .Net CLR Profiler), I found
> that "Lucene.Net.Index.SegmentReader/Norm" and "Lucene.Net.Index.FieldInfo"
>
> will be increased 41 object(both these two classes) instances when searching
>
> index(yes, sort is involved).
>
> These increased object instances won't be grabage-collected and as result my
> system will soon reached memory limitation and fire CLR recycle whole
> process.
> My Lucene.Net version is 2.3.1.2 and source is grab from SVN.
> Please help on this.
> Best regards,
> Floyd
>