You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <hu...@hudson.apache.org> on 2011/05/12 04:59:19 UTC
[JENKINS] Lucene-trunk - Build # 1559 - Still Failing
Build: https://builds.apache.org/hudson/job/Lucene-trunk/1559/
1 tests failed.
FAILED: org.apache.lucene.index.TestNRTThreads.testNRTThreads
Error Message:
this writer hit an OutOfMemoryError; cannot commit
Stack Trace:
java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit
at org.apache.lucene.index.IndexWriter.prepareCommit(IndexWriter.java:2456)
at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2538)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2520)
at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2504)
at org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.java:223)
at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1282)
at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1211)
Build Log (for compile errors):
[...truncated 11983 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS] Lucene-trunk - Build # 1559 - Still Failing
Posted by Simon Willnauer <si...@googlemail.com>.
I found the issue - created LUCENE-3090 for it...
I am on it.
On Thu, May 12, 2011 at 3:08 PM, Michael McCandless
<lu...@mikemccandless.com> wrote:
> I dug some into this heap dump...
>
> Somehow we have a DWPT using WAY too much RAM (301 MB). A 2nd DWPT
> has 105 MB tied up. I'm getting these numbers from the bytesUsed
> AtomicLong in the DWPT class from the dump.
>
> This is baffling because, although this test indexes a large amount of
> content for a reasonably long time (5 minutes w/ -nightly), IW's RAM
> buffer is set to 16 MB, so these two DWPTs should have flushed long
> ago.
>
> However, I can't tell from the dump (it doesn't have enough info)
> whether these DWPTs are created by TestNRTThreads, or one of the many
> other tests that run inside the same JVM. Ie, it's possible (but I
> think unlikely) some other test made these massive DWPTs and then
> somehow failed to clean them up (ie, left references to them).
>
> So my best theory at this point is something is wrong w/ the
> FlushPolicy -- it's not flushing after crossing the 16 MB threshold.
>
> Mike
>
> http://blog.mikemccandless.com
>
> On Wed, May 11, 2011 at 10:59 PM, Apache Jenkins Server
> <hu...@hudson.apache.org> wrote:
>> Build: https://builds.apache.org/hudson/job/Lucene-trunk/1559/
>>
>> 1 tests failed.
>> FAILED: org.apache.lucene.index.TestNRTThreads.testNRTThreads
>>
>> Error Message:
>> this writer hit an OutOfMemoryError; cannot commit
>>
>> Stack Trace:
>> java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit
>> at org.apache.lucene.index.IndexWriter.prepareCommit(IndexWriter.java:2456)
>> at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2538)
>> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2520)
>> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2504)
>> at org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.java:223)
>> at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1282)
>> at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1211)
>>
>>
>>
>>
>> Build Log (for compile errors):
>> [...truncated 11983 lines...]
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS] Lucene-trunk - Build # 1559 - Still Failing
Posted by Michael McCandless <lu...@mikemccandless.com>.
I dug some into this heap dump...
Somehow we have a DWPT using WAY too much RAM (301 MB). A 2nd DWPT
has 105 MB tied up. I'm getting these numbers from the bytesUsed
AtomicLong in the DWPT class from the dump.
This is baffling because, although this test indexes a large amount of
content for a reasonably long time (5 minutes w/ -nightly), IW's RAM
buffer is set to 16 MB, so these two DWPTs should have flushed long
ago.
However, I can't tell from the dump (it doesn't have enough info)
whether these DWPTs are created by TestNRTThreads, or one of the many
other tests that run inside the same JVM. Ie, it's possible (but I
think unlikely) some other test made these massive DWPTs and then
somehow failed to clean them up (ie, left references to them).
So my best theory at this point is something is wrong w/ the
FlushPolicy -- it's not flushing after crossing the 16 MB threshold.
Mike
http://blog.mikemccandless.com
On Wed, May 11, 2011 at 10:59 PM, Apache Jenkins Server
<hu...@hudson.apache.org> wrote:
> Build: https://builds.apache.org/hudson/job/Lucene-trunk/1559/
>
> 1 tests failed.
> FAILED: org.apache.lucene.index.TestNRTThreads.testNRTThreads
>
> Error Message:
> this writer hit an OutOfMemoryError; cannot commit
>
> Stack Trace:
> java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit
> at org.apache.lucene.index.IndexWriter.prepareCommit(IndexWriter.java:2456)
> at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2538)
> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2520)
> at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2504)
> at org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.java:223)
> at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1282)
> at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1211)
>
>
>
>
> Build Log (for compile errors):
> [...truncated 11983 lines...]
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org