You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Mark Miller <ma...@gmail.com> on 2010/07/28 01:56:24 UTC

Lucene Test Case Failure: org.apache.lucene.index.TestIndexWriter.testThreadInterruptDeadlock (from TestIndexWriter)

FYI - Here is a test failure I just got:

org.apache.lucene.index.TestIndexWriter.testThreadInterruptDeadlock
(from TestIndexWriter)

Failing for the past 1 build (Since #10 )
Took 5.6 sec.
add description
Error Message

ConcurrentMergeScheduler hit unhandled exceptions
Stacktrace

junit.framework.AssertionFailedError: ConcurrentMergeScheduler hit
unhandled exceptions
	at org.apache.lucene.util.LuceneTestCase.tearDown(LuceneTestCase.java:195)
	at org.apache.lucene.util.LuceneTestCase.runBare(LuceneTestCase.java:328)
Standard Output

NOTE: random codec of testcase 'testThreadInterruptDeadlock' was: PreFlex
Standard Error

Exception in thread "Lucene Merge Thread #3"
org.apache.lucene.index.MergePolicy$MergeException:
java.lang.IllegalStateException: sub-readers have different
BytesRef.Comparators:
org.apache.lucene.util.BytesRef$UTF8SortedAsUnicodeComparator@535f2c97
vs org.apache.lucene.util.BytesRef$UTF8SortedAsUTF16Comparator@d689844;
cannot merge
	at
org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:471)
	at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:435)
Caused by: java.lang.IllegalStateException: sub-readers have different
BytesRef.Comparators:
org.apache.lucene.util.BytesRef$UTF8SortedAsUnicodeComparator@535f2c97
vs org.apache.lucene.util.BytesRef$UTF8SortedAsUTF16Comparator@d689844;
cannot merge
	at org.apache.lucene.index.MultiTermsEnum.reset(MultiTermsEnum.java:119)
	at org.apache.lucene.index.MultiFieldsEnum.terms(MultiFieldsEnum.java:112)
	at
org.apache.lucene.index.codecs.FieldsConsumer.merge(FieldsConsumer.java:49)
	at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:657)
	at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:154)
	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4024)
	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3618)
	at
org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:339)
	at
org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:407)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: Lucene Test Case Failure: org.apache.lucene.index.TestIndexWriter.testThreadInterruptDeadlock (from TestIndexWriter)

Posted by Robert Muir <rc...@gmail.com>.
Now I am already glad I volunteered Mike's beer instead of my own.

On Tue, Jul 27, 2010 at 7:56 PM, Mark Miller <ma...@gmail.com> wrote:

> FYI - Here is a test failure I just got:
>
> org.apache.lucene.index.TestIndexWriter.testThreadInterruptDeadlock
> (from TestIndexWriter)
>
> Failing for the past 1 build (Since #10 )
> Took 5.6 sec.
> add description
> Error Message
>
> ConcurrentMergeScheduler hit unhandled exceptions
> Stacktrace
>
> junit.framework.AssertionFailedError: ConcurrentMergeScheduler hit
> unhandled exceptions
>        at
> org.apache.lucene.util.LuceneTestCase.tearDown(LuceneTestCase.java:195)
>        at
> org.apache.lucene.util.LuceneTestCase.runBare(LuceneTestCase.java:328)
> Standard Output
>
> NOTE: random codec of testcase 'testThreadInterruptDeadlock' was: PreFlex
> Standard Error
>
> Exception in thread "Lucene Merge Thread #3"
> org.apache.lucene.index.MergePolicy$MergeException:
> java.lang.IllegalStateException: sub-readers have different
> BytesRef.Comparators:
> org.apache.lucene.util.BytesRef$UTF8SortedAsUnicodeComparator@535f2c97
> vs org.apache.lucene.util.BytesRef$UTF8SortedAsUTF16Comparator@d689844;
> cannot merge
>        at
>
> org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:471)
>        at
>
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:435)
> Caused by: java.lang.IllegalStateException: sub-readers have different
> BytesRef.Comparators:
> org.apache.lucene.util.BytesRef$UTF8SortedAsUnicodeComparator@535f2c97
> vs org.apache.lucene.util.BytesRef$UTF8SortedAsUTF16Comparator@d689844;
> cannot merge
>        at
> org.apache.lucene.index.MultiTermsEnum.reset(MultiTermsEnum.java:119)
>        at
> org.apache.lucene.index.MultiFieldsEnum.terms(MultiFieldsEnum.java:112)
>        at
> org.apache.lucene.index.codecs.FieldsConsumer.merge(FieldsConsumer.java:49)
>        at
> org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:657)
>        at
> org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:154)
>        at
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4024)
>        at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3618)
>        at
>
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:339)
>        at
>
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:407)
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>


-- 
Robert Muir
rcmuir@gmail.com

Re: Lucene Test Case Failure: org.apache.lucene.index.TestIndexWriter.testThreadInterruptDeadlock (from TestIndexWriter)

Posted by Michael McCandless <lu...@mikemccandless.com>.
OK I committed a fix for this one.

The test was failing to close its IW, and so its IW was carrying along
continuing merging such that where we re-install Standard codec in
LuceneTestCase, if a merge kicks in right at that point, completes,
and then another merge tries to run, you'd get the exception below.

Mike

On Tue, Jul 27, 2010 at 8:05 PM, Michael McCandless
<lu...@mikemccandless.com> wrote:
> Well that was fast... I'll try to repro.  Can already hear the beer
> flowing.... better get a backup CO2 tank.
>
> Mike
>
> On Tue, Jul 27, 2010 at 7:56 PM, Mark Miller <ma...@gmail.com> wrote:
>> FYI - Here is a test failure I just got:
>>
>> org.apache.lucene.index.TestIndexWriter.testThreadInterruptDeadlock
>> (from TestIndexWriter)
>>
>> Failing for the past 1 build (Since #10 )
>> Took 5.6 sec.
>> add description
>> Error Message
>>
>> ConcurrentMergeScheduler hit unhandled exceptions
>> Stacktrace
>>
>> junit.framework.AssertionFailedError: ConcurrentMergeScheduler hit
>> unhandled exceptions
>>        at org.apache.lucene.util.LuceneTestCase.tearDown(LuceneTestCase.java:195)
>>        at org.apache.lucene.util.LuceneTestCase.runBare(LuceneTestCase.java:328)
>> Standard Output
>>
>> NOTE: random codec of testcase 'testThreadInterruptDeadlock' was: PreFlex
>> Standard Error
>>
>> Exception in thread "Lucene Merge Thread #3"
>> org.apache.lucene.index.MergePolicy$MergeException:
>> java.lang.IllegalStateException: sub-readers have different
>> BytesRef.Comparators:
>> org.apache.lucene.util.BytesRef$UTF8SortedAsUnicodeComparator@535f2c97
>> vs org.apache.lucene.util.BytesRef$UTF8SortedAsUTF16Comparator@d689844;
>> cannot merge
>>        at
>> org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:471)
>>        at
>> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:435)
>> Caused by: java.lang.IllegalStateException: sub-readers have different
>> BytesRef.Comparators:
>> org.apache.lucene.util.BytesRef$UTF8SortedAsUnicodeComparator@535f2c97
>> vs org.apache.lucene.util.BytesRef$UTF8SortedAsUTF16Comparator@d689844;
>> cannot merge
>>        at org.apache.lucene.index.MultiTermsEnum.reset(MultiTermsEnum.java:119)
>>        at org.apache.lucene.index.MultiFieldsEnum.terms(MultiFieldsEnum.java:112)
>>        at
>> org.apache.lucene.index.codecs.FieldsConsumer.merge(FieldsConsumer.java:49)
>>        at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:657)
>>        at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:154)
>>        at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4024)
>>        at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3618)
>>        at
>> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:339)
>>        at
>> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:407)
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: Lucene Test Case Failure: org.apache.lucene.index.TestIndexWriter.testThreadInterruptDeadlock (from TestIndexWriter)

Posted by Michael McCandless <lu...@mikemccandless.com>.
Well that was fast... I'll try to repro.  Can already hear the beer
flowing.... better get a backup CO2 tank.

Mike

On Tue, Jul 27, 2010 at 7:56 PM, Mark Miller <ma...@gmail.com> wrote:
> FYI - Here is a test failure I just got:
>
> org.apache.lucene.index.TestIndexWriter.testThreadInterruptDeadlock
> (from TestIndexWriter)
>
> Failing for the past 1 build (Since #10 )
> Took 5.6 sec.
> add description
> Error Message
>
> ConcurrentMergeScheduler hit unhandled exceptions
> Stacktrace
>
> junit.framework.AssertionFailedError: ConcurrentMergeScheduler hit
> unhandled exceptions
>        at org.apache.lucene.util.LuceneTestCase.tearDown(LuceneTestCase.java:195)
>        at org.apache.lucene.util.LuceneTestCase.runBare(LuceneTestCase.java:328)
> Standard Output
>
> NOTE: random codec of testcase 'testThreadInterruptDeadlock' was: PreFlex
> Standard Error
>
> Exception in thread "Lucene Merge Thread #3"
> org.apache.lucene.index.MergePolicy$MergeException:
> java.lang.IllegalStateException: sub-readers have different
> BytesRef.Comparators:
> org.apache.lucene.util.BytesRef$UTF8SortedAsUnicodeComparator@535f2c97
> vs org.apache.lucene.util.BytesRef$UTF8SortedAsUTF16Comparator@d689844;
> cannot merge
>        at
> org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:471)
>        at
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:435)
> Caused by: java.lang.IllegalStateException: sub-readers have different
> BytesRef.Comparators:
> org.apache.lucene.util.BytesRef$UTF8SortedAsUnicodeComparator@535f2c97
> vs org.apache.lucene.util.BytesRef$UTF8SortedAsUTF16Comparator@d689844;
> cannot merge
>        at org.apache.lucene.index.MultiTermsEnum.reset(MultiTermsEnum.java:119)
>        at org.apache.lucene.index.MultiFieldsEnum.terms(MultiFieldsEnum.java:112)
>        at
> org.apache.lucene.index.codecs.FieldsConsumer.merge(FieldsConsumer.java:49)
>        at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:657)
>        at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:154)
>        at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4024)
>        at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3618)
>        at
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:339)
>        at
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:407)
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org