You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by "Robert A. Decker" <de...@robdecker.com> on 2002/09/19 01:53:11 UTC
has this exception been seen before
I'm wondering if the following looks familiar to anyone. This comes up at
times when calling optimize on an index.
com.medicalhost.marvinfoundation.EOIndexManager.editingContextSavedChanges
processUpdated e:java.lang.ArrayIndexOutOfBoundsException
: 99 >= 12
java.lang.ArrayIndexOutOfBoundsException: 99 >= 12
at java.util.Vector.elementAt(Vector.java)
at
org.apache.lucene.index.FieldInfos.fieldInfo(FieldInfos.java:138)
at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:102)
at
org.apache.lucene.index.SegmentReader.document(SegmentReader.java:190)
at
org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:119)
at
org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:90)
at
org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:316)
at
org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:225)
at
com.medicalhost.marvinfoundation.EOIndexManager.indexContents(EOIndexManager.java:199)
thanks,
rob
http://www.robdecker.com/
http://www.planetside.com/
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: has this exception been seen before
Posted by Avi Drissman <av...@baseview.com>.
At 9:55 AM -0800 11/12/02, you wrote:
>A self-contained, reproducible test case is required before someone
>can really start looking at it.
Yep, I know how that goes. Still trying to get my hands on the
database that this seems to happen to.
The reason I write is that there's a new stack trace available. Same
place, but this time I have line numbers (corresponding to the
lucene-1.2-src tarball release). Perhaps that might help a bit.
http://nagoya.apache.org/bugzilla/show_bug.cgi?id=14355
Avi
--
Avi 'rlwimi' Drissman
avi@baseview.com
Argh! This darn mail server is trunca
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: has this exception been seen before
Posted by Avi Drissman <av...@baseview.com>.
At 9:55 AM -0800 11/12/02, you wrote:
>A self-contained, reproducible test case is required before someone
>can really start looking at it.
Working on that now. Next time it crashes I'll have line numbers too.
>What is the history of this index? Have attempts to update it ever
>failed prior to this?
This index was created from scratch, and had several hundred thousand
documents added to it. If I coded it right, there were no deletions
and no searches.
Avi
--
Avi 'rlwimi' Drissman
avi@baseview.com
Argh! This darn mail server is trunca
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: has this exception been seen before
Posted by Doug Cutting <cu...@lucene.com>.
A self-contained, reproducible test case is required before someone can
really start looking at it. What is the history of this index? Have
attempts to update it ever failed prior to this?
Doug
Avi Drissman wrote:
> At 8:56 AM -0400 9/20/02, you wrote:
>
>> Because of this problem, this issue has suddenly become critical for
>> me because it has now taken out my whole server twice. Should this
>> topic be brought up on the lucene-developer list?
>
>
> Grrr. I just got the same problem:
>
>> java.lang.ArrayIndexOutOfBoundsException: 56 >= 5 at
>> java.util.Vector.elementAt(Vector.java:412) at
>> org.apache.lucene.index.FieldInfos.fieldInfo(Unknown Source) at
>> org.apache.lucene.index.FieldsReader.doc(Unknown Source) at
>> org.apache.lucene.index.SegmentReader.document(Unknown Source) at
>> org.apache.lucene.index.SegmentMerger.mergeFields(Unknown Source) at
>> org.apache.lucene.index.SegmentMerger.merge(Unknown Source) at
>> org.apache.lucene.index.IndexWriter.mergeSegments(Unknown Source) at
>> org.apache.lucene.index.IndexWriter.flushRamSegments(Unknown Source)
>> at org.apache.lucene.index.IndexWriter.close(Unknown Source) at
>> com.baseview.iqueserver.luceneindexer.IndexWriterThread.addFileToIndex(IndexWriterThread.java:427)
>> at
>> com.baseview.iqueserver.luceneindexer.IndexWriterThread.run(IndexWriterThread.java:82)
>>
>
>
> It's the same from IndexWriter.mergeSegments onwards. This is really
> bad; we can't complete an indexing of a 300k document database. Did
> anything ever get found on the dev list?
>
> Avi
>
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: has this exception been seen before
Posted by Avi Drissman <av...@baseview.com>.
At 8:56 AM -0400 9/20/02, you wrote:
> Because of this problem, this issue has suddenly become critical
>for me because it has now taken out my whole server twice. Should
>this topic be brought up on the lucene-developer list?
Grrr. I just got the same problem:
>java.lang.ArrayIndexOutOfBoundsException: 56 >= 5 at
>java.util.Vector.elementAt(Vector.java:412) at
>org.apache.lucene.index.FieldInfos.fieldInfo(Unknown Source) at
>org.apache.lucene.index.FieldsReader.doc(Unknown Source) at
>org.apache.lucene.index.SegmentReader.document(Unknown Source) at
>org.apache.lucene.index.SegmentMerger.mergeFields(Unknown Source) at
>org.apache.lucene.index.SegmentMerger.merge(Unknown Source) at
>org.apache.lucene.index.IndexWriter.mergeSegments(Unknown Source) at
>org.apache.lucene.index.IndexWriter.flushRamSegments(Unknown Source)
>at org.apache.lucene.index.IndexWriter.close(Unknown Source) at
>com.baseview.iqueserver.luceneindexer.IndexWriterThread.addFileToIndex(IndexWriterThread.java:427)
>at
>com.baseview.iqueserver.luceneindexer.IndexWriterThread.run(IndexWriterThread.java:82)
It's the same from IndexWriter.mergeSegments onwards. This is really
bad; we can't complete an indexing of a 300k document database. Did
anything ever get found on the dev list?
Avi
--
Avi 'rlwimi' Drissman
avi@baseview.com
Argh! This darn mail server is trunca
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: has this exception been seen before
Posted by Trevor Boicey <tb...@brit.ca>.
Trevor Boicey wrote:
> Robert A. Decker wrote:
>
>> I'm wondering if the following looks familiar to anyone. This comes up at
>> times when calling optimize on an index.
>>
>> com.medicalhost.marvinfoundation.EOIndexManager.editingContextSavedChanges
>>
>> processUpdated e:java.lang.ArrayIndexOutOfBoundsException
>> : 99 >= 12
>> java.lang.ArrayIndexOutOfBoundsException: 99 >= 12
>
>
> I get that a lot, with varying numbers...
>
> Still holding on a solution... :<
>
> It seems once it starts getting the above error it'll never optimize
> again, and the drive slowly fills up. (I think the optimize partially
> succeeds, but leaves stray files around when it fails, so I end up with
> an index directory with dozens of very large files)
>
> The only solution I have is to delete the index and build it again,
> but with my app I only have to time that to run over a weekend. :<
As if on cue, this happened to me this morning, requiring an index
delete and a rebuild.
New twist on the problem that has occured this time and the time
before: when the errors happen enough times, I start getting the good
old "Too many open files" error. (I think Lucene starts dangling file
handles)
So it seems like at a certain point my database is getting corrupted,
and any attempts to look at my poison database cause the "X>=Y" error.
Once I get the error enough times, my whole system will run out of open
files and cease to work, and that seems to mean everything, not just
Lucene. :< :< :<
Because of this problem, this issue has suddenly become critical for
me because it has now taken out my whole server twice. Should this topic
be brought up on the lucene-developer list?
--
Trevor Boicey, P. Eng.
Ottawa, Canada, tboicey@brit.ca
ICQ #17432933 http://www.brit.ca/~tboicey/
"Hey! I asked for Ketchup, I'm eating salad down here!" - Homer
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: has this exception been seen before
Posted by Trevor Boicey <tb...@brit.ca>.
Robert A. Decker wrote:
> I'm wondering if the following looks familiar to anyone. This comes up at
> times when calling optimize on an index.
>
> com.medicalhost.marvinfoundation.EOIndexManager.editingContextSavedChanges
> processUpdated e:java.lang.ArrayIndexOutOfBoundsException
> : 99 >= 12
> java.lang.ArrayIndexOutOfBoundsException: 99 >= 12
I get that a lot, with varying numbers...
Still holding on a solution... :<
It seems once it starts getting the above error it'll never optimize
again, and the drive slowly fills up. (I think the optimize partially
succeeds, but leaves stray files around when it fails, so I end up with
an index directory with dozens of very large files)
The only solution I have is to delete the index and build it again,
but with my app I only have to time that to run over a weekend. :<
--
Trevor Boicey, P. Eng.
Ottawa, Canada, tboicey@brit.ca
ICQ #17432933 http://www.brit.ca/~tboicey/
Admit it Dennis. You *WANT* to get off on a rant here.
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>
Re: has this exception been seen before
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Replying to lucene-dev, seems more appropriate.
Hm, that can't be....
137 final int size() {
138 return byNumber.size();
139 }
byNumber is an instance of Vector that is instantiated when an instance
of FieldInfos class is created. Vector's size() can't throw that
method, as far as I know, and I just checked the JDK API Javadocs.
Plus, it looks like the exception is from:
133 final FieldInfo fieldInfo(int fieldNumber) {
134 return (FieldInfo)byNumber.elementAt(fieldNumber);
135 }
If you (and the other person who reported having this problem....who
may not be on the lucene-dev, hm) can modify the source maybe you can
add some debugging there (print byNumber.size() and fieldNumber, maybe
that will reveal something), recompiling, and trying to get the same
error.
Otis
--- "Robert A. Decker" <de...@robdecker.com> wrote:
> I'm wondering if the following looks familiar to anyone. This comes
> up at
> times when calling optimize on an index.
>
>
com.medicalhost.marvinfoundation.EOIndexManager.editingContextSavedChanges
> processUpdated e:java.lang.ArrayIndexOutOfBoundsException
> : 99 >= 12
> java.lang.ArrayIndexOutOfBoundsException: 99 >= 12
> at java.util.Vector.elementAt(Vector.java)
> at
> org.apache.lucene.index.FieldInfos.fieldInfo(FieldInfos.java:138)
> at
> org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:102)
> at
>
org.apache.lucene.index.SegmentReader.document(SegmentReader.java:190)
> at
>
org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:119)
> at
> org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:90)
> at
>
org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:316)
> at
> org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:225)
> at
>
com.medicalhost.marvinfoundation.EOIndexManager.indexContents(EOIndexManager.java:199)
>
>
>
>
> thanks,
> rob
>
> http://www.robdecker.com/
> http://www.planetside.com/
>
>
> --
> To unsubscribe, e-mail:
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
> <ma...@jakarta.apache.org>
>
__________________________________________________
Do you Yahoo!?
New DSL Internet Access from SBC & Yahoo!
http://sbc.yahoo.com
--
To unsubscribe, e-mail: <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>