You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by bhupesh bansal <bb...@gmail.com> on 2008/11/18 00:43:00 UTC
Lucene 2.4 Token Stream error
Hey folks,
I saw this error in my code base after upgrading lucene-2.4 from lucene 2.3.
have folks seen this before and any idea ?? is it related to fix of
https://issues.apache.org/jira/browse/LUCENE-1333
java.lang.IllegalArgumentException: length 11 exceeds the size of the
termBuffer (10)
at org.apache.lucene.analysis.Token.setTermLength(Token.java:526)
at
com.linkedin.search.pub.stemming.impl.filter.AccentFilter.next(AccentFilter.java:42)
at
org.apache.lucene.analysis.LowerCaseFilter.next(LowerCaseFilter.java:34)
at org.apache.lucene.analysis.TokenStream.next(TokenStream.java:47)
at
com.linkedin.search.pub.stemming.impl.filter.PushbackFilter.next(PushbackFilter.java:52)
at
com.linkedin.search.pub.stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java:58)
at
com.linkedin.search.pub.stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java:70)
at
com.linkedin.search.pub.stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java:39)
at org.apache.lucene.analysis.StopFilter.next(StopFilter.java:120)
at org.apache.lucene.analysis.TokenStream.next(TokenStream.java:47)
--
View this message in context: http://www.nabble.com/Lucene-2.4-Token-Stream-error-tp20550488p20550488.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: Lucene 2.4 Token Stream error
Posted by Michael McCandless <lu...@mikemccandless.com>.
Can you post the code fragment in AccentFilter.java that's setting the
Token?
In 2.4 we added that check (for IllegalArgumentException) to ensure
you don't setTermLength to something longer than the current term
buffer. You should call resizeTermBuffer() first, then fill in the
char[] for the token, then call setTermLength.
Mike
bhupesh bansal wrote:
>
> Hey folks,
>
> I saw this error in my code base after upgrading lucene-2.4 from
> lucene 2.3.
> have folks seen this before and any idea ?? is it related to fix of
> https://issues.apache.org/jira/browse/LUCENE-1333
>
> java.lang.IllegalArgumentException: length 11 exceeds the size of the
> termBuffer (10)
> at org.apache.lucene.analysis.Token.setTermLength(Token.java:
> 526)
> at
> com
> .linkedin
> .search.pub.stemming.impl.filter.AccentFilter.next(AccentFilter.java:
> 42)
> at
> org.apache.lucene.analysis.LowerCaseFilter.next(LowerCaseFilter.java:
> 34)
> at
> org.apache.lucene.analysis.TokenStream.next(TokenStream.java:47)
> at
> com
> .linkedin
> .search
> .pub.stemming.impl.filter.PushbackFilter.next(PushbackFilter.java:52)
> at
> com
> .linkedin
> .search
> .pub
> .stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java:
> 58)
> at
> com
> .linkedin
> .search
> .pub
> .stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java:
> 70)
> at
> com
> .linkedin
> .search
> .pub
> .stemming.impl.filter.rewrite.RewriteFilter.next(RewriteFilter.java:
> 39)
> at org.apache.lucene.analysis.StopFilter.next(StopFilter.java:
> 120)
> at
> org.apache.lucene.analysis.TokenStream.next(TokenStream.java:47)
> --
> View this message in context: http://www.nabble.com/Lucene-2.4-Token-Stream-error-tp20550488p20550488.html
> Sent from the Lucene - Java Users mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org