You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Gilberto Rodriguez <gi...@conviveon.com> on 2004/05/26 22:03:55 UTC
Problem Indexing Large Document Field
I am trying to index a field in a Lucene document with about 90,000
characters. The problem is that it only indexes part of the document.
It seems to only index about 65,00 characters. So, if I search on terms
that are at the beginning of the text, the search works, but it fails
for terms that are at the end of the document.
Is there a limitation on how many characters can be stored in a
document field? Any help would be appreciated, thanks....
Gilberto Rodriguez
Software Engineer
370 CenterPointe Circle, Suite 1178
Altamonte Springs, FL 32701-3451
407.339.1177 (Ext.112) • phone
407.339.6704 • fax
gilberto.rodriguez@conviveon.com • email
www.conviveon.com • web
This e-mail contains legally privileged and confidential information
intended only for the individual or entity named within the message. If
the reader of this message is not the intended recipient, or the agent
responsible to deliver it to the intended recipient, the recipient is
hereby notified that any review, dissemination, distribution or copying
of this communication is prohibited. If this communication was received
in error, please notify me by reply e-mail and delete the original
message.
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: Problem Indexing Large Document Field
Posted by Gilberto Rodriguez <gi...@conviveon.com>.
Thanks, James... That solved the problem.
On May 26, 2004, at 4:15 PM, James Dunn wrote:
> Gilberto,
>
> Look at the IndexWriter class. It has a property,
> maxFieldLength, which you can set to determine the max
> number of characters to be stored in the index.
>
> http://jakarta.apache.org/lucene/docs/api/org/apache/lucene/index/
> IndexWriter.html
>
> Jim
>
> --- Gilberto Rodriguez
> <gi...@conviveon.com> wrote:
>> I am trying to index a field in a Lucene document
>> with about 90,000
>> characters. The problem is that it only indexes part
>> of the document.
>> It seems to only index about 65,00 characters. So,
>> if I search on terms
>> that are at the beginning of the text, the search
>> works, but it fails
>> for terms that are at the end of the document.
>>
>> Is there a limitation on how many characters can be
>> stored in a
>> document field? Any help would be appreciated,
>> thanks....
>>
>>
>> Gilberto Rodriguez
>> Software Engineer
>>
>> 370 CenterPointe Circle, Suite 1178
>> Altamonte Springs, FL 32701-3451
>>
>> 407.339.1177 (Ext.112) phone
>> 407.339.6704 fax
>> gilberto.rodriguez@conviveon.com email
>> www.conviveon.com web
>>
>> This e-mail contains legally privileged and
>> confidential information
>> intended only for the individual or entity named
>> within the message. If
>> the reader of this message is not the intended
>> recipient, or the agent
>> responsible to deliver it to the intended recipient,
>> the recipient is
>> hereby notified that any review, dissemination,
>> distribution or copying
>> of this communication is prohibited. If this
>> communication was received
>> in error, please notify me by reply e-mail and
>> delete the original
>> message.
>>
>>
> ---------------------------------------------------------------------
>> To unsubscribe, e-mail:
>> lucene-user-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail:
>> lucene-user-help@jakarta.apache.org
>>
>
>
>
>
>
> __________________________________
> Do you Yahoo!?
> Friends. Fun. Try the all-new Yahoo! Messenger.
> http://messenger.yahoo.com/
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
Gilberto Rodriguez
Software Engineer
370 CenterPointe Circle, Suite 1178
Altamonte Springs, FL 32701-3451
407.339.1177 (Ext.112) • phone
407.339.6704 • fax
gilberto.rodriguez@conviveon.com • email
www.conviveon.com • web
This e-mail contains legally privileged and confidential information
intended only for the individual or entity named within the message. If
the reader of this message is not the intended recipient, or the agent
responsible to deliver it to the intended recipient, the recipient is
hereby notified that any review, dissemination, distribution or copying
of this communication is prohibited. If this communication was received
in error, please notify me by reply e-mail and delete the original
message.
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: Problem Indexing Large Document Field
Posted by James Dunn <ja...@yahoo.com>.
Gilberto,
Look at the IndexWriter class. It has a property,
maxFieldLength, which you can set to determine the max
number of characters to be stored in the index.
http://jakarta.apache.org/lucene/docs/api/org/apache/lucene/index/IndexWriter.html
Jim
--- Gilberto Rodriguez
<gi...@conviveon.com> wrote:
> I am trying to index a field in a Lucene document
> with about 90,000
> characters. The problem is that it only indexes part
> of the document.
> It seems to only index about 65,00 characters. So,
> if I search on terms
> that are at the beginning of the text, the search
> works, but it fails
> for terms that are at the end of the document.
>
> Is there a limitation on how many characters can be
> stored in a
> document field? Any help would be appreciated,
> thanks....
>
>
> Gilberto Rodriguez
> Software Engineer
> �
> 370 CenterPointe Circle, Suite 1178
> Altamonte Springs, FL 32701-3451
> �
> 407.339.1177 (Ext.112) � phone
> 407.339.6704 � fax
> gilberto.rodriguez@conviveon.com � email
> www.conviveon.com � web
> �
> This e-mail contains legally privileged and
> confidential information
> intended only for the individual or entity named
> within the message. If
> the reader of this message is not the intended
> recipient, or the agent
> responsible to deliver it to the intended recipient,
> the recipient is
> hereby notified that any review, dissemination,
> distribution or copying
> of this communication is prohibited. If this
> communication was received
> in error, please notify me by reply e-mail and
> delete the original
> message.
>
>
---------------------------------------------------------------------
> To unsubscribe, e-mail:
> lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail:
> lucene-user-help@jakarta.apache.org
>
__________________________________
Do you Yahoo!?
Friends. Fun. Try the all-new Yahoo! Messenger.
http://messenger.yahoo.com/
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org