Records which fail to index

[Br...@mainline.com]

Hello friends.  I'm just getting started with Lucene and am hoping someone
can give me some guidance.  We've written some code to retrieve data from
the database and index it.  Unfortunately, some records simply are never
included.  If I restrict my process such that it attempts to only include
the records that fail, I get an invalid index; the viewer Luke is unable to
open the directory.  If I include all records in my query to find records
to index, the process finishes up, only the total number of records created
is short.

I've evaluated the data in the database to search for a difference and
until cross eyed and cannot find any potential differences.  Has anyone out
there had a similar experience and what did you do to debug / repair the
problem?

Thanks!

brian

This e-mail and files transmitted with it are confidential, and are
intended solely for the use of the individual or entity to whom this e-mail
is addressed.  If you are not the intended recipient, or the employee or
agent responsible to deliver it to the intended recipient, you are hereby
notified that any dissemination, distribution or copying of this
communication is strictly prohibited.  If you are not one of the named
recipient(s) or otherwise have reason to believe that you received this
message in error, please immediately notify sender by e-mail, and destroy
the original message.  Thank You.




---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org

Re: Records which fail to index

[Erik Hatcher <er...@ehatchersolutions.com>]

What kind of text are you feeding to Lucene?  Is it possible you're 
feeding some strange stuff into a field?  Nulls ('\0') maybe?

	Erik


On Jan 6, 2004, at 5:59 PM, Brian.Scott@mainline.com wrote:
> Hello friends.  I'm just getting started with Lucene and am hoping 
> someone
> can give me some guidance.  We've written some code to retrieve data 
> from
> the database and index it.  Unfortunately, some records simply are 
> never
> included.  If I restrict my process such that it attempts to only 
> include
> the records that fail, I get an invalid index; the viewer Luke is 
> unable to
> open the directory.  If I include all records in my query to find 
> records
> to index, the process finishes up, only the total number of records 
> created
> is short.
>
> I've evaluated the data in the database to search for a difference and
> until cross eyed and cannot find any potential differences.  Has 
> anyone out
> there had a similar experience and what did you do to debug / repair 
> the
> problem?
>
> Thanks!
>
> brian
>
> This e-mail and files transmitted with it are confidential, and are
> intended solely for the use of the individual or entity to whom this 
> e-mail
> is addressed.  If you are not the intended recipient, or the employee 
> or
> agent responsible to deliver it to the intended recipient, you are 
> hereby
> notified that any dissemination, distribution or copying of this
> communication is strictly prohibited.  If you are not one of the named
> recipient(s) or otherwise have reason to believe that you received this
> message in error, please immediately notify sender by e-mail, and 
> destroy
> the original message.  Thank You.
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-dev-help@jakarta.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-dev-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-dev-help@jakarta.apache.org