Re: FileNotFoundException on index

[Max Lynch <ih...@gmail.com>]

Hi Mike,

Missed your response on this,
What I was doing was physically removing index/write.lock if older than 8
hours, allowing another process of my indexer to run.  I realize in
hindsight that there is no reason why I should be doing this and it was
really stupid.  I think I was under the impression one of my pylucene
processes was hanging.

On Fri, Oct 9, 2009 at 3:44 AM, Michael McCandless <
lucene@mikemccandless.com> wrote:

> You can use o.a.l.index.CheckIndex to fix the index.  It will remove
> references to any segments that are missing or have problems during
> testing.  First run it without -fix to see what problems there are.
> Then take a backup of the index.  Then run it with -fix.  The index
> will lose all docs in those segments that it removes.
>
> Can you describe what led up to this?  Is it repeatable?
>
> Mike
>
> On Fri, Oct 9, 2009 at 12:37 AM, Max Lynch <ih...@gmail.com> wrote:
> > Missed your response, thanks Bernd.
> >
> > I don't think that's it, since I haven't been executing any commands like
> > that.  The only thing I could think of is corruption.  I've got the index
> > backed up in case there is a way to fix it (it won't matter in a week or
> so
> > since I cull any documents older than 25 days).
> >
> > Is there a way to fix this?
> >
> > Thanks.
> >
> > On Thu, Oct 8, 2009 at 3:01 AM, Bernd Fondermann <
> > bernd.fondermann@googlemail.com> wrote:
> >
> >> Hi Max
> >>
> >> just a guess: maybe you deleted all *.c source files in that area and
> >> unintentionally deleted this index file, too.
> >>
> >>  Bernd
> >>
> >> On Fri, Oct 2, 2009 at 17:10, Max Lynch <ih...@gmail.com> wrote:
> >> > I'm getting this error when I try to run my searcher and my indexer:
> >> >
> >> > Traceback (most recent call last):
> >> > self.searcher = lucene.IndexSearcher(self.directory)
> >> > JavaError: java.io.FileNotFoundException:
> >> /home/spider/misc/index/_275c.cfs
> >> > (No such file or directory)
> >> >
> >> > I don't know anything about the format of the Lucene index, but I
> notice
> >> I
> >> > have several _275* files from b to j but no c.
> >> >
> >> > Any ideas?
> >> >
> >> > Thanks.
> >> >
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>

Re: FileNotFoundException on index

[Michael McCandless <lu...@mikemccandless.com>]

OK thanks for bringing closure!

Accidentally allowing 2 writers to write to the same index quickly
leads to corruption.  They are like the Betta fish: they fight to the
death, removing each others files, if you put them in the same cage.

Mike

On Wed, Dec 9, 2009 at 1:56 AM, Max Lynch <ih...@gmail.com> wrote:
> Hi Mike,
>
> Missed your response on this,
> What I was doing was physically removing index/write.lock if older than 8
> hours, allowing another process of my indexer to run.  I realize in
> hindsight that there is no reason why I should be doing this and it was
> really stupid.  I think I was under the impression one of my pylucene
> processes was hanging.
>
> On Fri, Oct 9, 2009 at 3:44 AM, Michael McCandless <
> lucene@mikemccandless.com> wrote:
>
>> You can use o.a.l.index.CheckIndex to fix the index.  It will remove
>> references to any segments that are missing or have problems during
>> testing.  First run it without -fix to see what problems there are.
>> Then take a backup of the index.  Then run it with -fix.  The index
>> will lose all docs in those segments that it removes.
>>
>> Can you describe what led up to this?  Is it repeatable?
>>
>> Mike
>>
>> On Fri, Oct 9, 2009 at 12:37 AM, Max Lynch <ih...@gmail.com> wrote:
>> > Missed your response, thanks Bernd.
>> >
>> > I don't think that's it, since I haven't been executing any commands like
>> > that.  The only thing I could think of is corruption.  I've got the index
>> > backed up in case there is a way to fix it (it won't matter in a week or
>> so
>> > since I cull any documents older than 25 days).
>> >
>> > Is there a way to fix this?
>> >
>> > Thanks.
>> >
>> > On Thu, Oct 8, 2009 at 3:01 AM, Bernd Fondermann <
>> > bernd.fondermann@googlemail.com> wrote:
>> >
>> >> Hi Max
>> >>
>> >> just a guess: maybe you deleted all *.c source files in that area and
>> >> unintentionally deleted this index file, too.
>> >>
>> >>  Bernd
>> >>
>> >> On Fri, Oct 2, 2009 at 17:10, Max Lynch <ih...@gmail.com> wrote:
>> >> > I'm getting this error when I try to run my searcher and my indexer:
>> >> >
>> >> > Traceback (most recent call last):
>> >> > self.searcher = lucene.IndexSearcher(self.directory)
>> >> > JavaError: java.io.FileNotFoundException:
>> >> /home/spider/misc/index/_275c.cfs
>> >> > (No such file or directory)
>> >> >
>> >> > I don't know anything about the format of the Lucene index, but I
>> notice
>> >> I
>> >> > have several _275* files from b to j but no c.
>> >> >
>> >> > Any ideas?
>> >> >
>> >> > Thanks.
>> >> >
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >>
>> >>
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org