You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Max Lynch <ih...@gmail.com> on 2009/10/02 17:10:53 UTC
FileNotFoundException on index
I'm getting this error when I try to run my searcher and my indexer:
Traceback (most recent call last):
self.searcher = lucene.IndexSearcher(self.directory)
JavaError: java.io.FileNotFoundException: /home/spider/misc/index/_275c.cfs
(No such file or directory)
I don't know anything about the format of the Lucene index, but I notice I
have several _275* files from b to j but no c.
Any ideas?
Thanks.
Re: FileNotFoundException on index
Posted by Michael McCandless <lu...@mikemccandless.com>.
OK thanks for bringing closure!
Accidentally allowing 2 writers to write to the same index quickly
leads to corruption. They are like the Betta fish: they fight to the
death, removing each others files, if you put them in the same cage.
Mike
On Wed, Dec 9, 2009 at 1:56 AM, Max Lynch <ih...@gmail.com> wrote:
> Hi Mike,
>
> Missed your response on this,
> What I was doing was physically removing index/write.lock if older than 8
> hours, allowing another process of my indexer to run. I realize in
> hindsight that there is no reason why I should be doing this and it was
> really stupid. I think I was under the impression one of my pylucene
> processes was hanging.
>
> On Fri, Oct 9, 2009 at 3:44 AM, Michael McCandless <
> lucene@mikemccandless.com> wrote:
>
>> You can use o.a.l.index.CheckIndex to fix the index. It will remove
>> references to any segments that are missing or have problems during
>> testing. First run it without -fix to see what problems there are.
>> Then take a backup of the index. Then run it with -fix. The index
>> will lose all docs in those segments that it removes.
>>
>> Can you describe what led up to this? Is it repeatable?
>>
>> Mike
>>
>> On Fri, Oct 9, 2009 at 12:37 AM, Max Lynch <ih...@gmail.com> wrote:
>> > Missed your response, thanks Bernd.
>> >
>> > I don't think that's it, since I haven't been executing any commands like
>> > that. The only thing I could think of is corruption. I've got the index
>> > backed up in case there is a way to fix it (it won't matter in a week or
>> so
>> > since I cull any documents older than 25 days).
>> >
>> > Is there a way to fix this?
>> >
>> > Thanks.
>> >
>> > On Thu, Oct 8, 2009 at 3:01 AM, Bernd Fondermann <
>> > bernd.fondermann@googlemail.com> wrote:
>> >
>> >> Hi Max
>> >>
>> >> just a guess: maybe you deleted all *.c source files in that area and
>> >> unintentionally deleted this index file, too.
>> >>
>> >> Bernd
>> >>
>> >> On Fri, Oct 2, 2009 at 17:10, Max Lynch <ih...@gmail.com> wrote:
>> >> > I'm getting this error when I try to run my searcher and my indexer:
>> >> >
>> >> > Traceback (most recent call last):
>> >> > self.searcher = lucene.IndexSearcher(self.directory)
>> >> > JavaError: java.io.FileNotFoundException:
>> >> /home/spider/misc/index/_275c.cfs
>> >> > (No such file or directory)
>> >> >
>> >> > I don't know anything about the format of the Lucene index, but I
>> notice
>> >> I
>> >> > have several _275* files from b to j but no c.
>> >> >
>> >> > Any ideas?
>> >> >
>> >> > Thanks.
>> >> >
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> >> For additional commands, e-mail: java-user-help@lucene.apache.org
>> >>
>> >>
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: FileNotFoundException on index
Posted by Max Lynch <ih...@gmail.com>.
Hi Mike,
Missed your response on this,
What I was doing was physically removing index/write.lock if older than 8
hours, allowing another process of my indexer to run. I realize in
hindsight that there is no reason why I should be doing this and it was
really stupid. I think I was under the impression one of my pylucene
processes was hanging.
On Fri, Oct 9, 2009 at 3:44 AM, Michael McCandless <
lucene@mikemccandless.com> wrote:
> You can use o.a.l.index.CheckIndex to fix the index. It will remove
> references to any segments that are missing or have problems during
> testing. First run it without -fix to see what problems there are.
> Then take a backup of the index. Then run it with -fix. The index
> will lose all docs in those segments that it removes.
>
> Can you describe what led up to this? Is it repeatable?
>
> Mike
>
> On Fri, Oct 9, 2009 at 12:37 AM, Max Lynch <ih...@gmail.com> wrote:
> > Missed your response, thanks Bernd.
> >
> > I don't think that's it, since I haven't been executing any commands like
> > that. The only thing I could think of is corruption. I've got the index
> > backed up in case there is a way to fix it (it won't matter in a week or
> so
> > since I cull any documents older than 25 days).
> >
> > Is there a way to fix this?
> >
> > Thanks.
> >
> > On Thu, Oct 8, 2009 at 3:01 AM, Bernd Fondermann <
> > bernd.fondermann@googlemail.com> wrote:
> >
> >> Hi Max
> >>
> >> just a guess: maybe you deleted all *.c source files in that area and
> >> unintentionally deleted this index file, too.
> >>
> >> Bernd
> >>
> >> On Fri, Oct 2, 2009 at 17:10, Max Lynch <ih...@gmail.com> wrote:
> >> > I'm getting this error when I try to run my searcher and my indexer:
> >> >
> >> > Traceback (most recent call last):
> >> > self.searcher = lucene.IndexSearcher(self.directory)
> >> > JavaError: java.io.FileNotFoundException:
> >> /home/spider/misc/index/_275c.cfs
> >> > (No such file or directory)
> >> >
> >> > I don't know anything about the format of the Lucene index, but I
> notice
> >> I
> >> > have several _275* files from b to j but no c.
> >> >
> >> > Any ideas?
> >> >
> >> > Thanks.
> >> >
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: java-user-help@lucene.apache.org
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
Re: FileNotFoundException on index
Posted by Michael McCandless <lu...@mikemccandless.com>.
You can use o.a.l.index.CheckIndex to fix the index. It will remove
references to any segments that are missing or have problems during
testing. First run it without -fix to see what problems there are.
Then take a backup of the index. Then run it with -fix. The index
will lose all docs in those segments that it removes.
Can you describe what led up to this? Is it repeatable?
Mike
On Fri, Oct 9, 2009 at 12:37 AM, Max Lynch <ih...@gmail.com> wrote:
> Missed your response, thanks Bernd.
>
> I don't think that's it, since I haven't been executing any commands like
> that. The only thing I could think of is corruption. I've got the index
> backed up in case there is a way to fix it (it won't matter in a week or so
> since I cull any documents older than 25 days).
>
> Is there a way to fix this?
>
> Thanks.
>
> On Thu, Oct 8, 2009 at 3:01 AM, Bernd Fondermann <
> bernd.fondermann@googlemail.com> wrote:
>
>> Hi Max
>>
>> just a guess: maybe you deleted all *.c source files in that area and
>> unintentionally deleted this index file, too.
>>
>> Bernd
>>
>> On Fri, Oct 2, 2009 at 17:10, Max Lynch <ih...@gmail.com> wrote:
>> > I'm getting this error when I try to run my searcher and my indexer:
>> >
>> > Traceback (most recent call last):
>> > self.searcher = lucene.IndexSearcher(self.directory)
>> > JavaError: java.io.FileNotFoundException:
>> /home/spider/misc/index/_275c.cfs
>> > (No such file or directory)
>> >
>> > I don't know anything about the format of the Lucene index, but I notice
>> I
>> > have several _275* files from b to j but no c.
>> >
>> > Any ideas?
>> >
>> > Thanks.
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: java-user-help@lucene.apache.org
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org
Re: FileNotFoundException on index
Posted by Max Lynch <ih...@gmail.com>.
Missed your response, thanks Bernd.
I don't think that's it, since I haven't been executing any commands like
that. The only thing I could think of is corruption. I've got the index
backed up in case there is a way to fix it (it won't matter in a week or so
since I cull any documents older than 25 days).
Is there a way to fix this?
Thanks.
On Thu, Oct 8, 2009 at 3:01 AM, Bernd Fondermann <
bernd.fondermann@googlemail.com> wrote:
> Hi Max
>
> just a guess: maybe you deleted all *.c source files in that area and
> unintentionally deleted this index file, too.
>
> Bernd
>
> On Fri, Oct 2, 2009 at 17:10, Max Lynch <ih...@gmail.com> wrote:
> > I'm getting this error when I try to run my searcher and my indexer:
> >
> > Traceback (most recent call last):
> > self.searcher = lucene.IndexSearcher(self.directory)
> > JavaError: java.io.FileNotFoundException:
> /home/spider/misc/index/_275c.cfs
> > (No such file or directory)
> >
> > I don't know anything about the format of the Lucene index, but I notice
> I
> > have several _275* files from b to j but no c.
> >
> > Any ideas?
> >
> > Thanks.
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
> For additional commands, e-mail: java-user-help@lucene.apache.org
>
>
Re: FileNotFoundException on index
Posted by Bernd Fondermann <be...@googlemail.com>.
Hi Max
just a guess: maybe you deleted all *.c source files in that area and
unintentionally deleted this index file, too.
Bernd
On Fri, Oct 2, 2009 at 17:10, Max Lynch <ih...@gmail.com> wrote:
> I'm getting this error when I try to run my searcher and my indexer:
>
> Traceback (most recent call last):
> self.searcher = lucene.IndexSearcher(self.directory)
> JavaError: java.io.FileNotFoundException: /home/spider/misc/index/_275c.cfs
> (No such file or directory)
>
> I don't know anything about the format of the Lucene index, but I notice I
> have several _275* files from b to j but no c.
>
> Any ideas?
>
> Thanks.
>
---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org