You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Nasseam Elkarra <na...@bodukai.com> on 2009/03/24 19:35:22 UTC
Solr index deletion
On a few occasions, our development server crashed and in the process
solr deleted the index folder. We are suspecting another app on the
server caused an OutOfMemoryException on Tomcat causing all apps
including solr to crash.
So my question is why is solr deleting the index? We are not doing any
updates to the index only reading from it so any insight would be
appreciated.
Thank you,
Nasseam
Re: Solr index deletion
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Hm, you are not saying much about what you've tried. Could it be your Solr home is wrong and not even pointing to the index you just checked?
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
----- Original Message ----
> From: Nasseam Elkarra <na...@bodukai.com>
> To: solr-user@lucene.apache.org
> Sent: Tuesday, March 24, 2009 7:47:08 PM
> Subject: Re: Solr index deletion
>
> The tool says there are no problems. Solr is pointing to the right directory so
> not sure what is preventing it from returning any results. Any ideas? Here is
> the output:
>
> Segments file=segments_2 numSegments=1 version=FORMAT_USER_DATA [Lucene 2.9]
> 1 of 1: name=_0 docCount=18021
> compound=false
> hasProx=true
> numFiles=9
> size (MB)=8.389
> has deletions [delFileName=_0_1.del]
> test: open reader.........OK [18 deleted docs]
> test: fields, norms.......OK [35 fields]
> test: terms, freq, prox...OK [60492 terms; 1157700 terms/docs pairs; 1224063
> tokens]
> test: stored fields.......OK [386828 total field count; avg 21.487 fields
> per doc]
> test: term vectors........OK [0 total vector count; avg 0 term/freq vector
> fields per doc]
>
> No problems were detected with this index.
>
> --
>
> Thanks,
> Nasseam
>
>
> On Mar 24, 2009, at 1:34 PM, Otis Gospodnetic wrote:
>
> >
> > There is, it's called CheckIndex and it is a part of Lucene (and Lucene jars
> that come with Solr, I believe):
> >
> >
> http://lucene.apache.org/java/2_4_1/api/org/apache/lucene/index/CheckIndex.html
> >
> >
> > Otis
> > --
> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> >
> >
> >
> > ----- Original Message ----
> >> From: Nasseam Elkarra
> >> To: solr-user@lucene.apache.org
> >> Sent: Tuesday, March 24, 2009 4:21:50 PM
> >> Subject: Re: Solr index deletion
> >>
> >> Correction: index was not deleted. The folder is still there with the index
> >> files in it but a *:* query returns 0 results. Is there a tool to check the
> >> health of an index?
> >>
> >> Thanks,
> >> Nasseam
> >>
> >> On Mar 24, 2009, at 11:49 AM, Otis Gospodnetic wrote:
> >>
> >>>
> >>> Somehow that sounds very unlikely. Have you looked at logs? What have you
> >> found from Solr there? I am not checking the sources, but I don't think
> there
> >> is any place in Solr where the index directory gets deleted.
> >>>
> >>> Otis
> >>> --
> >>> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> >>>
> >>>
> >>>
> >>> ----- Original Message ----
> >>>> From: Nasseam Elkarra
> >>>> To: solr-user@lucene.apache.org
> >>>> Sent: Tuesday, March 24, 2009 2:35:22 PM
> >>>> Subject: Solr index deletion
> >>>>
> >>>> On a few occasions, our development server crashed and in the process solr
> >>>> deleted the index folder. We are suspecting another app on the server
> caused
> >> an
> >>>> OutOfMemoryException on Tomcat causing all apps including solr to crash.
> >>>>
> >>>> So my question is why is solr deleting the index? We are not doing any
> >> updates
> >>>> to the index only reading from it so any insight would be appreciated.
> >>>>
> >>>> Thank you,
> >>>> Nasseam
> >>>
> >
Re: Solr index deletion
Posted by Nasseam Elkarra <na...@bodukai.com>.
The tool says there are no problems. Solr is pointing to the right
directory so not sure what is preventing it from returning any
results. Any ideas? Here is the output:
Segments file=segments_2 numSegments=1 version=FORMAT_USER_DATA
[Lucene 2.9]
1 of 1: name=_0 docCount=18021
compound=false
hasProx=true
numFiles=9
size (MB)=8.389
has deletions [delFileName=_0_1.del]
test: open reader.........OK [18 deleted docs]
test: fields, norms.......OK [35 fields]
test: terms, freq, prox...OK [60492 terms; 1157700 terms/docs
pairs; 1224063 tokens]
test: stored fields.......OK [386828 total field count; avg
21.487 fields per doc]
test: term vectors........OK [0 total vector count; avg 0 term/
freq vector fields per doc]
No problems were detected with this index.
--
Thanks,
Nasseam
On Mar 24, 2009, at 1:34 PM, Otis Gospodnetic wrote:
>
> There is, it's called CheckIndex and it is a part of Lucene (and
> Lucene jars that come with Solr, I believe):
>
> http://lucene.apache.org/java/2_4_1/api/org/apache/lucene/index/CheckIndex.html
>
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> ----- Original Message ----
>> From: Nasseam Elkarra <na...@bodukai.com>
>> To: solr-user@lucene.apache.org
>> Sent: Tuesday, March 24, 2009 4:21:50 PM
>> Subject: Re: Solr index deletion
>>
>> Correction: index was not deleted. The folder is still there with
>> the index
>> files in it but a *:* query returns 0 results. Is there a tool to
>> check the
>> health of an index?
>>
>> Thanks,
>> Nasseam
>>
>> On Mar 24, 2009, at 11:49 AM, Otis Gospodnetic wrote:
>>
>>>
>>> Somehow that sounds very unlikely. Have you looked at logs? What
>>> have you
>> found from Solr there? I am not checking the sources, but I don't
>> think there
>> is any place in Solr where the index directory gets deleted.
>>>
>>> Otis
>>> --
>>> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>>
>>>
>>>
>>> ----- Original Message ----
>>>> From: Nasseam Elkarra
>>>> To: solr-user@lucene.apache.org
>>>> Sent: Tuesday, March 24, 2009 2:35:22 PM
>>>> Subject: Solr index deletion
>>>>
>>>> On a few occasions, our development server crashed and in the
>>>> process solr
>>>> deleted the index folder. We are suspecting another app on the
>>>> server caused
>> an
>>>> OutOfMemoryException on Tomcat causing all apps including solr to
>>>> crash.
>>>>
>>>> So my question is why is solr deleting the index? We are not
>>>> doing any
>> updates
>>>> to the index only reading from it so any insight would be
>>>> appreciated.
>>>>
>>>> Thank you,
>>>> Nasseam
>>>
>
Re: Solr index deletion
Posted by Otis Gospodnetic <ot...@yahoo.com>.
There is, it's called CheckIndex and it is a part of Lucene (and Lucene jars that come with Solr, I believe):
http://lucene.apache.org/java/2_4_1/api/org/apache/lucene/index/CheckIndex.html
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
----- Original Message ----
> From: Nasseam Elkarra <na...@bodukai.com>
> To: solr-user@lucene.apache.org
> Sent: Tuesday, March 24, 2009 4:21:50 PM
> Subject: Re: Solr index deletion
>
> Correction: index was not deleted. The folder is still there with the index
> files in it but a *:* query returns 0 results. Is there a tool to check the
> health of an index?
>
> Thanks,
> Nasseam
>
> On Mar 24, 2009, at 11:49 AM, Otis Gospodnetic wrote:
>
> >
> > Somehow that sounds very unlikely. Have you looked at logs? What have you
> found from Solr there? I am not checking the sources, but I don't think there
> is any place in Solr where the index directory gets deleted.
> >
> > Otis
> > --
> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> >
> >
> >
> > ----- Original Message ----
> >> From: Nasseam Elkarra
> >> To: solr-user@lucene.apache.org
> >> Sent: Tuesday, March 24, 2009 2:35:22 PM
> >> Subject: Solr index deletion
> >>
> >> On a few occasions, our development server crashed and in the process solr
> >> deleted the index folder. We are suspecting another app on the server caused
> an
> >> OutOfMemoryException on Tomcat causing all apps including solr to crash.
> >>
> >> So my question is why is solr deleting the index? We are not doing any
> updates
> >> to the index only reading from it so any insight would be appreciated.
> >>
> >> Thank you,
> >> Nasseam
> >
Re: Solr index deletion
Posted by Nasseam Elkarra <na...@bodukai.com>.
Correction: index was not deleted. The folder is still there with the
index files in it but a *:* query returns 0 results. Is there a tool
to check the health of an index?
Thanks,
Nasseam
On Mar 24, 2009, at 11:49 AM, Otis Gospodnetic wrote:
>
> Somehow that sounds very unlikely. Have you looked at logs? What
> have you found from Solr there? I am not checking the sources, but
> I don't think there is any place in Solr where the index directory
> gets deleted.
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> ----- Original Message ----
>> From: Nasseam Elkarra <na...@bodukai.com>
>> To: solr-user@lucene.apache.org
>> Sent: Tuesday, March 24, 2009 2:35:22 PM
>> Subject: Solr index deletion
>>
>> On a few occasions, our development server crashed and in the
>> process solr
>> deleted the index folder. We are suspecting another app on the
>> server caused an
>> OutOfMemoryException on Tomcat causing all apps including solr to
>> crash.
>>
>> So my question is why is solr deleting the index? We are not doing
>> any updates
>> to the index only reading from it so any insight would be
>> appreciated.
>>
>> Thank you,
>> Nasseam
>
Re: Solr index deletion
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Somehow that sounds very unlikely. Have you looked at logs? What have you found from Solr there? I am not checking the sources, but I don't think there is any place in Solr where the index directory gets deleted.
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
----- Original Message ----
> From: Nasseam Elkarra <na...@bodukai.com>
> To: solr-user@lucene.apache.org
> Sent: Tuesday, March 24, 2009 2:35:22 PM
> Subject: Solr index deletion
>
> On a few occasions, our development server crashed and in the process solr
> deleted the index folder. We are suspecting another app on the server caused an
> OutOfMemoryException on Tomcat causing all apps including solr to crash.
>
> So my question is why is solr deleting the index? We are not doing any updates
> to the index only reading from it so any insight would be appreciated.
>
> Thank you,
> Nasseam