solr stops running periodically

[athir nuaimi <at...@nuaim.com>]

> We have 4 machines running solr.  On one of the machines, every 2-3  
> days solr stops running.  By that I mean that the java/tomcat  
> process just disappears.  If I look at the catalina logs, I see  
> normal log entries and then nothing.  There is no shutdown messages  
> like you would normally see if you sent a SIGTERM to the process.
>
> Obviously this is a problem. I''m new to solr/java so if there are  
> more diagnostic things I can do I'd appreciate any tips/advice.
>
> thanks in advance
> Athir

Re: solr stops running periodically

[Otis Gospodnetic <ot...@yahoo.com>]

Look for the HotSpot dump files that Sun's Java leaves on disk when it dies.  I think their names start with "hs".  Luckily, I don't have any of them handy to tell you the exact name pattern.

Otis
--
Sematext is hiring -- http://sematext.com/about/jobs.html?mls
Lucene, Solr, Nutch, Katta, Hadoop, HBase, UIMA, NLP, NER, IR



----- Original Message ----
> From: Grant Ingersoll <gs...@apache.org>
> To: solr-user@lucene.apache.org
> Sent: Sun, November 15, 2009 8:15:47 PM
> Subject: Re: solr stops running periodically
> 
> Have you looked in other logs, like your syslogs?  I've never seen Solr/Tomcat 
> just disappear w/o so much as a blip.  I'd think if a process just died from an 
> error condition there would be some note of it somewhere.  I'd try to find some 
> other events taking place at that time which might give a hint.
> 
> On Nov 15, 2009, at 1:45 PM, athir nuaimi wrote:
> 
> >> We have 4 machines running solr.  On one of the machines, every 2-3 days solr 
> stops running.  By that I mean that the java/tomcat process just disappears.  If 
> I look at the catalina logs, I see normal log entries and then nothing.  There 
> is no shutdown messages like you would normally see if you sent a SIGTERM to the 
> process.
> >> 
> >> Obviously this is a problem. I''m new to solr/java so if there are more 
> diagnostic things I can do I'd appreciate any tips/advice.
> >> 
> >> thanks in advance
> >> Athir
> > 

Re: solr stops running periodically

[Grant Ingersoll <gs...@apache.org>]

Have you looked in other logs, like your syslogs?  I've never seen Solr/Tomcat just disappear w/o so much as a blip.  I'd think if a process just died from an error condition there would be some note of it somewhere.  I'd try to find some other events taking place at that time which might give a hint.

On Nov 15, 2009, at 1:45 PM, athir nuaimi wrote:

>> We have 4 machines running solr.  On one of the machines, every 2-3 days solr stops running.  By that I mean that the java/tomcat process just disappears.  If I look at the catalina logs, I see normal log entries and then nothing.  There is no shutdown messages like you would normally see if you sent a SIGTERM to the process.
>> 
>> Obviously this is a problem. I''m new to solr/java so if there are more diagnostic things I can do I'd appreciate any tips/advice.
>> 
>> thanks in advance
>> Athir
> 

RE: solr stops running periodically

[Fuad Efendi <fu...@efendi.ca>]

> By that I mean that the java/tomcat  
> process just disappears. 


I had similar problem when I started Tomcat via SSH, and then I improperly
closed SSH without "exit" command. 

In some cases (OutOfMemory) memory is not enough to generate log (or CPU can
be overloaded by Garbage Collector to such extent that you will have to wait
few days until LOG will be generated) - but process cant' disappear...

Process can't simply disappear... if it is JVM crash you should see dump
file (you may need to set specific option for JVM to generate dump file in
case of crash)





> -----Original Message-----
> From: athir nuaimi [mailto:athir@nuaim.com]
> Sent: November-15-09 1:46 PM
> To: solr-user@lucene.apache.org
> Subject: solr stops running periodically
> 
> > We have 4 machines running solr.  On one of the machines, every 2-3
> > days solr stops running.  By that I mean that the java/tomcat
> > process just disappears.  If I look at the catalina logs, I see
> > normal log entries and then nothing.  There is no shutdown messages
> > like you would normally see if you sent a SIGTERM to the process.
> >
> > Obviously this is a problem. I''m new to solr/java so if there are
> > more diagnostic things I can do I'd appreciate any tips/advice.
> >
> > thanks in advance
> > Athir