Tomcat freezes one or more times a day

[Reinier Kip <rk...@reprovinci.nl>]

Tomcat freezes one or more times a day. It may be related to the
reloading (in Tomcat's manager) of the Solr application. Searching the
internet led me to the conclusion that this might be due to garbage
collection. I was advised to enable more detailed logging of garbage
collection with '-verbose:gc'. Tomcat's JAVA_OPTS currently looks like
this.

 

JAVA_OPTS="-Djava.awt.headless=true -Xmx128m -XX:+UseConcMarkSweepGC
-verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails"

 

This morning it froze again, you can find the log since the first
request today - after which Tomcat froze - at
http://pastebin.com/yVGmAjK8 <http://pastebin.com/yVGmAjK8> . I do not
know when the GC would have stopped, as the server was restarted after
three minutes (an unacceptable long downtime).

 

Does anyone have a clue as to what is going on here?

 

Reinier

Re: Tomcat freezes one or more times a day

[Markus Jelsma <ma...@openindex.io>]

> > Part Solr log part GC log? Strange.
> 
> The log is catalina.out. Solr requests are apparently logged into this
> file, as are Tomcat's garbage collections (-verbose:gc).

Ah yes. You can store GC log in a separate file. Makes life easier.

> 
> > Anyway, your permgen is full, do not reload Solr in Tomcat as it, by
> 
> default, does not free previous permgen space.
> 
> Thank you, I reload the Solr application to reload the schema, but a
> quick search suggested I use the core admin
> (http://wiki.apache.org/solr/CoreAdmin#RELOAD) to reload the schema.

Try increasing permgen space. It's full according to the logs. It should be at 
least 32M but you're safe at 64M.

> 
> 
> 
> -----Oorspronkelijk bericht-----
> Van: Markus Jelsma [mailto:markus.jelsma@openindex.io]
> Verzonden: maandag 22 augustus 2011 10:44
> Aan: solr-user@lucene.apache.org
> CC: Reinier Kip
> Onderwerp: Re: Tomcat freezes one or more times a day
> 
> > Tomcat freezes one or more times a day. It may be related to the
> > reloading (in Tomcat's manager) of the Solr application. Searching the
> > 
> > internet led me to the conclusion that this might be due to garbage
> > collection. I was advised to enable more detailed logging of garbage
> > collection with '-verbose:gc'. Tomcat's JAVA_OPTS currently looks like
> > 
> > this.
> > 
> > 
> > 
> > JAVA_OPTS="-Djava.awt.headless=true -Xmx128m -XX:+UseConcMarkSweepGC
> > -verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails"
> > 
> > 
> > 
> > This morning it froze again, you can find the log since the first
> > request today - after which Tomcat froze - at
> > http://pastebin.com/yVGmAjK8 <http://pastebin.com/yVGmAjK8> . I do not
> > 
> > know when the GC would have stopped, as the server was restarted after
> > 
> > three minutes (an unacceptable long downtime).
> 
> Part Solr log part GC log? Strange. Anyway, your permgen is full, do not
> reload Solr in Tomcat as it, by default, does not free previous permgen
> space.
> 
> > Does anyone have a clue as to what is going on here?
> > 
> > 
> > 
> > Reinier

RE: Tomcat freezes one or more times a day

[Reinier Kip <rk...@reprovinci.nl>]

> Part Solr log part GC log? Strange.

The log is catalina.out. Solr requests are apparently logged into this
file, as are Tomcat's garbage collections (-verbose:gc).

> Anyway, your permgen is full, do not reload Solr in Tomcat as it, by
default, does not free previous permgen space.

Thank you, I reload the Solr application to reload the schema, but a
quick search suggested I use the core admin
(http://wiki.apache.org/solr/CoreAdmin#RELOAD) to reload the schema.



-----Oorspronkelijk bericht-----
Van: Markus Jelsma [mailto:markus.jelsma@openindex.io] 
Verzonden: maandag 22 augustus 2011 10:44
Aan: solr-user@lucene.apache.org
CC: Reinier Kip
Onderwerp: Re: Tomcat freezes one or more times a day


> Tomcat freezes one or more times a day. It may be related to the 
> reloading (in Tomcat's manager) of the Solr application. Searching the

> internet led me to the conclusion that this might be due to garbage 
> collection. I was advised to enable more detailed logging of garbage 
> collection with '-verbose:gc'. Tomcat's JAVA_OPTS currently looks like

> this.
> 
> 
> 
> JAVA_OPTS="-Djava.awt.headless=true -Xmx128m -XX:+UseConcMarkSweepGC 
> -verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails"
> 
> 
> 
> This morning it froze again, you can find the log since the first 
> request today - after which Tomcat froze - at
> http://pastebin.com/yVGmAjK8 <http://pastebin.com/yVGmAjK8> . I do not

> know when the GC would have stopped, as the server was restarted after

> three minutes (an unacceptable long downtime).

Part Solr log part GC log? Strange. Anyway, your permgen is full, do not
reload Solr in Tomcat as it, by default, does not free previous permgen
space. 

> 
> 
> 
> Does anyone have a clue as to what is going on here?
> 
> 
> 
> Reinier

Re: Tomcat freezes one or more times a day

[Markus Jelsma <ma...@openindex.io>]

> Tomcat freezes one or more times a day. It may be related to the
> reloading (in Tomcat's manager) of the Solr application. Searching the
> internet led me to the conclusion that this might be due to garbage
> collection. I was advised to enable more detailed logging of garbage
> collection with '-verbose:gc'. Tomcat's JAVA_OPTS currently looks like
> this.
> 
> 
> 
> JAVA_OPTS="-Djava.awt.headless=true -Xmx128m -XX:+UseConcMarkSweepGC
> -verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails"
> 
> 
> 
> This morning it froze again, you can find the log since the first
> request today - after which Tomcat froze - at
> http://pastebin.com/yVGmAjK8 <http://pastebin.com/yVGmAjK8> . I do not
> know when the GC would have stopped, as the server was restarted after
> three minutes (an unacceptable long downtime).

Part Solr log part GC log? Strange. Anyway, your permgen is full, do not 
reload Solr in Tomcat as it, by default, does not free previous permgen space. 

> 
> 
> 
> Does anyone have a clue as to what is going on here?
> 
> 
> 
> Reinier