You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by kk...@poczta.wp.pl on 2011/04/29 11:57:40 UTC

Tomcat stop responding without any reason

Hello,
Here is the configuration used:
1. MS Windows Server 2003 R2 SP2
2. 4GB RAM
3. Tomcat has set -Xmx to 1G
4. Tomcat 5.5.30
5. This is production environment

The server had been working for a long time quite well but one day it stopped responding (it did not respond on request) with weird logs in jakarta_service.log (see at the bottom).

Unfortunately I do not have information about processor and memory usage from hang moment. What these weird *s mean in the log? Is it the root cause of the issue. Moreover there are no additional messages in other Tomcat and application logs recorded.


jakarta_service.log content:
[2011-04-26 09:25:02] [info] Commons Daemon procrun (1.0.2.0) started
[2011-04-26 09:25:02] [info] Running Service...
[2011-04-26 09:25:17] [info] Starting service...
[2011-04-26 09:25:24] [info] Service started in 6500 ms.
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:24:25] [info] *s
[2011-04-28 10:26:46] [info] *s
[2011-04-28 10:27:20] [info] *s
[2011-04-28 10:27:20] [info] *s
[2011-04-28 10:27:20] [info] *s
[2011-04-28 10:27:20] [info] *s
[2011-04-28 10:27:52] [info] *s
[2011-04-28 10:27:52] [info] *s
[2011-04-28 10:27:52] [info] *s
[2011-04-28 10:27:52] [info] *s
[2011-04-28 10:28:26] [info] *s
[2011-04-28 10:28:26] [info] *s
[2011-04-28 10:28:26] [info] *s
[2011-04-28 10:28:26] [info] *s
[2011-04-28 10:28:57] [info] *s
[2011-04-28 10:28:57] [info] *s
[2011-04-28 10:29:29] [info] *s
[2011-04-28 10:29:29] [info] *s
[2011-04-28 10:30:05] [info] *s
[2011-04-28 10:30:05] [info] *s
[2011-04-28 10:30:41] [info] *s
[2011-04-28 10:30:41] [info] *s
[2011-04-28 10:31:24] [info] *s
[2011-04-28 10:31:24] [info] *s
[2011-04-28 10:31:58] [info] *s
[2011-04-28 10:31:58] [info] *s
[2011-04-28 10:32:35] [info] *s
[2011-04-28 10:32:35] [info] *s
[2011-04-28 10:33:13] [info] *s
[2011-04-28 10:33:13] [info] *s
[2011-04-28 10:33:50] [info] *s
[2011-04-28 10:33:50] [info] *s
[2011-04-28 10:34:29] [info] *s
[2011-04-28 10:34:29] [info] *s
[2011-04-28 10:35:06] [info] *s
[2011-04-28 10:35:06] [info] *s
[2011-04-28 10:35:46] [info] *s
[2011-04-28 10:35:46] [info] *s
[2011-04-28 10:36:25] [info] *s
[2011-04-28 10:36:25] [info] *s
[2011-04-28 10:37:04] [info] *s
[2011-04-28 10:37:04] [info] *s
[2011-04-28 10:37:45] [info] *s
[2011-04-28 10:37:45] [info] *s
[2011-04-28 10:38:26] [info] *s
[2011-04-28 10:38:26] [info] *s
[2011-04-28 10:39:06] [info] *s
[2011-04-28 10:39:06] [info] *s
[2011-04-28 10:39:43] [info] *s
[2011-04-28 10:39:43] [info] *s
[2011-04-28 10:40:22] [info] Stopping service...
[2011-04-28 10:40:22] [info] *s
[2011-04-28 10:40:22] [info] *s
[2011-04-28 10:41:01] [info] *s
[2011-04-28 10:41:01] [info] *s




---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: Tomcat stop responding without any reason

Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

kkazmierczyk,

On 4/30/2011 5:10 PM, kkazmierczyk@poczta.wp.pl wrote:
> I know what I can do in the future to diagnose it (gather thread
> dumps). The Java used is IBM JRE 5.0.
> 
> Do you know what is the root cause of weird logs in
> jakarta_service.log (many following lines: [2011-04-28 10:24:25]
> [info] *s)?

I wonder if that is a bug that has been fixed in commons-daemon. Would
it be possible to upgrade? You are using 1.0.2.0 and it looks like
latest is 1.0.5. I would carefully read all the changelog documentation
(I couldn't find a changelog on commons-daemon site, unfortunately) to
make sure it will be compatible: the 1.0.6 RELEASE-NOTES.txt file says
that it is compatible with the 1.0.3 release... that probably means that
there were some incompatible changes made with that 1.0.3 release that
may be important to your environment.

- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk2+wZYACgkQ9CaO5/Lv0PAySACfWcn59Y3lBwJsPKpQwg3yfG8F
vx8Ani9pfFLbNkWwnEP+qsxY1SuiHloM
=6WNN
-----END PGP SIGNATURE-----

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: Tomcat stop responding without any reason

Posted by kk...@poczta.wp.pl.
Dnia 29-04-2011 o godz. 12:36 Konstantin Kolinko napisał(a):
> 2011/4/29  <kk...@poczta.wp.pl>:
> > Hello,
> > Here is the configuration used:
> > 1. MS Windows Server 2003 R2 SP2
> > 2. 4GB RAM
> > 3. Tomcat has set -Xmx to 1G
> > 4. Tomcat 5.5.30
> > 5. This is production environment
> >
> > The server had been working for a long time quite well but one day it 
> stopped responding (it did not respond on request) with weird logs in 
> jakarta_service.log (see at the bottom).
> >
> > Unfortunately I do not have information about processor and memory usage 
> from hang moment. What these weird *s mean in the log? Is it the root 
> cause of the issue. Moreover there are no additional messages in other 
> Tomcat and application logs recorded.
> >
> 
> Take 3 thread dumps in a row, several seconds apart. It should show
> what Tomcat is actually doing at the moment. See FAQ on how to make a
> thread dump:
> 
> http://wiki.apache.org/tomcat/HowTo#How_do_I_obtain_a_thread_dump_of_my_running_webapp_.3F
> 
> BTW, usual causes of hangs are
> 
> a) OutOfMemoryError, including out of memory in PermGen  In the latter
> case Tomcat cannot load any new classes. PermGen can be exhausted if
> you have redeployed or restarted a webapp many times without
> restarting the server if there is a "PermGen" memory leak.
> 
> b) waiting on a resource, e.g. unlimited waiting-for-connection
> timeout on a database pool (maxWait) -- if all Connector threads are
> waiting you won't be able to connect anymore
> c) deadlocks (bugs)
> 
> b), c) can be seen in the thread dumps
> 
> 
> What is your Java version?
> 
> Best regards,
> Konstantin Kolinko
> 



Hello,
Thank you Konstantin for fast reply!
I know what I can do in the future to diagnose it (gather thread dumps). The Java used is IBM JRE 5.0.

Do you know what is the root cause of weird logs in jakarta_service.log (many following lines: [2011-04-28 10:24:25] [info] *s)?



---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: Tomcat stop responding without any reason

Posted by Konstantin Kolinko <kn...@gmail.com>.
2011/4/29  <kk...@poczta.wp.pl>:
> Hello,
> Here is the configuration used:
> 1. MS Windows Server 2003 R2 SP2
> 2. 4GB RAM
> 3. Tomcat has set -Xmx to 1G
> 4. Tomcat 5.5.30
> 5. This is production environment
>
> The server had been working for a long time quite well but one day it stopped responding (it did not respond on request) with weird logs in jakarta_service.log (see at the bottom).
>
> Unfortunately I do not have information about processor and memory usage from hang moment. What these weird *s mean in the log? Is it the root cause of the issue. Moreover there are no additional messages in other Tomcat and application logs recorded.
>

Take 3 thread dumps in a row, several seconds apart. It should show
what Tomcat is actually doing at the moment. See FAQ on how to make a
thread dump:

http://wiki.apache.org/tomcat/HowTo#How_do_I_obtain_a_thread_dump_of_my_running_webapp_.3F

BTW, usual causes of hangs are

a) OutOfMemoryError, including out of memory in PermGen  In the latter
case Tomcat cannot load any new classes. PermGen can be exhausted if
you have redeployed or restarted a webapp many times without
restarting the server if there is a "PermGen" memory leak.

b) waiting on a resource, e.g. unlimited waiting-for-connection
timeout on a database pool (maxWait) -- if all Connector threads are
waiting you won't be able to connect anymore
c) deadlocks (bugs)

b), c) can be seen in the thread dumps


What is your Java version?

Best regards,
Konstantin Kolinko

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


RE: Tomcat stop responding without any reason

Posted by Martin Gainty <mg...@hotmail.com>.
startup problems *usually occur* if you have a misconfiguration in your server.xml or perhaps context.xml for your ROOT webapp
we could provide greater assistance if you could you display both server.xml and context.xml declarators to group

Dziękuję
Martin 
______________________________________________ 
Jogi és Bizalmassági kinyilatkoztatás/Verzicht und Vertraulichkeitanmerkung/Note de déni et de confidentialité
 Ez az
üzenet bizalmas.  Ha nem ön az akinek szánva volt, akkor kérjük, hogy
jelentse azt nekünk vissza. Semmiféle továbbítása vagy másolatának
készítése nem megengedett.  Ez az üzenet csak ismeret cserét szolgál és
semmiféle jogi alkalmazhatósága sincs.  Mivel az electronikus üzenetek
könnyen megváltoztathatóak, ezért minket semmi felelöség nem terhelhet
ezen üzenet tartalma miatt.

Diese Nachricht ist vertraulich. Sollten Sie nicht der vorgesehene Empfaenger sein, so bitten wir hoeflich um eine Mitteilung. Jede unbefugte Weiterleitung oder Fertigung einer Kopie ist unzulaessig. Diese Nachricht dient lediglich dem Austausch von Informationen und entfaltet keine rechtliche Bindungswirkung. Aufgrund der leichten Manipulierbarkeit von E-Mails koennen wir keine Haftung fuer den Inhalt uebernehmen.
Ce message est confidentiel et peut être privilégié. Si vous n'êtes pas le destinataire prévu, nous te demandons avec bonté que pour satisfaire informez l'expéditeur. N'importe quelle diffusion non autorisée ou la copie de ceci est interdite. Ce message sert à l'information seulement et n'aura pas n'importe quel effet légalement obligatoire. Étant donné que les email peuvent facilement être sujets à la manipulation, nous ne pouvons accepter aucune responsabilité pour le contenu fourni.




> Date: Fri, 29 Apr 2011 11:57:40 +0200
> From: kkazmierczyk@poczta.wp.pl
> To: users@tomcat.apache.org
> Subject: Tomcat stop responding without any reason
> 
> Hello,
> Here is the configuration used:
> 1. MS Windows Server 2003 R2 SP2
> 2. 4GB RAM
> 3. Tomcat has set -Xmx to 1G
> 4. Tomcat 5.5.30
> 5. This is production environment
> 
> The server had been working for a long time quite well but one day it stopped responding (it did not respond on request) with weird logs in jakarta_service.log (see at the bottom).
> 
> Unfortunately I do not have information about processor and memory usage from hang moment. What these weird *s mean in the log? Is it the root cause of the issue. Moreover there are no additional messages in other Tomcat and application logs recorded.
> 
> 
> jakarta_service.log content:
> [2011-04-26 09:25:02] [info] Commons Daemon procrun (1.0.2.0) started
> [2011-04-26 09:25:02] [info] Running Service...
> [2011-04-26 09:25:17] [info] Starting service...
> [2011-04-26 09:25:24] [info] Service started in 6500 ms.
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:24:25] [info] *s
> [2011-04-28 10:26:46] [info] *s
> [2011-04-28 10:27:20] [info] *s
> [2011-04-28 10:27:20] [info] *s
> [2011-04-28 10:27:20] [info] *s
> [2011-04-28 10:27:20] [info] *s
> [2011-04-28 10:27:52] [info] *s
> [2011-04-28 10:27:52] [info] *s
> [2011-04-28 10:27:52] [info] *s
> [2011-04-28 10:27:52] [info] *s
> [2011-04-28 10:28:26] [info] *s
> [2011-04-28 10:28:26] [info] *s
> [2011-04-28 10:28:26] [info] *s
> [2011-04-28 10:28:26] [info] *s
> [2011-04-28 10:28:57] [info] *s
> [2011-04-28 10:28:57] [info] *s
> [2011-04-28 10:29:29] [info] *s
> [2011-04-28 10:29:29] [info] *s
> [2011-04-28 10:30:05] [info] *s
> [2011-04-28 10:30:05] [info] *s
> [2011-04-28 10:30:41] [info] *s
> [2011-04-28 10:30:41] [info] *s
> [2011-04-28 10:31:24] [info] *s
> [2011-04-28 10:31:24] [info] *s
> [2011-04-28 10:31:58] [info] *s
> [2011-04-28 10:31:58] [info] *s
> [2011-04-28 10:32:35] [info] *s
> [2011-04-28 10:32:35] [info] *s
> [2011-04-28 10:33:13] [info] *s
> [2011-04-28 10:33:13] [info] *s
> [2011-04-28 10:33:50] [info] *s
> [2011-04-28 10:33:50] [info] *s
> [2011-04-28 10:34:29] [info] *s
> [2011-04-28 10:34:29] [info] *s
> [2011-04-28 10:35:06] [info] *s
> [2011-04-28 10:35:06] [info] *s
> [2011-04-28 10:35:46] [info] *s
> [2011-04-28 10:35:46] [info] *s
> [2011-04-28 10:36:25] [info] *s
> [2011-04-28 10:36:25] [info] *s
> [2011-04-28 10:37:04] [info] *s
> [2011-04-28 10:37:04] [info] *s
> [2011-04-28 10:37:45] [info] *s
> [2011-04-28 10:37:45] [info] *s
> [2011-04-28 10:38:26] [info] *s
> [2011-04-28 10:38:26] [info] *s
> [2011-04-28 10:39:06] [info] *s
> [2011-04-28 10:39:06] [info] *s
> [2011-04-28 10:39:43] [info] *s
> [2011-04-28 10:39:43] [info] *s
> [2011-04-28 10:40:22] [info] Stopping service...
> [2011-04-28 10:40:22] [info] *s
> [2011-04-28 10:40:22] [info] *s
> [2011-04-28 10:41:01] [info] *s
> [2011-04-28 10:41:01] [info] *s
> 
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>