You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by francis picabia <fp...@gmail.com> on 2012/07/06 18:52:58 UTC
High load from tomcat, no users, no errors
Hello,
I have two servers with Debian 6 and an older tomcat 5.0.30
Starting only recently, each has taken a sudden leap in load.
There is no traffic hitting it, as I can confirm using lsof.
One server had a load of nearly 0 and at midnight jumped
to 10 and stayed that way until the next day. Nothing has
changed in the tomcat apps, but the Debian OS has
likely had some security updates, such as for mysql
library.
I found some small glitches in orphaned apps and deleted
them so I now have a clean start up - no errors.
The server which was at load of 10 now shows reasonable
load average, but tomcat is still running hot for a service
getting no hits:
top - 13:41:38 up 30 days, 6:21, 2 users, load average: 0.00, 0.00, 0.00
Tasks: 263 total, 2 running, 261 sleeping, 0 stopped, 0 zombie
Cpu(s): 4.7%us, 4.4%sy, 0.0%ni, 90.3%id, 0.0%wa, 0.0%hi, 0.5%si, 0.0%st
Mem: 16461112k total, 16335376k used, 125736k free, 549972k buffers
Swap: 3906552k total, 0k used, 3906552k free, 14871648k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
23648 tomcat 20 0 4623m 203m 10m S 109 1.3 284:04.69 java
On the second server, it also has a clean start up, but the load average
is about 6. In that case it uses the mysql connector. I experimented
with the current mysql java driver from the Debian package copied into the
tomcat 5.0.30 common/lib, but it made no difference either way.
I should add that the tomcat apps all appear to work, but we are
simply seeing a very high load.
On stackexchange, someone suggested a kill -3 will be a poor man's profiler
to reveal what is tying up CPU time.
I've looked at the dump, and I don't see anything pinpointed by
this method. I noticed a couple of lines mentioning lock, but I don't
know what it might mean.
If anyone can suggest what I can do next, it would be appreciated.
I end this email with the dump from kill -3...
2012-07-06 13:24:12
Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.1-b02 mixed mode):
"TP-Processor8" daemon prio=10 tid=0x0000000040432000 nid=0x5ca0 in
Object.wait() [0x00007f18330ef000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007ac546728> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007ac546728> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"TP-Processor7" daemon prio=10 tid=0x0000000040803000 nid=0x5c9f in
Object.wait() [0x00007f18331f0000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007ac546318> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007ac546318> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"TP-Processor6" daemon prio=10 tid=0x0000000040430800 nid=0x5c9e in
Object.wait() [0x00007f18332f1000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007ac545f08> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007ac545f08> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"TP-Processor5" daemon prio=10 tid=0x0000000040944000 nid=0x5c9d in
Object.wait() [0x00007f18333f2000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007ac545af8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007ac545af8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"TP-Monitor" daemon prio=10 tid=0x00007f183435e800 nid=0x5c92 in
Object.wait() [0x00007f18334f3000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02d0100> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559)
- locked <0x00000007b02d0100> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at java.lang.Thread.run(Thread.java:662)
"TP-Processor4" daemon prio=10 tid=0x00007f1834256000 nid=0x5c91
runnable [0x00007f18335f4000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
- locked <0x00000007b02e00a0> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.jk.common.ChannelSocket.accept(ChannelSocket.java:295)
at org.apache.jk.common.ChannelSocket.acceptConnections(ChannelSocket.java:638)
at org.apache.jk.common.SocketAcceptor.runIt(ChannelSocket.java:847)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:662)
"TP-Processor3" daemon prio=10 tid=0x00007f18342cb000 nid=0x5c90 in
Object.wait() [0x00007f18336f5000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02e8d68> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02e8d68> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"TP-Processor2" daemon prio=10 tid=0x00007f18342b6800 nid=0x5c8f in
Object.wait() [0x00007f18337f6000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02eb210> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02eb210> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"TP-Processor1" daemon prio=10 tid=0x00007f18342f2000 nid=0x5c8e
runnable [0x00007f18338f7000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
- locked <0x00000007ac54b6c0> (a java.io.BufferedInputStream)
at org.apache.jk.common.ChannelSocket.read(ChannelSocket.java:598)
at org.apache.jk.common.ChannelSocket.receive(ChannelSocket.java:535)
at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:663)
at org.apache.jk.common.SocketConnection.runIt(ChannelSocket.java:866)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Monitor" prio=10 tid=0x00007f1838025000 nid=0x5c8d in
Object.wait() [0x00007f18339f8000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f8070> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:559)
- locked <0x00000007b02f8070> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor25" daemon prio=10 tid=0x00007f1838023000
nid=0x5c8c runnable [0x00007f1833af9000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
- locked <0x00000007b03000a0> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
at org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java:368)
at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:549)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor24" daemon prio=10 tid=0x00007f1838019800
nid=0x5c8b in Object.wait() [0x00007f1833bfa000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02d01a8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02d01a8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor23" daemon prio=10 tid=0x00007f18385f4800
nid=0x5c8a in Object.wait() [0x00007f1833cfb000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f8118> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f8118> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor22" daemon prio=10 tid=0x00007f18385f2800
nid=0x5c89 in Object.wait() [0x00007f1833dfc000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02d0250> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02d0250> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor21" daemon prio=10 tid=0x00007f18385f0800
nid=0x5c88 in Object.wait() [0x00007f1833efd000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02e02c8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02e02c8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor20" daemon prio=10 tid=0x00007f18385ee800
nid=0x5c87 in Object.wait() [0x00007f1833ffe000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f0228> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f0228> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor19" daemon prio=10 tid=0x00007f18385ec800
nid=0x5c86 in Object.wait() [0x00007f1840151000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02e0370> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02e0370> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor18" daemon prio=10 tid=0x00007f18385ea800
nid=0x5c85 in Object.wait() [0x00007f1840252000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f02d0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f02d0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor17" daemon prio=10 tid=0x00007f18385e8800
nid=0x5c84 in Object.wait() [0x00007f1840353000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02e0418> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02e0418> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor16" daemon prio=10 tid=0x00007f18385e7800
nid=0x5c83 in Object.wait() [0x00007f1840454000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f0378> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f0378> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor15" daemon prio=10 tid=0x00007f1838055000
nid=0x5c82 in Object.wait() [0x00007f1840555000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02e04c0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02e04c0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor14" daemon prio=10 tid=0x00007f1838053000
nid=0x5c81 in Object.wait() [0x00007f1840656000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f0420> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f0420> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor13" daemon prio=10 tid=0x00007f1838086800
nid=0x5c80 in Object.wait() [0x00007f1840757000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02e0788> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02e0788> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor12" daemon prio=10 tid=0x00007f1838051000
nid=0x5c7f in Object.wait() [0x00007f1840858000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02e07a8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02e07a8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor11" daemon prio=10 tid=0x00007f183804f800
nid=0x5c7e in Object.wait() [0x00007f1840959000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f1798> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f1798> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor10" daemon prio=10 tid=0x00007f1838043000
nid=0x5c7d in Object.wait() [0x00007f1840a5a000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f1a18> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f1a18> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor9" daemon prio=10 tid=0x00007f1838041000
nid=0x5c7c in Object.wait() [0x00007f1840b5b000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f1c98> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f1c98> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor8" daemon prio=10 tid=0x00007f183803f000
nid=0x5c7b in Object.wait() [0x00007f1840c5c000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f1f10> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f1f10> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor7" daemon prio=10 tid=0x00007f183803d800
nid=0x5c7a in Object.wait() [0x00007f1840d5d000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f2188> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f2188> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor6" daemon prio=10 tid=0x00007f1838008800
nid=0x5c79 in Object.wait() [0x00007f1840e5e000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f2400> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f2400> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor5" daemon prio=10 tid=0x00007f1838034000
nid=0x5c78 in Object.wait() [0x00007f1840f5f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f2678> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f2678> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor4" daemon prio=10 tid=0x00007f1838032000
nid=0x5c77 in Object.wait() [0x00007f1841060000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f28f0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f28f0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor3" daemon prio=10 tid=0x00007f183802d800
nid=0x5c76 in Object.wait() [0x00007f1841161000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f2b68> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f2b68> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor2" daemon prio=10 tid=0x00007f1838018800
nid=0x5c75 in Object.wait() [0x00007f1841262000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f2de0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f2de0> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"http-8080-Processor1" daemon prio=10 tid=0x00007f183802c800
nid=0x5c74 in Object.wait() [0x00007f1841363000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f3058> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Object.wait(Object.java:485)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:656)
- locked <0x00000007b02f3058> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
at java.lang.Thread.run(Thread.java:662)
"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon
prio=10 tid=0x00007f1838123800 nid=0x5c73 sleeping[0x00007f1841464000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1597)
at java.lang.Thread.run(Thread.java:662)
"Low Memory Detector" daemon prio=10 tid=0x00007f183c003800 nid=0x5c70
runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" daemon prio=10 tid=0x00007f183c001000 nid=0x5c6f
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" daemon prio=10 tid=0x00000000403c6000 nid=0x5c6e
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00000000403c3800 nid=0x5c6d
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x00000000403a7000 nid=0x5c6c in
Object.wait() [0x00007f1848430000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b0300498> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x00000007b0300498> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x000000004039f800 nid=0x5c6b
in Object.wait() [0x00007f1848531000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000007b02f0088> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x00000007b02f0088> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x000000004032f000 nid=0x5c61 runnable [0x00007f184e532000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
- locked <0x00000007b0300628> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.catalina.core.StandardServer.await(StandardServer.java:513)
at org.apache.catalina.startup.Catalina.await(Catalina.java:619)
at org.apache.catalina.startup.Catalina.start(Catalina.java:579)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:287)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:425)
"VM Thread" prio=10 tid=0x0000000040399000 nid=0x5c6a runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000040342000
nid=0x5c62 runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000040344000
nid=0x5c63 runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x0000000040346000
nid=0x5c64 runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x0000000040347800
nid=0x5c65 runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x0000000040349800
nid=0x5c66 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x000000004034b800
nid=0x5c67 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x000000004034d000
nid=0x5c68 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x000000004034f000
nid=0x5c69 runnable
"VM Periodic Task Thread" prio=10 tid=0x00007f183c016800 nid=0x5c71
waiting on condition
JNI global references: 1702
Heap
PSYoungGen total 75008K, used 17836K [0x00000007ac400000,
0x00000007b17b0000, 0x0000000800000000)
eden space 64320K, 18% used
[0x00000007ac400000,0x00000007acf81218,0x00000007b02d0000)
from space 10688K, 56% used
[0x00000007b02d0000,0x00000007b08b9e58,0x00000007b0d40000)
to space 10688K, 0% used
[0x00000007b0d40000,0x00000007b0d40000,0x00000007b17b0000)
PSOldGen total 171520K, used 0K [0x0000000704c00000,
0x000000070f380000, 0x00000007ac400000)
object space 171520K, 0% used
[0x0000000704c00000,0x0000000704c00000,0x000000070f380000)
PSPermGen total 21248K, used 16280K [0x00000006ffa00000,
0x0000000700ec0000, 0x0000000704c00000)
object space 21248K, 76% used
[0x00000006ffa00000,0x00000007009e6320,0x0000000700ec0000)
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: High load from tomcat, no users, no errors
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: francis picabia [mailto:fpicabia@gmail.com]
> Subject: Re: High load from tomcat, no users, no errors
> I stop tomcat 5.0.
Good, since it hasn't been supported in quite some time.
> I install the tomcat6 from Debian
What happens if you install a real Tomcat from tomcat.apache.org? The Debian repackaging of Tomcat is well known to be a mess.
If you still see threads looping with a real Tomcat 6 (or preferably, 7), take thread dumps of that and post them.
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: High load from tomcat, no users, no errors
Posted by francis picabia <fp...@gmail.com>.
Here is another thing which is odd...
I stop tomcat 5.0. I install the tomcat6 from Debian and allow it to start
with the default "It works" page. The tomcat load is still unusual:
top - 14:07:12 up 52 days, 6:36, 2 users, load average: 0.00, 0.00, 0.00
Tasks: 154 total, 3 running, 151 sleeping, 0 stopped, 0 zombie
Cpu(s): 13.4%us, 26.2%sy, 0.0%ni, 59.9%id, 0.0%wa, 0.0%hi, 0.4%si, 0.0%st
Mem: 6128864k total, 5368868k used, 759996k free, 771176k buffers
Swap: 2506100k total, 9156k used, 2496944k free, 3333764k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
6953 tomcat6 20 0 611m 71m 9.9m S 149 1.2 10:03.66 java
I do the same on my Debian desktop, and I need to search for user tomcat6
before I can notice it from top:
top - 14:08:05 up 45 days, 5:30, 76 users, load average: 0.00, 0.06, 0.03
Tasks: 353 total, 1 running, 351 sleeping, 0 stopped, 1 zombie
Cpu(s): 9.1%us, 1.8%sy, 0.0%ni, 88.5%id, 0.7%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 3372892k total, 3272292k used, 100600k free, 83004k buffers
Swap: 2650684k total, 53928k used, 2596756k free, 1639576k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
14634 tomcat6 20 0 292m 54m 8092 S 0 1.7 0:02.18 java
Both are running a default install of tomcat6 on Debian, as configured by
default.
I don't get it.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: High load from tomcat, no users, no errors
Posted by "Mark H. Wood" <mw...@IUPUI.Edu>.
Not just Debian; I had several Gentoo boxes get into this state.
--
Mark H. Wood, Lead System Programmer mwood@IUPUI.Edu
Asking whether markets are efficient is like asking whether people are smart.
Re: High load from tomcat, no users, no errors
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Peter,
On 7/6/12 2:43 PM, Peter Balogh wrote:
> Is that a debian based system? Isn't it a leap second related
> issue? Do you have ntp installed? Did you restart the machine since
> saturday?
"That's just insane", I thought. Until I checked-out my servers: one
of them had about a 6.00 load average and is mainly idle.
A quick Google[1] and I was able to fix my box:
$ sudo date -s now
Done.
Crazy.
- -chris
[1]
http://serverfault.com/questions/403732/anyone-else-experiencing-high-rates-of-linux-server-crashes-during-a-leap-second
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAk/3hBoACgkQ9CaO5/Lv0PDi3QCfcAg1frnmSwnpDr9pifVNw7zo
8scAoLFD4sqwEt/3JLzQTr6WVbAK3ARU
=cmc1
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: High load from tomcat, no users, no errors
Posted by francis picabia <fp...@gmail.com>.
On Fri, Jul 6, 2012 at 3:43 PM, Peter Balogh <pe...@nemesys.hu> wrote:
> Hi,
>
> Is that a debian based system? Isn't it a leap second related issue?
> Do you have ntp installed? Did you restart the machine since saturday?
>
> Just my ideas
I think you have the solution there.
I knew about the leap second but had not seen any issues.
I do have ntp installed and running.
I rebooted one server with the problem and it came back up
with normal low load on tomcat - this with tomcat 5. So it
seems there was some delayed issue with the leap second
or something like that.
Anyway problem resolved...
Thanks...
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: High load from tomcat, no users, no errors
Posted by Peter Balogh <pe...@nemesys.hu>.
Hi,
Is that a debian based system? Isn't it a leap second related issue?
Do you have ntp installed? Did you restart the machine since saturday?
Just my ideas
Best regards,
Peter Balogh
On 2012.07.06. 20:35, Caldarale, Charles R wrote:
> Hi,
>
> Is that a debian based system? Isn't it a leap second related issue?
> Do you have ntp installed? Did you restart the machine since saturday?
>
> Just my ideas:)
>
> Best regards,
> Peter Balogh
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: High load from tomcat, no users, no errors
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: francis picabia [mailto:fpicabia@gmail.com]
> Subject: Re: High load from tomcat, no users, no errors
> firewall is blocking 8080 and apache is off.
By "apache" do you mean httpd? Tomcat is also an Apache product.
> tomcat 7.0.28 from tarball install is running
> as user tomcat.
The tarball from tomcat.apache.org? Or somewhere else?
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 9866 tomcat 20 0 2000m 81m 9.8m S 283 1.4 9:37.85 java
> Here is the thread dump - is there anything interesting here?
No - everything is idle, waiting for something to do. As Chris suggested, you may well have another Tomcat process running that is eating up 2 - 3 cores. Or perhaps you have webapps deployed with native code, which won't show up in a Java thread dump.
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: High load from tomcat, no users, no errors
Posted by francis picabia <fp...@gmail.com>.
Here is a new scenario:
firewall is blocking 8080 and apache is off.
tomcat 7.0.28 from tarball install is running
as user tomcat.
Load is about 6. It never comes down
after some 5 minutes or so. Again, this
is simply the tarball install, with no configuration.
Here is the top of top:
top - 15:13:58 up 52 days, 7:43, 2 users, load average: 6.35, 4.48, 2.18
Tasks: 141 total, 2 running, 139 sleeping, 0 stopped, 0 zombie
Cpu(s): 43.1%us, 55.0%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 1.9%si, 0.0%st
Mem: 6128864k total, 5197444k used, 931420k free, 772404k buffers
Swap: 2506100k total, 9156k used, 2496944k free, 3360572k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
9866 tomcat 20 0 2000m 81m 9.8m S 283 1.4 9:37.85 java
13 root 20 0 0 0 0 S 32 0.0
1940:37 ksoftirqd/3
7 root 20 0 0 0 0 S 31 0.0
1957:11 ksoftirqd/1
10 root 20 0 0 0 0 R 30 0.0
1956:46 ksoftirqd/2
4 root 20 0 0 0 0 S 23 0.0
1943:29 ksoftirqd/0
2269 snmp 20 0 43696 3256 1428 S 0 0.1 19:48.97 snmpd
6273 postgres 20 0 170m 3136 292 S 0 0.1 72:54.91 postgres
1 root 20 0 8356 676 632 S 0 0.0 0:23.98 init
Here is the thread dump - is there anything interesting here?
INFO: Server startup in 685 ms
2012-07-06 15:18:13
Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.1-b02 mixed mode):
"ajp-bio-8009-AsyncTimeout" daemon prio=10 tid=0x00007f494c079800
nid=0x26a0 sleeping[0x00007f495c9f7000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:148)
at java.lang.Thread.run(Thread.java:662)
"ajp-bio-8009-Acceptor-0" daemon prio=10 tid=0x00007f494c090000
nid=0x269f runnable [0x00007f495caf8000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
- locked <0x00000000e24a6dc8> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
at java.lang.Thread.run(Thread.java:662)
"http-bio-8080-AsyncTimeout" daemon prio=10 tid=0x00007f494c08e800
nid=0x269e sleeping[0x00007f495cbf9000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:148)
at java.lang.Thread.run(Thread.java:662)
"http-bio-8080-Acceptor-0" daemon prio=10 tid=0x00007f494c0a7000
nid=0x269d runnable [0x00007f495ccfa000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
- locked <0x00000000e24ba4b0> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
at org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:216)
at java.lang.Thread.run(Thread.java:662)
"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon
prio=10 tid=0x00007f4958972800 nid=0x269c waiting on condition
[0x00007f495cdfb000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1544)
at java.lang.Thread.run(Thread.java:662)
"GC Daemon" daemon prio=10 tid=0x00007f494c009000 nid=0x2698 in
Object.wait() [0x00007f495d21f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000e2430070> (a sun.misc.GC$LatencyLock)
at sun.misc.GC$Daemon.run(GC.java:100)
- locked <0x00000000e2430070> (a sun.misc.GC$LatencyLock)
"Low Memory Detector" daemon prio=10 tid=0x00007f4958023800 nid=0x2696
runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" daemon prio=10 tid=0x00007f4958020800 nid=0x2695
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" daemon prio=10 tid=0x00007f495801d800 nid=0x2694
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00007f495801b800 nid=0x2693
waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x00000000414e8800 nid=0x2692 in
Object.wait() [0x00007f495d97e000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000e24303c8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x00000000e24303c8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x00000000414e6800 nid=0x2691
in Object.wait() [0x00007f495da7f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000e2420120> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x00000000e2420120> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x0000000041482000 nid=0x268b runnable [0x00007f4962630000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
- locked <0x00000000e1c20158> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:462)
at java.net.ServerSocket.accept(ServerSocket.java:430)
at org.apache.catalina.core.StandardServer.await(StandardServer.java:452)
at org.apache.catalina.startup.Catalina.await(Catalina.java:757)
at org.apache.catalina.startup.Catalina.start(Catalina.java:703)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:322)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:451)
"VM Thread" prio=10 tid=0x00000000414e0000 nid=0x2690 runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000041495000
nid=0x268c runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000041497000
nid=0x268d runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x0000000041498800
nid=0x268e runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x000000004149a800
nid=0x268f runnable
"VM Periodic Task Thread" prio=10 tid=0x0000000041502800 nid=0x2697
waiting on condition
JNI global references: 948
Heap
PSYoungGen total 27968K, used 19601K [0x00000000e0cb0000,
0x00000000e2be0000, 0x0000000100000000)
eden space 24000K, 68% used
[0x00000000e0cb0000,0x00000000e1cbd4e0,0x00000000e2420000)
from space 3968K, 79% used
[0x00000000e2420000,0x00000000e2737060,0x00000000e2800000)
to space 3968K, 0% used
[0x00000000e2800000,0x00000000e2800000,0x00000000e2be0000)
PSOldGen total 63872K, used 0K [0x00000000a2600000,
0x00000000a6460000, 0x00000000e0cb0000)
object space 63872K, 0% used
[0x00000000a2600000,0x00000000a2600000,0x00000000a6460000)
PSPermGen total 21248K, used 15507K [0x000000009d400000,
0x000000009e8c0000, 0x00000000a2600000)
object space 21248K, 72% used
[0x000000009d400000,0x000000009e324d28,0x000000009e8c0000)
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: High load from tomcat, no users, no errors
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Francis,
On 7/6/12 12:52 PM, francis picabia wrote:
> I have two servers with Debian 6 and an older tomcat 5.0.30
Echoing Chuck's comments: upgrade. You are almost 4 major releases behind.
> top - 13:41:38 up 30 days, 6:21, 2 users, load average: 0.00,
> 0.00, 0.00
Load average: 0.00 0.00 0.00
High load?
Note that your OS may or may not count individual threads as processes
for the purposes of computing the load average (which, on Linux, is
the average length of the run queue in number-of-processes). If your
kernel doesn't count threads separately, then you can have an
effective load of, say, 100, even though your load average only says
1.00 (because it's all counted as one process). Just be sure you know
what your numbers mean.
> Tasks: 263 total, 2 running, 261 sleeping, 0 stopped, 0
> zombie Cpu(s): 4.7%us, 4.4%sy, 0.0%ni, 90.3%id, 0.0%wa,
> 0.0%hi, 0.5%si, 0.0%st Mem: 16461112k total, 16335376k used,
> 125736k free, 549972k buffers Swap: 3906552k total, 0k
> used, 3906552k free, 14871648k cached
CPU(s) is(are) 90% idle. High load? Looks like even user/system use
which suggests that at least something is being accomplished.
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 23648 tomcat 20 0 4623m 203m 10m S 109 1.3 284:04.69 java
109% of your CPU suggests that more than one CPU is in use: how many
do you have?
> I should add that the tomcat apps all appear to work, but we are
> simply seeing a very high load.
You mean lots of apparent CPU usage.
> "TP-Processor1" daemon prio=10 tid=0x00007f18342f2000 nid=0x5c8e
> runnable [0x00007f18338f7000] java.lang.Thread.State: RUNNABLE at
> java.net.SocketInputStream.socketRead0(Native Method) at
> java.net.SocketInputStream.read(SocketInputStream.java:129) at
> java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at
> java.io.BufferedInputStream.read1(BufferedInputStream.java:258) at
> java.io.BufferedInputStream.read(BufferedInputStream.java:317) -
> locked <0x00000007ac54b6c0> (a java.io.BufferedInputStream) at
> org.apache.jk.common.ChannelSocket.read(ChannelSocket.java:598) at
> org.apache.jk.common.ChannelSocket.receive(ChannelSocket.java:535)
> at
> org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:663)
>
>
at org.apache.jk.common.SocketConnection.runIt(ChannelSocket.java:866)
> at
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
>
>
at java.lang.Thread.run(Thread.java:662)
This thread is handling a request: are you sure there is no traffic?
All other threads are idle or blocked on some condition, which means
they shouldn't be using any CPU at all.
Are you sure you got a thread dump from the right process?
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.17 (Darwin)
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAk/3JtwACgkQ9CaO5/Lv0PA1BQCferJz1pzDXQBfaxKkhiG+bD1u
nmEAoLF6kzJ9kMh9jGR+HK3WMqophW1J
=XTV4
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org