You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tomcat.apache.org by "yhs@mimic.onesourcecorp.com" <yh...@mimic.onesourcecorp.com> on 2000/09/27 17:55:46 UTC

BUG: Tomcat 3.2b CRASH on load balancing.

One of my load balancing processes died..the other one runs fine.
mod_jserv removed the crashed process from the pool correctly and the
server stayed up executing servlets. I tested the RAM out..there isnt
anything wrong with it. Machine has been running fine for 140 days with
1GB in ECC memory/dual P-III 650s/Linux 2.2.17/Redhat 6.2. It crashed 
at a point just before it was due to output to the browser (out.println).

SIGSEGV   11*  segmentation violation
    si_signo [11]: SIGSEGV   11*  segmentation violation
    si_errno [0]: Success
    si_code [0]: SI_USER [pid: 0, uid: 0]
        stackpointer=0xbd7ff5dc

Full thread dump Classic VM (Linux_JDK_1.2.2_FCS, native threads):
    "Thread-12" (TID:0x40e96080, sys_thread_t:0x448562b0, state:CW, native
ID:0x400) prio=5
    "Thread-11" (TID:0x40ea4770, sys_thread_t:0x44826d68, state:CW, native
ID:0x4c14) prio=5
        at java.lang.Object.wait(Native Method)
        at
org.apache.tomcat.util.ThreadPool$MonitorRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-10" (TID:0x40ea5868, sys_thread_t:0x44854de0, state:R, native
ID:0x4813) prio=1
        at
org.apache.tomcat.facade.SimpleFacadeManager.createHttpServletResponseFacade(SimpleFacadeManager.java,
Compiled Code)
        at
org.apache.tomcat.core.ResponseImpl.getFacade(ResponseImpl.java, Compiled
Code)
        at
org.apache.tomcat.core.ServletWrapper.doService(ServletWrapper.java,
Compiled Code)
        at org.apache.tomcat.core.Handler.service(Handler.java, Compiled
Code)
        at
org.apache.tomcat.core.ServletWrapper.service(ServletWrapper.java,
Compiled Code)
        at
org.apache.tomcat.core.ContextManager.internalService(ContextManager.java,
Compiled Code)
        at
org.apache.tomcat.core.ContextManager.service(ContextManager.java,
Compiled Code)
        at
org.apache.tomcat.service.connector.Ajp12ConnectionHandler.processConnection(Ajp12ConnectionHandler.java,
Compiled Code)
        at
org.apache.tomcat.service.TcpWorkerThread.runIt(PoolTcpEndpoint.java,
Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-9" (TID:0x40ea5cc8, sys_thread_t:0x4467c800, state:R, native
ID:0x4412) prio=5
        at
org.apache.tomcat.core.ResponseImpl.getFacade(ResponseImpl.java, Compiled
Code)
        at
org.apache.tomcat.core.ServletWrapper.doService(ServletWrapper.java,
Compiled Code)
        at org.apache.tomcat.core.Handler.service(Handler.java, Compiled
Code)
        at
org.apache.tomcat.core.ServletWrapper.service(ServletWrapper.java,
Compiled Code)
        at
org.apache.tomcat.core.ContextManager.internalService(ContextManager.java,
Compiled Code)
        at
org.apache.tomcat.core.ContextManager.service(ContextManager.java,
Compiled Code)
        at
org.apache.tomcat.service.connector.Ajp12ConnectionHandler.processConnection(Ajp12ConnectionHandler.java,
Compiled Code)
        at
org.apache.tomcat.service.TcpWorkerThread.runIt(PoolTcpEndpoint.java,
Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-8" (TID:0x40ea5c00, sys_thread_t:0x4484c398, state:R, native
ID:0x4011) prio=5
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java, Compiled
Code)
        at java.net.ServerSocket.implAccept(ServerSocket.java, Compiled
Code)
        at java.net.ServerSocket.accept(ServerSocket.java, Compiled Code)
        at
org.apache.tomcat.service.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java,
Compiled Code)
        at
org.apache.tomcat.service.TcpWorkerThread.runIt(PoolTcpEndpoint.java,
Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-7" (TID:0x40ea5b58, sys_thread_t:0x4484b2b0, state:CW, native
ID:0x3c10) prio=5
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-6" (TID:0x40ea5a98, sys_thread_t:0x44670418, state:CW, native
ID:0x380f) prio=5
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-5" (TID:0x40ea5ff0, sys_thread_t:0x4485f9f8, state:CW, native
ID:0x340e) prio=5
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-4" (TID:0x40ea5f98, sys_thread_t:0x4485e910, state:CW, native
ID:0x300d) prio=5
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-3" (TID:0x40ea5f38, sys_thread_t:0x44876bd0, state:CW, native
ID:0x2c0c) prio=5
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-2" (TID:0x40ea5ee0, sys_thread_t:0x44875ae8, state:CW, native
ID:0x280b) prio=5
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-1" (TID:0x40ea6158, sys_thread_t:0x44874a00, state:CW, native
ID:0x240a) prio=5
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at
org.apache.tomcat.util.ThreadPool$ControlRunnable.run(ThreadPool.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "StandardManager" (TID:0x40ead0a8, sys_thread_t:0x4440d430, state:CW,
native ID:0x2009) prio=5
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.tomcat.session.StandardManager.threadSleep(StandardManager.java,
Compiled Code)
        at
org.apache.tomcat.session.StandardManager.run(StandardManager.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "StandardManager" (TID:0x40eaf768, sys_thread_t:0x44616be0, state:CW,
native ID:0x1c08) prio=5
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.tomcat.session.StandardManager.threadSleep(StandardManager.java,
Compiled Code)
        at
org.apache.tomcat.session.StandardManager.run(StandardManager.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "StandardManager" (TID:0x40ea9910, sys_thread_t:0x44616ab0, state:CW,
native ID:0x1807) prio=5
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.tomcat.session.StandardManager.threadSleep(StandardManager.java,
Compiled Code)
        at
org.apache.tomcat.session.StandardManager.run(StandardManager.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "StandardManager" (TID:0x40e8da90, sys_thread_t:0x8378b68, state:CW,
native ID:0x1406) prio=5
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.tomcat.session.StandardManager.threadSleep(StandardManager.java,
Compiled Code)
        at
org.apache.tomcat.session.StandardManager.run(StandardManager.java,
Compiled Code)
        at java.lang.Thread.run(Thread.java, Compiled Code)
    "Thread-0" (TID:0x40e909a8, sys_thread_t:0x828c158, state:CW, native
ID:0x1005) prio=5
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at org.apache.tomcat.util.Queue.pull(Queue.java, Compiled Code)
        at org.apache.tomcat.logging.LogDaemon$1.run(TomcatLogger.java,
Compiled Code)
        at org.apache.tomcat.logging.LogDaemon.run(TomcatLogger.java,
Compiled Code)
    "Finalizer" (TID:0x40e85320, sys_thread_t:0x80d67d8, state:CW, native
ID:0xc04) prio=8
        at java.lang.Object.wait(Native Method)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java,
Compiled Code)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java,
Compiled Code)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java,
Compiled Code)
    "Reference Handler" (TID:0x40e853b0, sys_thread_t:0x80d15d0, state:CW,
native ID:0x803) prio=10
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java, Compiled Code)
        at
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:114)
    "SIGQUIT handler" (TID:0x40e853e0, sys_thread_t:0x80d0f60, state:R,
native ID:0x402) prio=5
Monitor Cache Dump:
    java.net.PlainSocketImpl@40EA6980/40F5EAF8: owner
"Thread-8" (0x4484c398) 1 entry

org.apache.tomcat.util.ThreadPool$ControlRunnable@40EA5F90/40F5F4A8: <unowned>
        Waiting to be notified:
            "Thread-4" (0x4485e910)

org.apache.tomcat.util.ThreadPool$ControlRunnable@40EA5FE8/40F60390: <unowned>
        Waiting to be notified:
            "Thread-5" (0x4485f9f8)
    java.lang.ref.Reference$Lock@40E853C0/40EBA848: <unowned>
        Waiting to be notified:
            "Reference Handler" (0x80d15d0)

org.apache.tomcat.util.ThreadPool$ControlRunnable@40EA5F30/40F5F410: <unowned>
        Waiting to be notified:
            "Thread-3" (0x44876bd0)
    java.lang.ref.ReferenceQueue$Lock@40E85338/40EBAD18: <unowned>
        Waiting to be notified:
            "Finalizer" (0x80d67d8)

org.apache.tomcat.util.ThreadPool$ControlRunnable@40EA6150/40F5F2E0: <unowned>
        Waiting to be notified:
            "Thread-1" (0x44874a00)

org.apache.tomcat.util.ThreadPool$MonitorRunnable@40EA4750/40F607B0: <unowned>
        Waiting to be notified:
            "Thread-11" (0x44826d68)

org.apache.tomcat.util.ThreadPool$ControlRunnable@40EA5B50/40F604C0: <unowned>
        Waiting to be notified:
            "Thread-7" (0x4484b2b0)

org.apache.tomcat.util.ThreadPool$ControlRunnable@40EA5A90/40F60428: <unowned>
        Waiting to be notified:
            "Thread-6" (0x44670418)
    org.apache.tomcat.util.Queue@40E90980/40F05A40: <unowned>
        Waiting to be notified:
            "Thread-0" (0x828c158)

org.apache.tomcat.util.ThreadPool$ControlRunnable@40EA5ED8/40F5F378: <unowned>
        Waiting to be notified:
            "Thread-2" (0x44875ae8)
Registered Monitor Dump:
    PCMap lock: <unowned>
    utf8 hash table: <unowned>
    JNI pinning lock: <unowned>
    JNI global reference lock: <unowned>
    BinClass lock: <unowned>
    Class linking lock: owner "Thread-10" (0x44854de0) 1 entry
    System class loader lock: <unowned>
    Code rewrite lock: <unowned>
    Heap lock: <unowned>
    Monitor cache lock: owner "Thread-9" (0x4467c800) 1 entry
    Thread queue lock: owner "Thread-9" (0x4467c800) 1 entry
        Waiting to be notified:
            "Thread-12" (0x448562b0)
    Monitor registry: owner "Thread-9" (0x4467c800) 1 entry

-------

-Ys-
yhs@mimic.onesourcecorp.com


Re: BUG: Tomcat 3.2b CRASH on load balancing.

Posted by cm...@yahoo.com.
JVM problem....

But of course we should do something - if possible ( workarounds, etc).
I hate this - tomcat isn't doing anything special, just use documented 
Java ( maybe a bit fast for the VM :-). 

Costin