You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apr.apache.org by Anthony J Biacco <ab...@decentrix.net> on 2007/06/06 21:34:12 UTC

JVM crash APR-related?

Hi all,

I'm running Tomcat 6.0.10 with apr/apr-util 1.2.8, tomcat-native 1.1.8,
and JDK 1.6.0_01 (6u1), SSL, i686, CentOS 4.5.
It seems that every time I shutdown tomcat, the JVM crashes with a
segfault, and looking at the dump I'm wondering if it might be
apr-related.
It also happens on my 64-bit AMD (64-bit JVM and 64-bit compiled libs)
machine with CentOS 4.4.
Partial tomcat log and crash log from i686 machine is listed below.
I would be interested in any opinions on this.

TOMCAT:
Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.session.DeltaManager stop
INFO: Manager [localhost#/billboardAdmin] expiring sessions upon
shutdown
Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.session.DeltaManager stop
INFO: Manager [localhost#/billboardUser] expiring sessions upon shutdown
Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.session.DeltaManager stop
INFO: Manager [localhost#/billboard] expiring sessions upon shutdown
Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.session.DeltaManager stop
INFO: Manager [localhost#/billboardControl] expiring sessions upon
shutdown
Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.deploy.FarmWarDeployer
stop
INFO: Cluster FarmWarDeployer stopped.
Jun 6, 2007 10:56:28 AM org.apache.coyote.http11.Http11AprProtocol
destroy
INFO: Stopping Coyote HTTP/1.1 on http-8081
Jun 6, 2007 10:56:28 AM org.apache.coyote.http11.Http11AprProtocol
destroy
INFO: Stopping Coyote HTTP/1.1 on http-8444
#
# An unexpected error has been detected by Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x08311d0e, pid=25496, tid=3085335456
#
# Java VM: Java HotSpot(TM) Server VM (1.6.0_01-b06 mixed mode)
# Problematic frame:
# C  0x08311d0e
#
# An error report file with more information is saved as
/tmp/hs_err_pid25496.log
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
#


CRASH:
#
# An unexpected error has been detected by Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x08311d0e, pid=25496, tid=3085335456
#
# Java VM: Java HotSpot(TM) Server VM (1.6.0_01-b06 mixed mode)
# Problematic frame:
# C  0x08311d0e
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
#

---------------  T H R E A D  ---------------

Current thread (0x08058800):  JavaThread "main" [_thread_in_native,
id=25498]

siginfo:si_signo=11, si_errno=0, si_code=128, si_addr=0x00000000

Registers:
EAX=0x08311c1e, EBX=0x636ff164, ECX=0x00000000, EDX=0x630000b8
ESP=0xb7e668dc, EBP=0xb7e668f8, ESI=0x0830fcf0, EDI=0x00000000
EIP=0x08311d0e, CR2=0xb7e15100, EFLAGS=0x00010286

Top of Stack: (sp=0xb7e668dc)
0xb7e668dc:   636f512c 08311cf8 b7fcbe27 00000000
0xb7e668ec:   636f50e4 636e61e8 63000040 b7e66918
0xb7e668fc:   636da2cd 0830fcf0 08058800 00000000
0xb7e6690c:   b4d8ae7d 632722f8 63000030 b7e66948
0xb7e6691c:   636db049 083b1500 08058800 b7e66958
0xb7e6692c:   636dae15 b7e66930 00000000 082375d0
0xb7e6693c:   636ff164 63272140 00000000 b7e66978
0xb7e6694c:   636f5425 63000030 63272140 636f50d4

Instructions: (pc=0x08311d0e)
0x08311cfe:   00 00 00 00 00 00 b0 1e 31 08 00 60 aa 08 00 90
0x08311d0e:   1f 08 00 00 00 00 00 00 00 00 c0 1c 31 08 ff ff


Stack: [0xb7e17000,0xb7e68000),  sp=0xb7e668dc,  free space=318k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
C=native code)
C  0x08311d0e
C  [libapr-1.so.0+0x132cd]
C  [libapr-1.so.0+0x14049]  apr_pool_clear+0x3d
C  [libtcnative-1.so.0.1.8+0xe425]
Java_org_apache_tomcat_jni_Socket_close+0x5d
j  org.apache.tomcat.jni.Socket.close(J)I+0
j  org.apache.tomcat.util.net.AprEndpoint.destroy()V+27
j  org.apache.coyote.http11.Http11AprProtocol.destroy()V+35
j  org.apache.catalina.connector.Connector.stop()V+109
j  org.apache.catalina.core.StandardService.stop()V+201
j  org.apache.catalina.core.StandardServer.stop()V+65
j  org.apache.catalina.startup.Catalina.stop()V+39
j  org.apache.catalina.startup.Catalina.start()V+154
v  ~StubRoutines::call_stub
V  [libjvm.so+0x2b55ed]
V  [libjvm.so+0x43dd98]
V  [libjvm.so+0x2b5480]
V  [libjvm.so+0x48569f]
V  [libjvm.so+0x48809c]
V  [libjvm.so+0x321588]
C  [libjava.so+0x15224]
Java_sun_reflect_NativeMethodAccessorImpl_invoke0+0x34
j
sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;L
java/lang/Object;[Ljava/lang/Object;)Ljava/lang/Objec
t;+0
j
sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lan
g/Object;)Ljava/lang/Object;+87
j
sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava
/lang/Object;)Ljava/lang/Object;+6
j
java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Lj
ava/lang/Object;+161
j  org.apache.catalina.startup.Bootstrap.start()V+37
j  org.apache.catalina.startup.Bootstrap.main([Ljava/lang/String;)V+125
v  ~StubRoutines::call_stub
V  [libjvm.so+0x2b55ed]
V  [libjvm.so+0x43dd98]
V  [libjvm.so+0x2b5480]
V  [libjvm.so+0x2de8a6]
V  [libjvm.so+0x2cff4b]
C  [java+0x1b98]  JavaMain+0x2c8
C  [libpthread.so.0+0x53cc]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  org.apache.tomcat.jni.Socket.close(J)I+0
j  org.apache.tomcat.util.net.AprEndpoint.destroy()V+27
j  org.apache.coyote.http11.Http11AprProtocol.destroy()V+35
j  org.apache.catalina.connector.Connector.stop()V+109
j  org.apache.catalina.core.StandardService.stop()V+201
j  org.apache.catalina.core.StandardServer.stop()V+65
j  org.apache.catalina.startup.Catalina.stop()V+39
j  org.apache.catalina.startup.Catalina.start()V+154
v  ~StubRoutines::call_stub
j
sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;L
java/lang/Object;[Ljava/lang/Object;)Ljava/lang/Objec
t;+0
j
sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lan
g/Object;)Ljava/lang/Object;+87
j
sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava
/lang/Object;)Ljava/lang/Object;+6
j
java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Lj
ava/lang/Object;+161
j  org.apache.catalina.startup.Bootstrap.start()V+37
j  org.apache.catalina.startup.Bootstrap.main([Ljava/lang/String;)V+125
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x61a71400 JavaThread
"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon
[_thread_blocked, id=11839]
  0x606cd000 JavaThread
"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon
[_thread_blocked, id=11838]
  0x61a81000 JavaThread
"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon
[_thread_blocked, id=11837]
  0x616fac00 JavaThread "Timer-1" daemon [_thread_blocked, id=11836]
  0x080c7800 JavaThread "ajp-8010-1" daemon [_thread_blocked, id=11835]
  0x60e59800 JavaThread
"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon
[_thread_blocked, id=25569]
  0x60e59400 JavaThread
"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon
[_thread_blocked, id=25568]
  0x63811c00 JavaThread
"com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon
[_thread_blocked, id=25567]
  0x63815800 JavaThread "Timer-0" daemon [_thread_blocked, id=25566]
  0x08400400 JavaThread "http-8444-7" daemon [_thread_blocked, id=25559]
  0x6374d400 JavaThread "ajp-8010-CometPoller-0" daemon
[_thread_blocked, id=25558]
  0x63508c00 JavaThread "ajp-8010-Poller-0" daemon [_thread_blocked,
id=25557]
  0x63709800 JavaThread "ajp-8010-Acceptor-0" daemon [_thread_blocked,
id=25556]
  0x082d8800 JavaThread "http-8444-6" daemon [_thread_blocked, id=25555]
  0x082d7400 JavaThread "http-8444-5" daemon [_thread_blocked, id=25554]
  0x082dbc00 JavaThread "http-8444-4" daemon [_thread_blocked, id=25553]
  0x08964000 JavaThread "http-8444-3" daemon [_thread_blocked, id=25552]
  0x083b0000 JavaThread "http-8444-2" daemon [_thread_blocked, id=25551]
  0x6351a000 JavaThread "http-8444-CometPoller-0" daemon
[_thread_blocked, id=25550]
  0x63215000 JavaThread "http-8444-Poller-0" daemon [_thread_blocked,
id=25549]
  0x08b05c00 JavaThread "http-8444-1" daemon [_thread_blocked, id=25548]
  0x63526c00 JavaThread "http-8444-Acceptor-0" daemon [_thread_blocked,
id=25547]
  0x638f7800 JavaThread "http-8081-Sendfile-0" daemon [_thread_blocked,
id=25546]
  0x63778800 JavaThread "http-8081-CometPoller-0" daemon
[_thread_blocked, id=25545]
  0x6374f400 JavaThread "http-8081-Poller-0" daemon [_thread_blocked,
id=25544]
  0x08b05000 JavaThread "http-8081-1" daemon [_thread_blocked, id=25543]
  0x635f3000 JavaThread "http-8081-Acceptor-0" daemon [_thread_blocked,
id=25542]
  0x63f02400 JavaThread "Low Memory Detector" daemon [_thread_blocked,
id=25509]
  0x63f00800 JavaThread "CompilerThread1" daemon [_thread_blocked,
id=25508]
  0x08154000 JavaThread "CompilerThread0" daemon [_thread_blocked,
id=25507]
  0x08152c00 JavaThread "Signal Dispatcher" daemon [_thread_blocked,
id=25506]
  0x08142c00 JavaThread "Finalizer" daemon [_thread_blocked, id=25505]
  0x0813f000 JavaThread "Reference Handler" daemon [_thread_blocked,
id=25504]
=>0x08058800 JavaThread "main" [_thread_in_native, id=25498]

Other Threads:
  0x0813c800 VMThread [id=25503]
  0x63f04000 WatcherThread [id=25510]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
 PSYoungGen      total 95168K, used 72630K [0xadb00000, 0xb4b40000,
0xb4cc0000)
  eden space 87872K, 74% used [0xadb00000,0xb1aced70,0xb30d0000)
  from space 7296K, 99% used [0xb30d0000,0xb37eed90,0xb37f0000)
  to   space 8576K, 0% used [0xb42e0000,0xb42e0000,0xb4b40000)
 PSOldGen        total 33984K, used 20165K [0x74cc0000, 0x76df0000,
0xadb00000)
  object space 33984K, 59% used [0x74cc0000,0x760714b8,0x76df0000)
 PSPermGen       total 44544K, used 37881K [0x64cc0000, 0x67840000,
0x74cc0000)
  object space 44544K, 85% used [0x64cc0000,0x671be628,0x67840000)

VM Arguments:
jvm_args: -Xmx1024m -XX:MaxPermSize=256m -Djava.awt.headless=true
-Dsun.awt.font.advancecache=off -DPAYMENTECH_HOME=/uDOit/payme
ntech -Dbootfile=server.properties -ea
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.con
fig.file=/usr/local/tomcat-6/conf/logging.properties
-Djava.endorsed.dirs=/usr/local/tomcat-6/endorsed
-Dcatalina.base=/usr/loca
l/tomcat-6 -Dcatalina.home=/usr/local/tomcat-6
-Djava.io.tmpdir=/usr/local/tomcat-6/temp
java_command: org.apache.catalina.startup.Bootstrap start
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/usr/java/jdk1.6.0
PATH=/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin
LD_LIBRARY_PATH=/usr/java/jdk1.6.0_01/jre/lib/i386/server:/usr/java/jdk1
.6.0_01/jre/lib/i386:/usr/java/jdk1.6.0_01/jre/../lib/i3
86:/usr/local/apr/lib
SHELL=/bin/bash

Signal Handlers:
SIGSEGV: [libjvm.so+0x51d3a0], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGBUS: [libjvm.so+0x51d3a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGFPE: [libjvm.so+0x43d430], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGPIPE: [libjvm.so+0x43d430], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGILL: [libjvm.so+0x43d430], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x43f440], sa_mask[0]=0x00000000,
sa_flags=0x10000004
SIGHUP: [libjvm.so+0x43ee60], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGQUIT: [libjvm.so+0x43ee60], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGTERM: [libjvm.so+0x43ee60], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGUSR2: [libjvm.so+0x43f440], sa_mask[0]=0x00000000,
sa_flags=0x10000004


---------------  S Y S T E M  ---------------

OS:CentOS release 4.5 (Final)

uname:Linux 2.6.9-34.ELsmp #1 SMP Fri Feb 24 16:54:53 EST 2006 i686
libc:glibc 2.3.4 NPTL 2.3.4
rlimit: STACK 10240k, CORE 0k, NPROC 64509, NOFILE 8192, AS infinity
load average:0.51 0.45 0.37

CPU:total 4 family 15, cmov, cx8, fxsr, mmx, sse, sse2, ht

Memory: 4k page, physical 4090492k(174332k free), swap 2040244k(2040240k
free)

vm_info: Java HotSpot(TM) Server VM (1.6.0_01-b06) for linux-x86, built
on Mar 14 2007 00:47:53 by "java_re" with gcc 3.2.1-7a (
J2SE release)


Thanx,

-Tony
-- 
Anthony J. Biacco
Senior Systems/Network Administrator
Decentrix Inc.
303-899-4000 x303