You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by jochen <so...@gmail.com> on 2009/04/23 08:16:49 UTC

JVM crash issue

Hi all,

I deployed an inhouse application in Tomcat 6.0 and I experienced random JVM
crashes for two weeks. I searched the archieves for this topic,  and went
through the "Troubleshooting guild for Java SE6 with HotSpot VM" spec again,
but still unable to fiure out what could have caused those crashes.
Below is one of JVM error logs, Could any big guy give me some advice? or
any help is greatly appreciated. sorry for the long message.

------------ JVM error log --------------
#
# An unexpected error has been detected by Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00002aecf42738c8, pid=31900, tid=1125493056
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (10.0-b23 mixed mode
linux-amd64)
# Problematic frame:
# V  [libjvm.so+0x3678c8]
#
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
#
---------------  T H R E A D  ---------------
Current thread (0x00002aab3ed70000):  JavaThread "catalina-exec-2" daemon
[_thread_in_vm, id=31977, stack(0x000000004305a000,0x000000004315b000)]
siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
si_addr=0x0000000000000000
Registers:
RAX=0x00002aab3ed70620, RBX=0x00002aab3ed70a08, RCX=0x00002aab3ed70000,
RDX=0x00002aecf3ac6280
RSP=0x00000000431564d0, RBP=0x0000000043156560, RSI=0x000000004315aa20,
RDI=0x0000000000000001
R8 =0x0000000000000ffc, R9 =0x00002aecf475c230, R10=0x00002aecf475fcb0,
R11=0x00002aab3fc513a0
R12=0x0000000000000000, R13=0x00002aab3ed70630, R14=0x0000000000000000,
R15=0x00000000431564f0
RIP=0x00002aecf42738c8, EFL=0x0000000000010246, CSGSFS=0x0000000000000033,
ERR=0x0000000000000004
  TRAPNO=0x000000000000000e
Top of Stack: (sp=0x00000000431564d0)
0x00000000431564d0:   00002aab3fc513a0 00002aab3ed70620
0x00000000431564e0:   00002aab3ed70630 00002aab3ed70a08
0x00000000431564f0:   00002aab3ed70000 0000000000000000
0x0000000043156500:   00002aecf475b170 00002aab3ed70000
0x0000000043156510:   00002aab3ed70000 0000000000000001
0x0000000043156520:   00002aab3ed70000 00002aecf41ffd43
0x0000000043156530:   00002aab275ed380 00002aaab1500830
0x0000000043156540:   00002aaab1500bc8 00002aaab1500830
0x0000000043156550:   0000000043156820 00002aab3ed70000
0x0000000043156560:   00002aab3ed70198 00002aab42736bf9
0x0000000043156570:   0000000043156590 00002aecf42ad629
0x0000000043156580:   0000000000000001 00002aaaaea065d8
0x0000000043156590:   00002aab3ed70000 0000000000000001
0x00000000431565a0:   0000000000000000 0000000000000004
0x00000000431565b0:   0000000043156808 0000000043156810
0x00000000431565c0:   0000000043156818 0000000000000000
0x00000000431565d0:   00002aab275ed470 0000000000000004
0x00000000431565e0:   0000000043156630 00002aecf41ff6f5
0x00000000431565f0:   00002aab3ed70000 0000000000000004
0x0000000043156600:   00002aab275ed660 0000000000000004
0x0000000043156610:   00002aab275ed660 00002aab3ed70000
0x0000000043156620:   0000000000000004 00002aab3ed70a88
0x0000000043156630:   0000000043156670 00002aecf4546950
0x0000000043156640:   00002aab275ed6a0 00002aab3ed70000
0x0000000043156650:   00002aab275ed680 00002aaaab5a86f6
0x0000000043156660:   0000000043156748 00002aab3ed70000
0x0000000043156670:   00002aab275ed700 00002aaaab58dc3e
0x0000000043156680:   00002aab275ed680 00002aecf422a4a2
0x0000000043156690:   00002aab3ed70000 0000000043156750
0x00000000431566a0:   00002aab275ed6a0 0000000043156740
0x00000000431566b0:   00000000431566b0 00002aaaaebe3178
0x00000000431566c0:   0000000043156700 00002aaab034aa08
Instructions: (pc=0x00002aecf42738c8)
0x00002aecf42738b8:   4d 8b 6b 10 4c 89 6d 80 49 8b 5b 18 48 89 5d 88
0x00002aecf42738c8:   49 8b 3c 24 e8 9f 92 fd ff 48 89 c7 49 89 c4 e8
Stack: [0x000000004305a000,0x000000004315b000],  sp=0x00000000431564d0,
free space=1009k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native
code)
V  [libjvm.so+0x3678c8]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::StubRoutines (1)
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
J
java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
J
org.apache.struts2.interceptor.CheckboxInterceptor.intercept(Lcom/opensymphony/xwork2/ActionInvocation;)Ljava/lang/String;
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
J
com.opensymphony.xwork2.interceptor.ChainingInterceptor.intercept(Lcom/opensymphony/xwork2/ActionInvocation;)Ljava/lang/String;
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
J
com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/lang/String;
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
J  org.apache.coyote.http11.Http11Processor.process(Ljava/net/Socket;)V
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
v  ~BufferBlob::Interpreter
J  java.util.concurrent.ThreadPoolExecutor$Worker.run()V
v  ~BufferBlob::Interpreter
v  ~BufferBlob::StubRoutines (1)
---------------  P R O C E S S  ---------------
Java Threads: ( => current thread )
  0x00002aab3f739800 JavaThread "Keep-Alive-Timer" daemon [_thread_blocked,
id=12426, stack(0x0000000043a64000,0x0000000043b65000)]
  0x00002aab3ec07c00 JavaThread "File Reaper" daemon [_thread_blocked,
id=8967, stack(0x0000000043963000,0x0000000043a64000)]
  0x00002aab3fdc7000 JavaThread "catalina-exec-13" daemon [_thread_blocked,
id=7876, stack(0x0000000043862000,0x0000000043963000)]
  0x00002aab3fdc6800 JavaThread "catalina-exec-12" daemon [_thread_blocked,
id=7875, stack(0x0000000043761000,0x0000000043862000)]
  0x00002aab4049ec00 JavaThread "catalina-exec-11" daemon [_thread_blocked,
id=7874, stack(0x0000000043660000,0x0000000043761000)]
  0x00002aab3e0a7c00 JavaThread "catalina-exec-10" daemon [_thread_blocked,
id=7873, stack(0x000000004345e000,0x000000004355f000)]
  0x00002aab41ab7000 JavaThread "catalina-exec-9" daemon [_thread_blocked,
id=7872, stack(0x000000004325c000,0x000000004335d000)]
  0x00002aab4025b800 JavaThread "catalina-exec-8" daemon [_thread_blocked,
id=17361, stack(0x000000004355f000,0x0000000043660000)]
  0x00002aab3e0a9400 JavaThread "catalina-exec-7" daemon [_thread_blocked,
id=30344, stack(0x000000004335d000,0x000000004345e000)]
=>0x00002aab3ed70000 JavaThread "catalina-exec-2" daemon [_thread_in_vm,
id=31977, stack(0x000000004305a000,0x000000004315b000)]
  0x00002aab3ed6f800 JavaThread "MySQL Statement Cancellation Timer" daemon
[_thread_blocked, id=31976, stack(0x0000000042f59000,0x000000004305a000)]
  0x00002aab405cc800 JavaThread "catalina-exec-1" daemon [_thread_blocked,
id=31975, stack(0x0000000042e58000,0x0000000042f59000)]
  0x00002aab415d2c00 JavaThread "TP-Monitor" daemon [_thread_blocked,
id=31960, stack(0x0000000042d57000,0x0000000042e58000)]
  0x00002aab415d1c00 JavaThread "TP-Processor4" daemon [_thread_in_native,
id=31959, stack(0x0000000042c56000,0x0000000042d57000)]
  0x00002aab415aa400 JavaThread "TP-Processor3" daemon [_thread_blocked,
id=31958, stack(0x0000000042b55000,0x0000000042c56000)]
  0x00002aab3f920800 JavaThread "TP-Processor2" daemon [_thread_blocked,
id=31957, stack(0x0000000042a54000,0x0000000042b55000)]
  0x00002aab415e2c00 JavaThread "TP-Processor1" daemon [_thread_blocked,
id=31956, stack(0x0000000042953000,0x0000000042a54000)]
  0x00002aab418df000 JavaThread "http-172.27.28.197-8081-Acceptor-0" daemon
[_thread_in_native, id=31955, stack(0x0000000042852000,0x0000000042953000)]
  0x00002aab3ef58400 JavaThread
"ContainerBackgroundProcessor[StandardEngine[Standalone]]" daemon
[_thread_blocked, id=31954, stack(0x0000000042751000,0x0000000042852000)]
  0x00002aab3fdc0000 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_QuartzSchedulerThread"
[_thread_blocked, id=31953, stack(0x0000000042650000,0x0000000042751000)]
  0x00002aab3f849c00 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-10"
[_thread_blocked, id=31952, stack(0x000000004254f000,0x0000000042650000)]
  0x00002aab3f848400 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-9"
[_thread_blocked, id=31951, stack(0x000000004244e000,0x000000004254f000)]
  0x00002aab404c9800 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-8"
[_thread_blocked, id=31950, stack(0x000000004234d000,0x000000004244e000)]
  0x00002aab404c8800 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-7"
[_thread_blocked, id=31949, stack(0x000000004224c000,0x000000004234d000)]
  0x00002aab3faff400 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-6"
[_thread_blocked, id=31948, stack(0x000000004214b000,0x000000004224c000)]
  0x00002aab3fab5c00 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-5"
[_thread_blocked, id=31947, stack(0x000000004204a000,0x000000004214b000)]
  0x00002aab4015dc00 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-4"
[_thread_blocked, id=31946, stack(0x0000000041f49000,0x000000004204a000)]
  0x00002aab4015d400 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-3"
[_thread_blocked, id=31945, stack(0x0000000041e48000,0x0000000041f49000)]
  0x00002aab3fb1b800 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-2"
[_thread_blocked, id=31944, stack(0x0000000041d47000,0x0000000041e48000)]
  0x00002aab3fb1b400 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#1_Worker-1"
[_thread_blocked, id=31943, stack(0x0000000041c46000,0x0000000041d47000)]
  0x00002aab40735c00 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_QuartzSchedulerThread"
[_thread_blocked, id=31933, stack(0x0000000041b45000,0x0000000041c46000)]
  0x00002aab3fa89c00 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-10"
[_thread_blocked, id=31932, stack(0x0000000041a44000,0x0000000041b45000)]
  0x00002aab3fa88400 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-9"
[_thread_blocked, id=31931, stack(0x0000000041943000,0x0000000041a44000)]
  0x00002aab40635c00 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-8"
[_thread_blocked, id=31930, stack(0x0000000041842000,0x0000000041943000)]
  0x00002aab3fb20800 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-7"
[_thread_blocked, id=31929, stack(0x0000000041741000,0x0000000041842000)]
  0x00002aab3fb3f000 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-6"
[_thread_blocked, id=31928, stack(0x0000000041640000,0x0000000041741000)]
  0x00002aab3eff0c00 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-5"
[_thread_blocked, id=31927, stack(0x000000004153f000,0x0000000041640000)]
  0x00002aab4014b800 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-4"
[_thread_blocked, id=31926, stack(0x000000004143e000,0x000000004153f000)]
  0x00002aab3ef8cc00 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-3"
[_thread_blocked, id=31925, stack(0x000000004133d000,0x000000004143e000)]
  0x00002aab3ef8c800 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-2"
[_thread_blocked, id=31924, stack(0x000000004123c000,0x000000004133d000)]
  0x00002aab3ed77000 JavaThread
"org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-1"
[_thread_blocked, id=31923, stack(0x000000004103a000,0x000000004113b000)]
  0x00002aab3f05c400 JavaThread "Timer-2" [_thread_blocked, id=31922,
stack(0x000000004113b000,0x000000004123c000)]
  0x00002aab4099e400 JavaThread "Timer-1" [_thread_blocked, id=31915,
stack(0x0000000040f39000,0x000000004103a000)]
  0x00002aab3f175400 JavaThread "Timer-0" [_thread_blocked, id=31914,
stack(0x0000000040e38000,0x0000000040f39000)]
  0x00002aab3e00fc00 JavaThread "Low Memory Detector" daemon
[_thread_blocked, id=31912, stack(0x0000000040c36000,0x0000000040d37000)]
  0x00002aab3e00d400 JavaThread "CompilerThread1" daemon [_thread_blocked,
id=31911, stack(0x0000000040b35000,0x0000000040c36000)]
  0x00002aab3e009c00 JavaThread "CompilerThread0" daemon [_thread_blocked,
id=31910, stack(0x0000000040a34000,0x0000000040b35000)]
  0x00002aab3e008400 JavaThread "Signal Dispatcher" daemon [_thread_blocked,
id=31909, stack(0x0000000040933000,0x0000000040a34000)]
  0x00002aab3dfd3000 JavaThread "Finalizer" daemon [_thread_blocked,
id=31908, stack(0x0000000040832000,0x0000000040933000)]
  0x00002aab3dcd8c00 JavaThread "Reference Handler" daemon [_thread_blocked,
id=31907, stack(0x0000000040731000,0x0000000040832000)]
  0x0000000040113400 JavaThread "main" [_thread_in_native, id=31901,
stack(0x000000004012b000,0x000000004022c000)]
Other Threads:
  0x00002aab3dcd6800 VMThread [stack: 0x0000000040630000,0x0000000040731000]
[id=31906]
  0x00002aab3e011800 WatcherThread [stack:
0x0000000040d37000,0x0000000040e38000] [id=31913]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
 PSYoungGen      total 172096K, used 19301K [0x00002aab26530000,
0x00002aab328d0000, 0x00002aab36530000)
  eden space 170176K, 10% used
[0x00002aab26530000,0x00002aab2762ca48,0x00002aab30b60000)
  from space 1920K, 99% used
[0x00002aab324a0000,0x00002aab3267ca68,0x00002aab32680000)
  to   space 2368K, 0% used
[0x00002aab32680000,0x00002aab32680000,0x00002aab328d0000)
 ParOldGen       total 349568K, used 318545K [0x00002aaab6530000,
0x00002aaacba90000, 0x00002aab26530000)
  object space 349568K, 91% used
[0x00002aaab6530000,0x00002aaac9c447e8,0x00002aaacba90000)
 PSPermGen       total 131072K, used 57827K [0x00002aaaae530000,
0x00002aaab6530000, 0x00002aaab6530000)
  object space 131072K, 44% used
[0x00002aaaae530000,0x00002aaab1da8fc8,0x00002aaab6530000)
Dynamic libraries:
40000000-40009000 r-xp 00000000 08:01 1198658
/usr/java/jdk1.6.0_07/bin/java
40108000-4010a000 rwxp 00008000 08:01 1198658
/usr/java/jdk1.6.0_07/bin/java
4010a000-4012b000 rwxp 4010a000 00:00 0
[heap]
4012b000-4012e000 ---p 4012b000 00:00 0
4012e000-4022c000 rwxp 4012e000 00:00 0
4022c000-4022d000 ---p 4022c000 00:00 0
4022d000-4032d000 rwxp 4022d000 00:00 0
4032d000-4032e000 ---p 4032d000 00:00 0
4032e000-4042e000 rwxp 4032e000 00:00 0
4042e000-4042f000 ---p 4042e000 00:00 0
4042f000-4052f000 rwxp 4042f000 00:00 0
4052f000-40530000 ---p 4052f000 00:00 0
40530000-40630000 rwxp 40530000 00:00 0
40630000-40631000 ---p 40630000 00:00 0
40631000-40731000 rwxp 40631000 00:00 0
40731000-40734000 ---p 40731000 00:00 0
40734000-40832000 rwxp 40734000 00:00 0
40832000-40835000 ---p 40832000 00:00 0
40835000-40933000 rwxp 40835000 00:00 0
40933000-40936000 ---p 40933000 00:00 0
40936000-40a34000 rwxp 40936000 00:00 0
40a34000-40a37000 ---p 40a34000 00:00 0
40a37000-40b35000 rwxp 40a37000 00:00 0
40b35000-40b38000 ---p 40b35000 00:00 0
40b38000-40c36000 rwxp 40b38000 00:00 0
40c36000-40c39000 ---p 40c36000 00:00 0
40c39000-40d37000 rwxp 40c39000 00:00 0
40d37000-40d38000 ---p 40d37000 00:00 0
40d38000-40e38000 rwxp 40d38000 00:00 0
40e38000-40e3b000 ---p 40e38000 00:00 0
40e3b000-40f39000 rwxp 40e3b000 00:00 0
40f39000-40f3c000 ---p 40f39000 00:00 0
40f3c000-4103a000 rwxp 40f3c000 00:00 0
4103a000-4103d000 ---p 4103a000 00:00 0
4103d000-4113b000 rwxp 4103d000 00:00 0
4113b000-4113e000 ---p 4113b000 00:00 0
4113e000-4123c000 rwxp 4113e000 00:00 0
4123c000-4123f000 ---p 4123c000 00:00 0
4123f000-4133d000 rwxp 4123f000 00:00 0
4133d000-41340000 ---p 4133d000 00:00 0
41340000-4143e000 rwxp 41340000 00:00 0
4143e000-41441000 ---p 4143e000 00:00 0
41441000-4153f000 rwxp 41441000 00:00 0
4153f000-41542000 ---p 4153f000 00:00 0
41542000-41640000 rwxp 41542000 00:00 0
41640000-41643000 ---p 41640000 00:00 0
41643000-41741000 rwxp 41643000 00:00 0
41741000-41744000 ---p 41741000 00:00 0
41744000-41842000 rwxp 41744000 00:00 0
41842000-41845000 ---p 41842000 00:00 0
41845000-41943000 rwxp 41845000 00:00 0
41943000-41946000 ---p 41943000 00:00 0
41946000-41a44000 rwxp 41946000 00:00 0
41a44000-41a47000 ---p 41a44000 00:00 0
41a47000-41b45000 rwxp 41a47000 00:00 0
41b45000-41b48000 ---p 41b45000 00:00 0
41b48000-41c46000 rwxp 41b48000 00:00 0
41c46000-41c49000 ---p 41c46000 00:00 0
41c49000-41d47000 rwxp 41c49000 00:00 0
41d47000-41d4a000 ---p 41d47000 00:00 0
41d4a000-41e48000 rwxp 41d4a000 00:00 0
41e48000-41e4b000 ---p 41e48000 00:00 0
41e4b000-41f49000 rwxp 41e4b000 00:00 0
41f49000-41f4c000 ---p 41f49000 00:00 0
41f4c000-4204a000 rwxp 41f4c000 00:00 0
4204a000-4204d000 ---p 4204a000 00:00 0
4204d000-4214b000 rwxp 4204d000 00:00 0
4214b000-4214e000 ---p 4214b000 00:00 0
4214e000-4224c000 rwxp 4214e000 00:00 0
4224c000-4224f000 ---p 4224c000 00:00 0
4224f000-4234d000 rwxp 4224f000 00:00 0
4234d000-42350000 ---p 4234d000 00:00 0
42350000-4244e000 rwxp 42350000 00:00 0
4244e000-42451000 ---p 4244e000 00:00 0
42451000-4254f000 rwxp 42451000 00:00 0
4254f000-42552000 ---p 4254f000 00:00 0
42552000-42650000 rwxp 42552000 00:00 0
42650000-42653000 ---p 42650000 00:00 0
42653000-42751000 rwxp 42653000 00:00 0
42751000-42754000 ---p 42751000 00:00 0
42754000-42852000 rwxp 42754000 00:00 0
42852000-42855000 ---p 42852000 00:00 0
42855000-42953000 rwxp 42855000 00:00 0
42953000-42956000 ---p 42953000 00:00 0
42956000-42a54000 rwxp 42956000 00:00 0
42a54000-42a57000 ---p 42a54000 00:00 0
42a57000-42b55000 rwxp 42a57000 00:00 0
42b55000-42b58000 ---p 42b55000 00:00 0
42b58000-42c56000 rwxp 42b58000 00:00 0
42c56000-42c59000 ---p 42c56000 00:00 0
42c59000-42d57000 rwxp 42c59000 00:00 0
42d57000-42d5a000 ---p 42d57000 00:00 0
42d5a000-42e58000 rwxp 42d5a000 00:00 0
42e58000-42e5b000 ---p 42e58000 00:00 0
42e5b000-42f59000 rwxp 42e5b000 00:00 0
42f59000-42f5c000 ---p 42f59000 00:00 0
42f5c000-4305a000 rwxp 42f5c000 00:00 0
4305a000-4305d000 ---p 4305a000 00:00 0
4305d000-4315b000 rwxp 4305d000 00:00 0
4315b000-4315e000 rwxp 4315b000 00:00 0
4315e000-4325c000 rwxp 4315e000 00:00 0
4325c000-4325f000 ---p 4325c000 00:00 0
4325f000-4335d000 rwxp 4325f000 00:00 0
4335d000-43360000 ---p 4335d000 00:00 0
43360000-4345e000 rwxp 43360000 00:00 0
4345e000-43461000 ---p 4345e000 00:00 0
43461000-4355f000 rwxp 43461000 00:00 0
4355f000-43562000 ---p 4355f000 00:00 0
43562000-43660000 rwxp 43562000 00:00 0
43660000-43663000 ---p 43660000 00:00 0
43663000-43761000 rwxp 43663000 00:00 0
43761000-43764000 ---p 43761000 00:00 0
43764000-43862000 rwxp 43764000 00:00 0
43862000-43865000 ---p 43862000 00:00 0
43865000-43963000 rwxp 43865000 00:00 0
43963000-43966000 ---p 43963000 00:00 0
43966000-43a64000 rwxp 43966000 00:00 0
43a64000-43a67000 ---p 43a64000 00:00 0
43a67000-43b65000 rwxp 43a67000 00:00 0
2aaaaaaab000-2aaaaaaad000 r-xs 00003000 08:03 2478834
/usr/local/tomcat-web1-6.0.16/bin/bootstrap.jar
2aaaaaaad000-2aaaaaabb000 r-xs 00656000 08:01 36699
/usr/java/jdk1.6.0_07/jre/lib/charsets.jar
2aaaaaabb000-2aaaaaac3000 r-xp 00000000 08:01 178153
/lib64/librt-2.4.so
2aaaaaac3000-2aaaaabc2000 ---p 00008000 08:01 178153
/lib64/librt-2.4.so
2aaaaabc2000-2aaaaabc4000 rwxp 00007000 08:01 178153
/lib64/librt-2.4.so
2aaaaabc4000-2aaaaabc5000 r-xp 2aaaaabc4000 00:00 0
2aaaaabc5000-2aaaaabc6000 rwxp 2aaaaabc5000 00:00 0
2aaaaabc6000-2aaaaabcd000 r-xp 00000000 08:01 36671
/usr/java/jdk1.6.0_07/jre/lib/amd64/native_threads/libhpi.so
2aaaaabcd000-2aaaaacce000 ---p 00007000 08:01 36671
/usr/java/jdk1.6.0_07/jre/lib/amd64/native_threads/libhpi.so
2aaaaacce000-2aaaaacd0000 rwxp 00008000 08:01 36671
/usr/java/jdk1.6.0_07/jre/lib/amd64/native_threads/libhpi.so
2aaaaacd0000-2aaaaacd1000 rwxp 2aaaaacd0000 00:00 0
2aaaaacd1000-2aaaaacd9000 rwxs 00000000 08:01 404808
/tmp/hsperfdata_webadmin/31900
2aaaaacdf000-2aaaaacf2000 r-xp 00000000 08:01 178134
/lib64/libnsl-2.4.so
2aaaaacf2000-2aaaaadf1000 ---p 00013000 08:01 178134
/lib64/libnsl-2.4.so
2aaaaadf1000-2aaaaadf3000 rwxp 00012000 08:01 178134
/lib64/libnsl-2.4.so
2aaaaadf3000-2aaaaadf5000 rwxp 2aaaaadf3000 00:00 0
2aaaaadf5000-2aaaaadfc000 r-xp 00000000 08:01 178136
/lib64/libnss_compat-2.4.so
2aaaaadfc000-2aaaaaefb000 ---p 00007000 08:01 178136
/lib64/libnss_compat-2.4.so
2aaaaaefb000-2aaaaaefd000 rwxp 00006000 08:01 178136
/lib64/libnss_compat-2.4.so
2aaaaaefd000-2aaaaaf06000 r-xp 00000000 08:01 178144
/lib64/libnss_nis-2.4.so
2aaaaaf06000-2aaaab006000 ---p 00009000 08:01 178144
/lib64/libnss_nis-2.4.so
2aaaab006000-2aaaab008000 rwxp 00009000 08:01 178144
/lib64/libnss_nis-2.4.so
2aaaab008000-2aaaab012000 r-xp 00000000 08:01 178140
/lib64/libnss_files-2.4.so
2aaaab012000-2aaaab111000 ---p 0000a000 08:01 178140
/lib64/libnss_files-2.4.so
2aaaab111000-2aaaab113000 rwxp 00009000 08:01 178140
/lib64/libnss_files-2.4.so
2aaaab113000-2aaaab120000 r-xp 00000000 08:01 36666
/usr/java/jdk1.6.0_07/jre/lib/amd64/libverify.so
2aaaab120000-2aaaab21f000 ---p 0000d000 08:01 36666
/usr/java/jdk1.6.0_07/jre/lib/amd64/libverify.so
2aaaab21f000-2aaaab222000 rwxp 0000c000 08:01 36666
/usr/java/jdk1.6.0_07/jre/lib/amd64/libverify.so
2aaaab222000-2aaaab24b000 r-xp 00000000 08:01 36647
/usr/java/jdk1.6.0_07/jre/lib/amd64/libjava.so
2aaaab24b000-2aaaab34a000 ---p 00029000 08:01 36647
/usr/java/jdk1.6.0_07/jre/lib/amd64/libjava.so
2aaaab34a000-2aaaab351000 rwxp 00028000 08:01 36647
/usr/java/jdk1.6.0_07/jre/lib/amd64/libjava.so
2aaaab351000-2aaaab35f000 r-xp 00000000 08:01 36667
/usr/java/jdk1.6.0_07/jre/lib/amd64/libzip.so
2aaaab35f000-2aaaab461000 ---p 0000e000 08:01 36667
/usr/java/jdk1.6.0_07/jre/lib/amd64/libzip.so
2aaaab461000-2aaaab464000 rwxp 00010000 08:01 36667
/usr/java/jdk1.6.0_07/jre/lib/amd64/libzip.so
2aaaab464000-2aaaac465000 rwxp 2aaaab464000 00:00 0
2aaaac465000-2aaaae465000 rwxp 2aaaac465000 00:00 0
2aaaae465000-2aaaae4a5000 rwxp 2aaaae465000 00:00 0
2aaaae4a5000-2aaaae525000 rwxp 2aaaae4a5000 00:00 0
2aaaae525000-2aaaae526000 rwxp 2aaaae525000 00:00 0
2aaaae527000-2aaaae52a000 r-xs 00013000 08:01 36697
/usr/java/jdk1.6.0_07/jre/lib/jce.jar
2aaaae530000-2aaacba90000 rwxp 2aaaae530000 00:00 0
2aaacba90000-2aab26530000 rwxp 2aaacba90000 00:00 0
2aab26530000-2aab328d0000 rwxp 2aab26530000 00:00 0
2aab328d0000-2aab36530000 rwxp 2aab328d0000 00:00 0
2aab36530000-2aab3661b000 rwxp 2aab36530000 00:00 0
2aab3661b000-2aab368f0000 rwxp 2aab3661b000 00:00 0
2aab368f0000-2aab36952000 rwxp 2aab368f0000 00:00 0
2aab36952000-2aab36970000 rwxp 2aab36952000 00:00 0
2aab36970000-2aab36a1c000 rwxp 2aab36970000 00:00 0
2aab36a1c000-2aab36cf1000 rwxp 2aab36a1c000 00:00 0
2aab36cf1000-2aab3dcd9000 rwxp 2aab36cf1000 00:00 0
2aab3dcd9000-2aab3de64000 r-xs 02def000 08:01 36710
/usr/java/jdk1.6.0_07/jre/lib/rt.jar
2aab3de64000-2aab3e0cf000 rwxp 2aab3de64000 00:00 0
2aab3e100000-2aab3e1ff000 rwxp 2aab3e100000 00:00 0
2aab3e1ff000-2aab3e200000 ---p 2aab3e1ff000 00:00 0
2aab3e200000-2aab3e300000 rwxp 2aab3e200000 00:00 0
2aab3e300000-2aab3e302000 r-xs 00001000 08:03 2478835
/usr/local/tomcat-web1-6.0.16/bin/commons-daemon.jar
2aab3e302000-2aab3e303000 r-xs 00004000 08:03 2478850
/usr/local/tomcat-web1-6.0.16/bin/tomcat-juli.jar
2aab3e303000-2aab3e305000 r-xs 00001000 08:03 2478972
/usr/local/tomcat-web1-6.0.16/lib/annotations-api.jar
2aab3e305000-2aab3e307000 r-xs 0000b000 08:03 2478973
/usr/local/tomcat-web1-6.0.16/lib/catalina-ant.jar
2aab3e307000-2aab3e309000 r-xs 0001c000 08:03 2478975
/usr/local/tomcat-web1-6.0.16/lib/catalina-ha.jar
2aab3e309000-2aab3e30d000 r-xs 00034000 08:03 2478976
/usr/local/tomcat-web1-6.0.16/lib/catalina-tribes.jar
2aab3e30d000-2aab3e31c000 r-xs 00105000 08:03 2478980
/usr/local/tomcat-web1-6.0.16/lib/catalina.jar
2aab3e31c000-2aab3e31d000 r-xs 00006000 08:03 2478983
/usr/local/tomcat-web1-6.0.16/lib/el-api.jar
2aab3e31d000-2aab3e31f000 r-xs 00017000 08:03 2479016
/usr/local/tomcat-web1-6.0.16/lib/jasper-el.jar
2aab3e31f000-2aab3e32b000 r-xs 00149000 08:03 2479019
/usr/local/tomcat-web1-6.0.16/lib/jasper-jdt.jar
2aab3e32b000-2aab3e332000 r-xs 00076000 08:03 2479114
/usr/local/tomcat-web1-6.0.16/lib/jasper.jar
2aab3e332000-2aab3e334000 r-xs 00010000 08:03 2479116
/usr/local/tomcat-web1-6.0.16/lib/jsp-api.jar
2aab3e334000-2aab3e344000 r-xs 00168000 08:03 2479117
/usr/local/tomcat-web1-6.0.16/lib/ojdbc14.jar
2aab3e344000-2aab3e346000 r-xs 00013000 08:03 2479118
/usr/local/tomcat-web1-6.0.16/lib/servlet-api.jar
2aab3e346000-2aab3e350000 r-xs 000ac000 08:03 2479119
/usr/local/tomcat-web1-6.0.16/lib/tomcat-coyote.jar
2aab3e400000-2aab3e4f4000 rwxp 2aab3e400000 00:00 0
2aab3e4f4000-2aab3e500000 ---p 2aab3e4f4000 00:00 0
2aab3e500000-2aab3e600000 rwxp 2aab3e500000 00:00 0
2aab3e600000-2aab3e604000 r-xs 0002d000 08:03 2479120
/usr/local/tomcat-web1-6.0.16/lib/tomcat-dbcp.jar
2aab3e604000-2aab3e607000 r-xs 00009000 08:03 2479121
/usr/local/tomcat-web1-6.0.16/lib/tomcat-i18n-es.jar
2aab3e607000-2aab3e609000 r-xs 00009000 08:03 2479122
/usr/local/tomcat-web1-6.0.16/lib/tomcat-i18n-fr.jar
2aab3e609000-2aab3e60b000 r-xs 0000a000 08:03 2479123
/usr/local/tomcat-web1-6.0.16/lib/tomcat-i18n-ja.jar
2aab3e60b000-2aab3e70b000 rwxp 2aab3e60b000 00:00 0
2aab3e723000-2aab3e72a000 r-xs 000a5000 08:03 1905915
/usr/local/brand/bean/WEB-INF/lib/mysql-connector-java-5.1.6.jar
2aab3e796000-2aab3e79c000 r-xs 00091000 08:01 36708
/usr/java/jdk1.6.0_07/jre/lib/jsse.jar
2aab3e79c000-2aab3e79f000 r-xs 00027000 08:01 64784
/usr/java/jdk1.6.0_07/jre/lib/ext/sunjce_provider.jar
2aab3e800000-2aab3e8fb000 rwxp 2aab3e800000 00:00 0
2aab3e8fb000-2aab3e900000 ---p 2aab3e8fb000 00:00 0
2aab3e900000-2aab3e913000 r-xp 00000000 08:01 36659
/usr/java/jdk1.6.0_07/jre/lib/amd64/libnet.so
2aab3e913000-2aab3ea14000 ---p 00013000 08:01 36659
/usr/java/jdk1.6.0_07/jre/lib/amd64/libnet.so
2aab3ea14000-2aab3ea17000 rwxp 00014000 08:01 36659
/usr/java/jdk1.6.0_07/jre/lib/amd64/libnet.so
2aab3eb00000-2aab3ebe9000 rwxp 2aab3eb00000 00:00 0
2aab3ebe9000-2aab3ec00000 ---p 2aab3ebe9000 00:00 0
2aab3ec00000-2aab3ed00000 rwxp 2aab3ec00000 00:00 0
2aab3ed39000-2aab3ee39000 rwxp 2aab3ed39000 00:00 0
2aab3ee69000-2aab3f069000 rwxp 2aab3ee69000 00:00 0
2aab3f100000-2aab3f1f4000 rwxp 2aab3f100000 00:00 0
2aab3f1f4000-2aab3f200000 ---p 2aab3f1f4000 00:00 0
2aab3f2a9000-2aab3f2ad000 r-xs 000ca000 08:01 65292
/usr/java/jdk1.6.0_07/jre/lib/ext/localedata.jar
2aab3f300000-2aab3f3fc000 rwxp 2aab3f300000 00:00 0
2aab3f3fc000-2aab3f400000 ---p 2aab3f3fc000 00:00 0
2aab3f400000-2aab3f427000 r-xs 001f4000 08:03 1905924
/usr/local/brand/bean/WEB-INF/lib/struts2-core-2.0.9.jar
2aab3f427000-2aab3f428000 r-xs 00001000 08:03 1905926
/usr/local/brand/bean/WEB-INF/lib/struts2-spring-plugin-2.0.9.jar
2aab3f500000-2aab3f5f6000 rwxp 2aab3f500000 00:00 0
2aab3f5f6000-2aab3f600000 ---p 2aab3f5f6000 00:00 0
2aab3f600000-2aab3f6fc000 rwxp 2aab3f600000 00:00 0
2aab3f6fc000-2aab3f700000 ---p 2aab3f6fc000 00:00 0
2aab3f700000-2aab3f7f5000 rwxp 2aab3f700000 00:00 0
2aab3f7f5000-2aab3f800000 ---p 2aab3f7f5000 00:00 0
2aab3f800000-2aab3fa00000 rwxp 2aab3f800000 00:00 0
2aab3fa00000-2aab3fa07000 r-xs 00110000 08:01 36707
/usr/java/jdk1.6.0_07/jre/lib/resources.jar
2aab3fa65000-2aab3fc65000 rwxp 2aab3fa65000 00:00 0
2aab3fd3e000-2aab4003e000 rwxp 2aab3fd3e000 00:00 0
2aab4005f000-2aab4015f000 rwxp 2aab4005f000 00:00 0
2aab40185000-2aab40385000 rwxp 2aab40185000 00:00 0
2aab403cd000-2aab404cd000 rwxp 2aab403cd000 00:00 0
2aab40537000-2aab40737000 rwxp 2aab40537000 00:00 0
2aab40800000-2aab408fe000 rwxp 2aab40800000 00:00 0
2aab408fe000-2aab40900000 ---p 2aab408fe000 00:00 0
2aab40900000-2aab409f4000 rwxp 2aab40900000 00:00 0
2aab409f4000-2aab40a00000 ---p 2aab409f4000 00:00 0
2aab40a00000-2aab40c00000 rwxp 2aab40a00000 00:00 0
2aab40c04000-2aab40d04000 rwxp 2aab40c04000 00:00 0
2aab40deb000-2aab40eeb000 rwxp 2aab40deb000 00:00 0
2aab40eeb000-2aab40ef1000 r-xp 00000000 08:01 36655
/usr/java/jdk1.6.0_07/jre/lib/amd64/libmanagement.so
2aab40ef1000-2aab40ff0000 ---p 00006000 08:01 36655
/usr/java/jdk1.6.0_07/jre/lib/amd64/libmanagement.so
2aab40ff0000-2aab40ff2000 rwxp 00005000 08:01 36655
/usr/java/jdk1.6.0_07/jre/lib/amd64/libmanagement.so
2aab40ff2000-2aab40ff4000 r-xp 00000000 08:03 2478827
/usr/local/tomcat-web1-6.0.16/appso/itil4app_api_x86_64-suse-linux.so
2aab40ff4000-2aab410f3000 ---p 00002000 08:03 2478827
/usr/local/tomcat-web1-6.0.16/appso/itil4app_api_x86_64-suse-linux.so
2aab410f3000-2aab410f4000 rwxp 00001000 08:03 2478827
/usr/local/tomcat-web1-6.0.16/appso/itil4app_api_x86_64-suse-linux.so
2aab41100000-2aab411f7000 rwxp 2aab41100000 00:00 0
2aab411f7000-2aab41200000 ---p 2aab411f7000 00:00 0
2aab41200000-2aab41215000 r-xp 00000000 08:03 2478823
/usr/local/tomcat-web1-6.0.16/appso/confg4app_api_x86_64-suse-linux.so
2aab41215000-2aab41315000 ---p 00015000 08:03 2478823
/usr/local/tomcat-web1-6.0.16/appso/confg4app_api_x86_64-suse-linux.so
2aab41315000-2aab41316000 rwxp 00015000 08:03 2478823
/usr/local/tomcat-web1-6.0.16/appso/confg4app_api_x86_64-suse-linux.so
2aab41316000-2aab41351000 rwxp 2aab41316000 00:00 0
2aab41351000-2aab413ac000 rwxs 00000000 00:08 131075
/SYSV00001b64 (deleted)
2aab41400000-2aab414f9000 rwxp 2aab41400000 00:00 0
2aab414f9000-2aab41500000 ---p 2aab414f9000 00:00 0
2aab41500000-2aab415ea000 rwxp 2aab41500000 00:00 0
2aab415ea000-2aab41600000 ---p 2aab415ea000 00:00 0
2aab41600000-2aab41800000 rwxp 2aab41600000 00:00 0
2aab41800000-2aab418f5000 rwxp 2aab41800000 00:00 0
2aab418f5000-2aab41900000 ---p 2aab418f5000 00:00 0
2aab41900000-2aab419fc000 rwxp 2aab41900000 00:00 0
2aab419fc000-2aab41a00000 ---p 2aab419fc000 00:00 0
2aab41a00000-2aab41bf6000 rwxp 2aab41a00000 00:00 0
2aab41bf6000-2aab41c00000 ---p 2aab41bf6000 00:00 0
2aab41c00000-2aab41c62000 rwxs 00000000 00:08 163844
/SYSV000063d3 (deleted)
2aab41d00000-2aab41df4000 rwxp 2aab41d00000 00:00 0
2aab41df4000-2aab41e00000 ---p 2aab41df4000 00:00 0
2aab41e00000-2aab41eff000 rwxp 2aab41e00000 00:00 0
2aab41eff000-2aab41f00000 ---p 2aab41eff000 00:00 0
2aab41f00000-2aab420f9000 rwxp 2aab41f00000 00:00 0
2aab420f9000-2aab42100000 ---p 2aab420f9000 00:00 0
2aab42100000-2aab42118000 r-xp 00000000 08:03 2478825
/usr/local/tomcat-web1-6.0.16/appso/confg4conf_api_x86_64-suse-linux.so
2aab42118000-2aab42217000 ---p 00018000 08:03 2478825
/usr/local/tomcat-web1-6.0.16/appso/confg4conf_api_x86_64-suse-linux.so
2aab42217000-2aab42219000 rwxp 00017000 08:03 2478825
/usr/local/tomcat-web1-6.0.16/appso/confg4conf_api_x86_64-suse-linux.so
2aab42227000-2aab4230a000 r-xp 00000000 08:01 1092589
/usr/lib64/libstdc++.so.6.0.8
2aab4230a000-2aab4240a000 ---p 000e3000 08:01 1092589
/usr/lib64/libstdc++.so.6.0.8
2aab4240a000-2aab42410000 r-xp 000e3000 08:01 1092589
/usr/lib64/libstdc++.so.6.0.8
2aab42410000-2aab42413000 rwxp 000e9000 08:01 1092589
/usr/lib64/libstdc++.so.6.0.8
2aab42413000-2aab42425000 rwxp 2aab42413000 00:00 0
2aab42425000-2aab42432000 r-xp 00000000 08:01 178177
/lib64/libgcc_s.so.1
2aab42432000-2aab42531000 ---p 0000d000 08:01 178177
/lib64/libgcc_s.so.1
2aab42531000-2aab42532000 rwxp 0000c000 08:01 178177
/lib64/libgcc_s.so.1
2aab42532000-2aab42732000 rwxp 2aab42532000 00:00 0
2aab42732000-2aab42744000 r-xp 00000000 08:03 2478826
/usr/local/tomcat-web1-6.0.16/appso/verifycode_agent_x86_64-suse-linux.so
2aab42744000-2aab42844000 ---p 00012000 08:03 2478826
/usr/local/tomcat-web1-6.0.16/appso/verifycode_agent_x86_64-suse-linux.so
2aab42844000-2aab42845000 rwxp 00012000 08:03 2478826
/usr/local/tomcat-web1-6.0.16/appso/verifycode_agent_x86_64-suse-linux.so
2aab42847000-2aab42a47000 rwxp 2aab42847000 00:00 0
2aab42a88000-2aab42c88000 rwxp 2aab42a88000 00:00 0
2aab42c88000-2aab42ce3000 rwxs 00000000 00:08 131075
/SYSV00001b64 (deleted)
2aab42ce3000-2aab42ce4000 rwxp 2aab42ce3000 00:00 0
2aab42d9e000-2aab42f9e000 rwxp 2aab42d9e000 00:00 0
2aab42fdf000-2aab430df000 rwxp 2aab42fdf000 00:00 0
2aab4315c000-2aab4325c000 rwxp 2aab4315c000 00:00 0
2aab4328f000-2aab4329f000 r-xp 00000000 08:03 2478824
/usr/local/tomcat-web1-6.0.16/appso/confg4cgi_api_x86_64-suse-linux.so
2aab4329f000-2aab4339e000 ---p 00010000 08:03 2478824
/usr/local/tomcat-web1-6.0.16/appso/confg4cgi_api_x86_64-suse-linux.so
2aab4339e000-2aab4339f000 rwxp 0000f000 08:03 2478824
/usr/local/tomcat-web1-6.0.16/appso/confg4cgi_api_x86_64-suse-linux.so
2aab4339f000-2aab433fa000 rwxs 00000000 00:08 131075
/SYSV00001b64 (deleted)
2aab4347b000-2aab4357b000 rwxp 2aab4347b000 00:00 0
2aab43659000-2aab4389a000 rwxp 2aab43659000 00:00 0
2aab43900000-2aab439fb000 rwxp 2aab43900000 00:00 0
2aab439fb000-2aab43a00000 ---p 2aab439fb000 00:00 0
2aab43a00000-2aab43afd000 rwxp 2aab43a00000 00:00 0
2aab43afd000-2aab43b00000 ---p 2aab43afd000 00:00 0
2aab43b00000-2aab43c41000 rwxp 2aab43b00000 00:00 0
2aab43d22000-2aab44322000 rwxp 2aab43d22000 00:00 0
2aab44346000-2aab44546000 rwxp 2aab44346000 00:00 0
2aab44588000-2aab44788000 rwxp 2aab44588000 00:00 0
2aab4485e000-2aab4495e000 rwxp 2aab4485e000 00:00 0
2aab44a37000-2aab44c37000 rwxp 2aab44a37000 00:00 0
2aab44d00000-2aab44f41000 rwxp 2aab44d00000 00:00 0
2aab45033000-2aab45133000 rwxp 2aab45033000 00:00 0
2aab451c4000-2aab454c4000 rwxp 2aab451c4000 00:00 0
2aab454c4000-2aab4552c000 r-xp 00000000 08:03 2478831
/usr/local/tomcat-web1-6.0.16/appso/xss_agent_x86_64-suse-linux.so
2aab4552c000-2aab4562c000 ---p 00068000 08:03 2478831
/usr/local/tomcat-web1-6.0.16/appso/xss_agent_x86_64-suse-linux.so
2aab4562c000-2aab45630000 rwxp 00068000 08:03 2478831
/usr/local/tomcat-web1-6.0.16/appso/xss_agent_x86_64-suse-linux.so
2aab45630000-2aab457f2000 rwxp 2aab45630000 00:00 0
2aab45800000-2aab459f7000 rwxp 2aab45800000 00:00 0
2aab459f7000-2aab45a00000 ---p 2aab459f7000 00:00 0
2aab45a00000-2aab45af1000 rwxp 2aab45a00000 00:00 0
2aab45af1000-2aab45b00000 ---p 2aab45af1000 00:00 0
2aab45b00000-2aab45bfc000 rwxp 2aab45b00000 00:00 0
2aab45bfc000-2aab45c00000 ---p 2aab45bfc000 00:00 0
2aab45c00000-2aab45cff000 rwxp 2aab45c00000 00:00 0
2aab45cff000-2aab45d00000 ---p 2aab45cff000 00:00 0
2aab45d00000-2aab461fd000 rwxp 2aab45d00000 00:00 0
2aab461fd000-2aab46200000 ---p 2aab461fd000 00:00 0
2aab46200000-2aab47500000 rwxp 2aab46200000 00:00 0
2aab47600000-2aab477f4000 rwxp 2aab47600000 00:00 0
2aab477f4000-2aab47800000 ---p 2aab477f4000 00:00 0
2aab47a00000-2aab47c00000 rwxp 2aab47a00000 00:00 0
2aab47d00000-2aab482fb000 rwxp 2aab47d00000 00:00 0
2aab482fb000-2aab48300000 ---p 2aab482fb000 00:00 0
2aab48300000-2aab4907c000 rwxp 2aab48300000 00:00 0
2aab4907c000-2aab49100000 ---p 2aab4907c000 00:00 0
2aab49100000-2aab491ff000 rwxp 2aab49100000 00:00 0
2aab491ff000-2aab49200000 ---p 2aab491ff000 00:00 0
2aab49200000-2aab492ef000 rwxp 2aab49200000 00:00 0
2aab492ef000-2aab49300000 ---p 2aab492ef000 00:00 0
2aab49300000-2aab493f5000 rwxp 2aab49300000 00:00 0
2aab493f5000-2aab49400000 ---p 2aab493f5000 00:00 0
2aab49500000-2aab495f1000 rwxp 2aab49500000 00:00 0
2aab495f1000-2aab49600000 ---p 2aab495f1000 00:00 0
2aab49700000-2aab497ff000 rwxp 2aab49700000 00:00 0
2aab497ff000-2aab49800000 ---p 2aab497ff000 00:00 0
2aab49a00000-2aab49afc000 rwxp 2aab49a00000 00:00 0
2aab49afc000-2aab49b00000 ---p 2aab49afc000 00:00 0
2aab49e00000-2aab4a7f9000 rwxp 2aab49e00000 00:00 0
2aab4a7f9000-2aab4a800000 ---p 2aab4a7f9000 00:00 0
2aab4a800000-2aab4aafb000 rwxp 2aab4a800000 00:00 0
2aab4aafb000-2aab4ab00000 ---p 2aab4aafb000 00:00 0
2aab4ab00000-2aab4ab21000 rwxp 2aab4ab00000 00:00 0
2aab4ab21000-2aab4ac00000 ---p 2aab4ab21000 00:00 0
2aecf3898000-2aecf38b3000 r-xp 00000000 08:01 178115
/lib64/ld-2.4.so
2aecf38b3000-2aecf38b4000 rwxp 2aecf38b3000 00:00 0
2aecf38c2000-2aecf38c3000 rwxp 2aecf38c2000 00:00 0
2aecf39b2000-2aecf39b4000 rwxp 0001a000 08:01 178115
/lib64/ld-2.4.so
2aecf39b4000-2aecf39c6000 r-xp 00000000 08:01 178149
/lib64/libpthread-2.4.so
2aecf39c6000-2aecf3ac5000 ---p 00012000 08:01 178149
/lib64/libpthread-2.4.so
2aecf3ac5000-2aecf3ac7000 rwxp 00011000 08:01 178149
/lib64/libpthread-2.4.so
2aecf3ac7000-2aecf3acb000 rwxp 2aecf3ac7000 00:00 0
2aecf3acb000-2aecf3ad2000 r-xp 00000000 08:01 36631
/usr/java/jdk1.6.0_07/jre/lib/amd64/jli/libjli.so
2aecf3ad2000-2aecf3bd3000 ---p 00007000 08:01 36631
/usr/java/jdk1.6.0_07/jre/lib/amd64/jli/libjli.so
2aecf3bd3000-2aecf3bd5000 rwxp 00008000 08:01 36631
/usr/java/jdk1.6.0_07/jre/lib/amd64/jli/libjli.so
2aecf3bd5000-2aecf3bd7000 r-xp 00000000 08:01 178129
/lib64/libdl-2.4.so
2aecf3bd7000-2aecf3cd7000 ---p 00002000 08:01 178129
/lib64/libdl-2.4.so
2aecf3cd7000-2aecf3cd9000 rwxp 00002000 08:01 178129
/lib64/libdl-2.4.so
2aecf3cd9000-2aecf3cda000 rwxp 2aecf3cd9000 00:00 0
2aecf3cda000-2aecf3e01000 r-xp 00000000 08:01 178123
/lib64/libc-2.4.so
2aecf3e01000-2aecf3f01000 ---p 00127000 08:01 178123
/lib64/libc-2.4.so
2aecf3f01000-2aecf3f04000 r-xp 00127000 08:01 178123
/lib64/libc-2.4.so
2aecf3f04000-2aecf3f06000 rwxp 0012a000 08:01 178123
/lib64/libc-2.4.so
2aecf3f06000-2aecf3f0c000 rwxp 2aecf3f06000 00:00 0
2aecf3f0c000-2aecf4601000 r-xp 00000000 08:01 36675
/usr/java/jdk1.6.0_07/jre/lib/amd64/server/libjvm.so
2aecf4601000-2aecf4700000 ---p 006f5000 08:01 36675
/usr/java/jdk1.6.0_07/jre/lib/amd64/server/libjvm.so
2aecf4700000-2aecf484a000 rwxp 006f4000 08:01 36675
/usr/java/jdk1.6.0_07/jre/lib/amd64/server/libjvm.so
2aecf484a000-2aecf4887000 rwxp 2aecf484a000 00:00 0
2aecf4895000-2aecf48e9000 r-xp 00000000 08:01 178131
/lib64/libm-2.4.so
2aecf48e9000-2aecf49e8000 ---p 00054000 08:01 178131
/lib64/libm-2.4.so
2aecf49e8000-2aecf49ea000 rwxp 00053000 08:01 178131
/lib64/libm-2.4.so
7fffb71fc000-7fffb7212000 rwxp 7fffb71fc000 00:00 0
[stack]
ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0
[vdso]
VM Arguments:
jvm_args: -Xms512m -Xmx2048m -XX:PermSize=128M -XX:MaxNewSize=256m
-XX:MaxPermSize=128m -XX:+UseParallelGC -XX:+UseParallelOldGC
-Dtomcat.log=/data/log/tomcat-web1 -Db2c.log=/data/log/b2c-web1
-Db2c.conf.env=idc -Drunlog.dir=/data/log/b2c-web1
-Dbusilog.dir=/data/log/b2c-web1 -Dfile.encoding=GBK
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=/usr/local/tomcat-web1-6.0.16/conf/logging.properties
-Djava.endorsed.dirs=/usr/local/tomcat-web1-6.0.16/endorsed
-Dcatalina.base=/usr/local/tomcat-web1-6.0.16
-Dcatalina.home=/usr/local/tomcat-web1-6.0.16
-Djava.io.tmpdir=/usr/local/tomcat-web1-6.0.16/temp
java_command: org.apache.catalina.startup.Bootstrap start
Launcher Type: SUN_STANDARD
Environment Variables:
PATH=/home/webadmin/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/usr/lib/mit/bin:/usr/lib/mit/sbin
LD_LIBRARY_PATH=/usr/java/jdk1.6.0_07/jre/lib/amd64/server:/usr/java/jdk1.6.0_07/jre/lib/amd64:/usr/java/jdk1.6.0_07/jre/../lib/amd64
SHELL=/bin/bash
HOSTTYPE=x86_64
OSTYPE=linux
MACHTYPE=x86_64-suse-linux
Signal Handlers:
SIGSEGV: [libjvm.so+0x661750], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGBUS: [libjvm.so+0x661750], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGFPE: [libjvm.so+0x504550], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGPIPE: [libjvm.so+0x504550], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGXFSZ: [libjvm.so+0x504550], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGILL: [libjvm.so+0x504550], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x5067c0], sa_mask[0]=0x00000000, sa_flags=0x10000004
SIGHUP: [libjvm.so+0x506520], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGTERM: [libjvm.so+0x506520], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGQUIT: [libjvm.so+0x506520], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004

---------------  S Y S T E M  ---------------
OS:SUSE Linux Enterprise Server 10 (x86_64)
VERSION = 10
PATCHLEVEL = 1
uname:Linux 2.6.16.54-0.2.3-TENCENT64-080623 #1 SMP Thu Jun 26 16:14:47 CST
2008 x86_64
libc:glibc 2.4 NPTL 2.4
rlimit: STACK 8192k, CORE 0k, NPROC 70655, NOFILE 1024, AS infinity
load average:0.30 0.16 0.10
CPU:total 4 (4 cores per cpu, 1 threads per core) family 6 model 15 stepping
11, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3
Memory: 4k page, physical 8178264k(1723028k free), swap 2104504k(2104504k
free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (10.0-b23) for linux-amd64 JRE
(1.6.0_07-b06), built on Jun 10 2008 01:53:27 by "java_re" with gcc 3.2.2
(SuSE Linux)
time: Sun Apr 19 23:00:29 2009
elapsed time: 188802 seconds
------------------------

Re: JVM crash issue

Posted by Dan Armbrust <da...@gmail.com>.
On Thu, Apr 23, 2009 at 3:59 PM, Anthony J. Biacco
<ab...@formatdynamics.com> wrote:
> This is a little OT, but I'm interested to see if oracle decides to
> merge their BEA acquisition jrockit product with sun's JDK or just picks
> one of them to represent.

Hopefully they at least merge together the developers.  I get the
feeling that Sun has about 3 experts and 3 interns working on the JVM
lately, and no one else.  The last time I filed a bug report with them
(which, coincidently, was a JVM crash issue) with a test case that
made it trivial to reproduce, it was 2 months before they would even
acknowledge the bug, and move it from their private issue tracker to
their public bug tracker.

Sigh.

Dan

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


RE: JVM crash issue

Posted by "Anthony J. Biacco" <ab...@formatdynamics.com>.
This is a little OT, but I'm interested to see if oracle decides to
merge their BEA acquisition jrockit product with sun's JDK or just picks
one of them to represent.

-Tony
---------------------------
Manager, IT Operations
Format Dynamics, Inc.
303-573-1800x27
abiacco@formatdynamics.com
http://www.formatdynamics.com


> -----Original Message-----
> From: Dan Armbrust [mailto:daniel.armbrust.list@gmail.com]
> Sent: Thursday, April 23, 2009 2:56 PM
> To: Tomcat Users List
> Subject: Re: JVM crash issue
> 
> JVM crashes seem to be a common issue lately.  We tried to move our
> main apps from JRE 1.5 to 1.6 about 6 months ago, and had to give up
> and revert because we couldn't find any 1.6 or early 1.7 JVM's that
> were stable.  They all had random crashes on hardware that runs the
> same software perfectly fine with a 1.5 JVM.  Personally, I think it's
> because of Suns dismal care of java as a whole, lately.  Hopefully,
> things will change for the better with the upcoming OpenJDK 1.7, or
> with Oracle's takeover.    Certainly couldn't get much worse.
> 
> But I would start JVM shopping.  Back to 1.5, or over to IBM's JVM, or
> perhaps Apache Harmony.  At least they will make an effort to respond
> to bug reports.
> 
> Good luck,
> 
> Dan
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: JVM crash issue

Posted by Dan Armbrust <da...@gmail.com>.
JVM crashes seem to be a common issue lately.  We tried to move our
main apps from JRE 1.5 to 1.6 about 6 months ago, and had to give up
and revert because we couldn't find any 1.6 or early 1.7 JVM's that
were stable.  They all had random crashes on hardware that runs the
same software perfectly fine with a 1.5 JVM.  Personally, I think it's
because of Suns dismal care of java as a whole, lately.  Hopefully,
things will change for the better with the upcoming OpenJDK 1.7, or
with Oracle's takeover.    Certainly couldn't get much worse.

But I would start JVM shopping.  Back to 1.5, or over to IBM's JVM, or
perhaps Apache Harmony.  At least they will make an effort to respond
to bug reports.

Good luck,

Dan

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: JVM crash issue

Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Jochen,

On 4/24/2009 12:55 AM, jochen wrote:
> No JNI frames in the stack dump also confused me a lot, but
> "LJava/lang/String" was one of parameter structure defined by our C code. I
> don't know if any other Java code including JDK, tomcat, or struts, would
> define the structure like this, if have, please remind me.

Assuming you mean "Ljava/lang/String", this just means that your JNI
code calls a method that takes a String argument, or returns a String
result. It's just a red herring, since most Java code in the world
contains that series of characters because String usage is so prevalent.

- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAknxs+MACgkQ9CaO5/Lv0PDIgwCfZ+1KsExQmL7A6gunmu7DvEtA
wPcAniG+ufS3MQpBjhN91GD5Xf5XGXGn
=0ZiK
-----END PGP SIGNATURE-----

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: JVM crash issue

Posted by jochen <so...@gmail.com>.
chris,

The hardware has same identical spec with others, and hosting for internet
service independent, and the model of hardware is very popular and proven to
be used in internet service, of course, it still needs check to ensure its
quality. I will ask hardware team for help to check that points you
mentioned, perhaps a long-time hardware test is needed.

No JNI frames in the stack dump also confused me a lot, but
"LJava/lang/String" was one of parameter structure defined by our C code. I
don't know if any other Java code including JDK, tomcat, or struts, would
define the structure like this, if have, please remind me.

On Thu, Apr 23, 2009 at 11:16 PM, Christopher Schultz <
chris@christopherschultz.net> wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Jochen,
>
> On 4/23/2009 4:14 AM, jochen wrote:
> > Thanks for Peter,  the hardware is the same box with production
> > machine
>
> Do you mean the same physical machine, or a machine with identical
> specs? If the former, that's bad. If the latter, that's good, but
> irrelevant. You might just have drawn the short straw on some RAM.
>
> > and those type of machines works very well for serving large-load
> > internet service, and the hardware itself already hosted very well
> > for half year before I deployed new functions to it.
>
> You wouldn't be the first one to experience hardware failure after
> things were running well. Seriously, if you can't blame this on your JNI
> code, just test the hardware. You can spend months looking at code and
> finding nothing if your hardware has gone bad. Do yourself a favor and
> run a hardware test -- you can even run it overnight and sleep while the
> work is being done for you :)
>
> > Again the new functions worked fine for several days, and crashed
> > twice. It seemed the crashes always happen at the same point of those
> > new function code, not in xwork2.
>
> Interesting.
>
> > Your reply reminds me on the
> > "DefaultActionInvocation.invoke()Ljava/lang/String", maybe it is the
> > fault of JNI code, which was invoked by xwork2, to call some native C
> > code to finish something jobs. I'll try to reproduce it and confirm
> > if it's the JNI fault.
>
> I didn't see any JNI frames in the stack dump, but it's possible that
> you have JNI code that is mangling something in memory and the JVM later
> goes in and tries to de-reference it, and you get a SIGSEGV.
>
> Are you actually running any of your own native code?
>
> - -chris
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.9 (MingW32)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAknwhlwACgkQ9CaO5/Lv0PBkXwCgmx7aYdrf8q7JZ5xuxvTyYNDs
> LvoAn3kbaT69rSiBhe4RAOypSlQffxNi
> =m2r0
> -----END PGP SIGNATURE-----
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>

Re: JVM crash issue

Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Jochen,

On 4/23/2009 4:14 AM, jochen wrote:
> Thanks for Peter,  the hardware is the same box with production
> machine

Do you mean the same physical machine, or a machine with identical
specs? If the former, that's bad. If the latter, that's good, but
irrelevant. You might just have drawn the short straw on some RAM.

> and those type of machines works very well for serving large-load
> internet service, and the hardware itself already hosted very well
> for half year before I deployed new functions to it.

You wouldn't be the first one to experience hardware failure after
things were running well. Seriously, if you can't blame this on your JNI
code, just test the hardware. You can spend months looking at code and
finding nothing if your hardware has gone bad. Do yourself a favor and
run a hardware test -- you can even run it overnight and sleep while the
work is being done for you :)

> Again the new functions worked fine for several days, and crashed
> twice. It seemed the crashes always happen at the same point of those
> new function code, not in xwork2.

Interesting.

> Your reply reminds me on the 
> "DefaultActionInvocation.invoke()Ljava/lang/String", maybe it is the
> fault of JNI code, which was invoked by xwork2, to call some native C
> code to finish something jobs. I'll try to reproduce it and confirm
> if it's the JNI fault.

I didn't see any JNI frames in the stack dump, but it's possible that
you have JNI code that is mangling something in memory and the JVM later
goes in and tries to de-reference it, and you get a SIGSEGV.

Are you actually running any of your own native code?

- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAknwhlwACgkQ9CaO5/Lv0PBkXwCgmx7aYdrf8q7JZ5xuxvTyYNDs
LvoAn3kbaT69rSiBhe4RAOypSlQffxNi
=m2r0
-----END PGP SIGNATURE-----

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: JVM crash issue

Posted by jochen <so...@gmail.com>.
Thanks for Peter,  the hardware is the same box with production machine, and
those type of machines works very well for serving large-load internet
service, and the hardware itself already hosted very well for half year
before I deployed new functions to it.  Again the new functions worked fine
for several days, and crashed twice. It seemed the crashes always happen at
the same point of those new function code, not in xwork2.
Your reply reminds me on the
"DefaultActionInvocation.invoke()Ljava/lang/String", maybe it is the fault
of JNI code, which was invoked by xwork2, to call some native C code to
finish something jobs. I'll try to reproduce it and confirm if it's the JNI
fault. thanks.

Best regards,
Jochen

On Thu, Apr 23, 2009 at 2:36 PM, Peter Crowther <Peter.Crowther@melandra.com
> wrote:

> > From: jochen [mailto:songzhou.cn@gmail.com]
> > I deployed an inhouse application in Tomcat 6.0 and I
> > experienced random JVM crashes for two weeks.
>
> Are you *absolutely certain* your hardware is good?  We've had several
> reports of JVM crashes on this list where the real problem is faulty
> hardware - usually bad RAM.  It's far more common than most people realise.
>  Test by running the application on different hardware.
>
> [...]
> > Native frames: (J=compiled Java code, j=interpreted, Vv=VM
> > code, C=native code)
> > V  [libjvm.so+0x3678c8]
> > Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> > v  ~BufferBlob::Interpreter
> [...]
> > java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/
> > Object;)Ljava/lang/Object;
> > v  ~BufferBlob::Interpreter
> > J
> > com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/
> lang/String;
> [...]
>
> The code that is closest to the crash is this OpenSymphony code, which is
> then invoking something by reflection when the crash happens.
>
> Do the crashes always happen at the same point in the code?  If so, I'd ask
> OpenSymphony :-).  If not, I suspect bad hardware - but you might want to
> analyse several crash dumps to look for common factors.
>
>                - Peter
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>

RE: JVM crash issue

Posted by Peter Crowther <Pe...@melandra.com>.
> From: jochen [mailto:songzhou.cn@gmail.com]
> I deployed an inhouse application in Tomcat 6.0 and I
> experienced random JVM crashes for two weeks.

Are you *absolutely certain* your hardware is good?  We've had several reports of JVM crashes on this list where the real problem is faulty hardware - usually bad RAM.  It's far more common than most people realise.  Test by running the application on different hardware.

[...]
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM
> code, C=native code)
> V  [libjvm.so+0x3678c8]
> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> v  ~BufferBlob::Interpreter
[...]
> java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/
> Object;)Ljava/lang/Object;
> v  ~BufferBlob::Interpreter
> J
> com.opensymphony.xwork2.DefaultActionInvocation.invoke()Ljava/
lang/String;
[...]

The code that is closest to the crash is this OpenSymphony code, which is then invoking something by reflection when the crash happens.

Do the crashes always happen at the same point in the code?  If so, I'd ask OpenSymphony :-).  If not, I suspect bad hardware - but you might want to analyse several crash dumps to look for common factors.

                - Peter

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org