You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by Taylan Develioglu <td...@ebuddy.com> on 2010/03/03 10:11:43 UTC
Re: jvm exits without trace
Downgrading to 1.6.0_16 did not help. I'm replacing the apr connector
with http now.
On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
> Taylan,
>
> > The failures we've seen are in anywhere between 8 hours to a week of
> > runtime.
>
> The timing of the failures seems similar.
>
> > We have also had failures with hotspot error files (hs_err) present, and
> > the cause specified was indeed SIGSEGV indicating a page fault.
>
> I have never seen any hs_* files but have seen core files where strace
> showed the jvm stopped on a seg fault.
>
> > We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> > the situation allows (during regular updates of the application, or a
> > crash) to see if that helps.
>
> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results... have not
> tried 1.6.0_16. Please post your results of this trial.
>
> > Running tomcat on the
> > foreground might show something, but then again I could be waiting for a
> > month for it to happen.
>
> Yes, this has been part of my problem as anytime we change something, we
> have to wait a week for the server to fail.
>
> In one sense, I am fortunate that I have a little more flexibility than you.
> I have two servers (different hardware) but only need one in service at a
> time. Therefore, I always have one server I can test ideas on although I
> have never been able to develop a meaningful stress test, i.e., the only way
> I can test a change is to put it in production.
>
> Thanks,
>
> Carl
>
> ----- Original Message -----
> From: "Taylan Develioglu" <td...@ebuddy.com>
> To: "Tomcat Users List" <us...@tomcat.apache.org>
> Sent: Wednesday, February 24, 2010 8:31 AM
> Subject: Re: jvm exits without trace
>
>
> > Hello Carl,
> >
> > The failures we've seen are in anywhere between 8 hours to a week of
> > runtime. Most of them have (still) been running for almost a month
> > without failure. There are ~100 machines.
> >
> >>From the top of my head, I think we've had about 10+ failures now.
> >
> > We have also had failures with hotspot error files (hs_err) present, and
> > the cause specified was indeed SIGSEGV indicating a page fault. But I
> > don't know if the two are related.
> >
> > We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> > the situation allows (during regular updates of the application, or a
> > crash) to see if that helps.
> >
> > It might be useful to note that the failures happen with tomcat 6.0.20
> > as well as 6.0.24.
> >
> > As far as load concerns, I haven't had a failure on an idle machines.
> > The machines are well loaded, but only at a fraction limit in regards to
> > load and cpu utilization.
> > Most memory is commited to tomcat, where a 24G machine would have 18G
> > allocated to heap, 128M to permgen and some unspecified amount would get
> > used by jni for apr. About 4G remains free after calculating taking into
> > account the jvm itsself.
> > A 16G machine would have 12G allocated to the heap.
> >
> > Besides the fact that our apps heavily use nio and mina I wouldn't say
> > there's anything else noteworthy. There can be anywhere up to 10000
> > concurrents on one machine.
> >
> > I had searched for coredumps, but no luck. Running tomcat on the
> > foreground might show something, but then again I could be waiting for a
> > month for it to happen.
> >
> > On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
> >> Taylan,
> >>
> >> I am the person who started the "Tomcat dies suddenly" thread which I
> >> still
> >> haven't resolved. I am curious about the pattern of failures you are
> >> experiencing because they may provide some clues to my problem. In my
> >> case,
> >> the system will run for 15 minutes to 10 days before failing (most of the
> >> time it is several days to a week.) It appears to die from a seg fault
> >> in
> >> the JVM (I am using Sun 1.6.0_18 but have tried previous versions)... you
> >> may be able to see the cause of the failure from the core file (the core
> >> files on my systems were in several directories so you may have to do a
> >> 'find' to locate them.) Load may be a factor but the failures generally
> >> come after the load has been heavy for a while. I am running a couple of
> >> applications and it seems the failures are more frequent when people are
> >> hitting the additional apps (the primary app is always used, the
> >> remaining
> >> apps are used sporatically.)
> >>
> >> How does this compare to what you are experiencing?
> >>
> >> Thanks,
> >>
> >> Carl
> >>
> >> ----- Original Message -----
> >> From: "Taylan Develioglu" <td...@ebuddy.com>
> >> To: "Tomcat Users List" <us...@tomcat.apache.org>; <pi...@pidster.com>
> >> Sent: Wednesday, February 24, 2010 5:09 AM
> >> Subject: Re: jvm exits without trace
> >>
> >>
> >> > The GC log shows plenty of heap space left in all the spaces.
> >> >
> >> > I purposely didn't bother replacing the variables because I figured
> >> > they
> >> > would not be relevant.
> >> >
> >> > But if you think they might provide clues they're as follows:
> >> >
> >> > JAVA_HEAP_SIZE=18432M
> >> > JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed 's/M$\|G$//')/6))M
> >> > JAVA_PERM_SIZE=128M
> >> > JAVA_STCK_SIZE=128K
> >> >
> >> > EDEN_SIZE is 1/6th of total heap.
> >> >
> >> > And I said there was nothing in the system logs.
> >> > But you get a couple of points for trying.
> >> >
> >> > On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
> >> >> On 24/02/2010 09:36, Taylan Develioglu wrote:
> >> >> > I thought I'd add the connector definitions too, :
> >> >> >
> >> >> > <Connector port="80"
> >> >> > protocol="org.apache.coyote.http11.Http11AprProtocol"
> >> >> > compression="1024" keepAliveTimeout="60000"
> >> >> > maxKeepAliveRequests="-1"
> >> >> > enableLookups="false" redirectPort="443"
> >> >> > maxThreads="150"
> >> >> > pollerSize="32768"
> >> >> > pollerThreadCount="4"/>
> >> >> >
> >> >> > <Connector port="443"
> >> >> > protocol="org.apache.coyote.http11.Http11AprProtocol"
> >> >> > SSLEnabled="true"
> >> >> > enableLookups="false" maxThreads="10" scheme="https"
> >> >> > secure="true"
> >> >> > SSLCertificateFile="/etc/ssl/private/something.crt"
> >> >> >
> >> >> > SSLCertificateKeyFile="/etc/ssl/private/something.key"
> >> >> > SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
> >> >> >
> >> >> >
> >> >> > On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
> >> >> >> Hi,
> >> >> >>
> >> >> >> I have jvm's, running tomcat and our application, exiting
> >> >> >> mysteriously,
> >> >> >> and was wondering if anyone could give me some advice on how to
> >> >> >> debug
> >> >> >> this thing.
> >> >> >>
> >> >> >> There is nothing in catalina.out, nor our application logs, and no
> >> >> >> hotspot error file. GC log looks normal. No trace in system logs.
> >> >> >>
> >> >> >> I am left completely clueless :(, has anyone dealt with a problem
> >> >> >> like
> >> >> >> this before?
> >> >> >>
> >> >> >> Any help appreciated.
> >> >> >>
> >> >> >> - Tomcat 6.0.24
> >> >> >> - TC native 1.1.18
> >> >> >> - APR 1.3.9
> >> >> >> - Sun JDK 6u18
> >> >> >> - Debian Lenny, 2.6.31.10-amd64
> >> >> >>
> >> >> >> 2 servlets, one as ROOT. 2 HTTP connectors that use TCNative/APR.
> >> >> >>
> >> >> >> JAVA_OPTS ( ):
> >> >> >>
> >> >> >> -verbose:gc
> >> >> >> -Djava.awt.headless=true
> >> >> >> -Dsun.net.inetaddr.ttl=60
> >> >> >> -Dfile.encoding=UTF-8
> >> >> >> -Djava.io.tmpdir=$TMP_DIR
> >> >> >> -Djava.library.path=/usr/local/lib
> >> >> >> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
> >> >> >> -Dcatalina.base=$CATALINA_BASE
> >> >> >> -Dcatalina.home=$CATALINA_HOME
> >> >>
> >> >> >> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> >> >> >> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
> >> >> >> -XX:+PrintGCDetails
> >> >> >> -Xloggc:$CATALINA_BASE/logs/gc.log
> >> >> >> -XX:+UseConcMarkSweepGC
> >> >> >> -XX:CMSInitiatingOccupancyFraction=70
> >> >> >> -Xms$JAVA_HEAP_SIZE
> >> >> >> -Xmx$JAVA_HEAP_SIZE
> >> >> >> -XX:NewSize=$JAVA_EDEN_SIZE
> >> >> >> -XX:MaxNewSize=$JAVA_EDEN_SIZE
> >> >> >> -XX:PermSize=$JAVA_PERM_SIZE
> >> >> >> -XX:MaxPermSize=$JAVA_PERM_SIZE
> >> >> >> -Xss$JAVA_STCK_SIZE
> >> >> >> -XX:+UseLargePages
> >> >>
> >> >> There's no actual heap size settings in the above. But you get a
> >> >> couple
> >> >> of points for trying.
> >> >>
> >> >> Google "Linux Out Of Memory killer" or "OOM Killer" and then check the
> >> >> server logs carefully. (e.g. /var/log/messages)
> >> >>
> >> >>
> >> >> p
> >> >>
> >> >> > ---------------------------------------------------------------------
> >> >> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> >> > For additional commands, e-mail: users-help@tomcat.apache.org
> >> >> >
> >> >>
> >> >>
> >> >> ---------------------------------------------------------------------
> >> >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> >> For additional commands, e-mail: users-help@tomcat.apache.org
> >> >>
> >> >
> >> >
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > For additional commands, e-mail: users-help@tomcat.apache.org
> >> >
> >> >
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> For additional commands, e-mail: users-help@tomcat.apache.org
> >>
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > For additional commands, e-mail: users-help@tomcat.apache.org
> >
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Pid <pi...@pidster.com>.
On 05/03/2010 17:21, Christopher Schultz wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Chuck,
>
> On 3/5/2010 10:07 AM, Caldarale, Charles R wrote:
>>> From: Christopher Schultz [mailto:chris@christopherschultz.net]
>>> Subject: Re: jvm exits without trace
>>>
>>> Do you have a lot of static resources being served?
>>
>> Or still allow keep-alives with the non-NIO connector?
>
> I thought he said he was using APR, not NIO. I would have expected that
> JIO vs. APR would be roughly the same unless SSL or sendFile was getting
> significant use. NIO of course has a different threading model, so that
> would make sense.
The OP was using HTTP APR + SSL and is now trying the HTTP JIO + SSL
connector. (It's not clear how much of the work is conducted over HTTPS.)
We are hoping that the HTTP connector doesn't exhibit the same fault,
because then we'll know that the native stuff has an issue, probably
between 1.1.17 and 1.1.20.
http://tomcat.apache.org/native-doc/miscellaneous/changelog.html
p
> - -chris
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.10 (MingW32)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAkuRPYkACgkQ9CaO5/Lv0PCVzQCeIIVq9ytWtbuou1X+Xfgq6dm4
> bW4AoIQnno0lrU3AuztXxf0kut1ZG77k
> =bchZ
> -----END PGP SIGNATURE-----
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
Sorry I wasn't clear.
I didn't mean 2172 concurrent requests. Just sessions.
It hadn't occured to me that the number of sessions does not necessarily
equal the number of connections (duh).
the number of established connections indeed equals the number of
threads. So what Chuck said was true.
On Tue, 2010-03-09 at 19:29 +0100, André Warnier wrote:
> Taylan Develioglu wrote:
> > Chuck, if that is true how can we explain I see only 637 busy threads on
> > a server that is serving 2172 clients ?
>
> Woaw ! can you give us your trick ?
>
> >
> > If every connection requires its own thread there should be 2172
> > threads.
>
> Seriously now : when a thread is finished serving a request, there is
> still some time during which the response bytes are cascading through
> the network to the clients.
> I think you need to defined "serving 2172 clients" a bit more precisely
> before you can say this, no ?
>
>
> >
> > On Tue, 2010-03-09 at 16:40 +0100, Caldarale, Charles R wrote:
> >>> From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
> >>> Subject: RE: jvm exits without trace
> >>>
> >>> where peak busy-threads used to be ~50 with APR, now it has become ~200
> >>> with JIO.
> >> To be expected when you have unlimited keep-alives configured. Each HTTP connection requires a separate thread with JIO, whereas the NIO and APR connectors use a single poller thread.
> >>
> >> - Chuck
> >>
> >>
> >> THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
> >>
> >>
> >> ______________________________________________________________________
> >> This email has been scanned by the MessageLabs Email Security System.
> >> For more information please visit http://www.messagelabs.com/email
> >> ______________________________________________________________________
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > For additional commands, e-mail: users-help@tomcat.apache.org
> >
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by André Warnier <aw...@ice-sa.com>.
Taylan Develioglu wrote:
> Chuck, if that is true how can we explain I see only 637 busy threads on
> a server that is serving 2172 clients ?
Woaw ! can you give us your trick ?
>
> If every connection requires its own thread there should be 2172
> threads.
Seriously now : when a thread is finished serving a request, there is
still some time during which the response bytes are cascading through
the network to the clients.
I think you need to defined "serving 2172 clients" a bit more precisely
before you can say this, no ?
>
> On Tue, 2010-03-09 at 16:40 +0100, Caldarale, Charles R wrote:
>>> From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
>>> Subject: RE: jvm exits without trace
>>>
>>> where peak busy-threads used to be ~50 with APR, now it has become ~200
>>> with JIO.
>> To be expected when you have unlimited keep-alives configured. Each HTTP connection requires a separate thread with JIO, whereas the NIO and APR connectors use a single poller thread.
>>
>> - Chuck
>>
>>
>> THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
>>
>>
>> ______________________________________________________________________
>> This email has been scanned by the MessageLabs Email Security System.
>> For more information please visit http://www.messagelabs.com/email
>> ______________________________________________________________________
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
> Subject: RE: jvm exits without trace
>
> If every connection requires its own thread there should be 2172
> threads.
Only if the client *chooses* to maintain the keep-alive. Browsers and other clients are free to terminate the connection any time they wish. All the server can do is deny the keep-alive; it can't initiate it.
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
______________________________________________________________________
This email has been scanned by the MessageLabs Email Security System.
For more information please visit http://www.messagelabs.com/email
______________________________________________________________________
RE: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
Chuck, if that is true how can we explain I see only 637 busy threads on
a server that is serving 2172 clients ?
If every connection requires its own thread there should be 2172
threads.
On Tue, 2010-03-09 at 16:40 +0100, Caldarale, Charles R wrote:
> > From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
> > Subject: RE: jvm exits without trace
> >
> > where peak busy-threads used to be ~50 with APR, now it has become ~200
> > with JIO.
>
> To be expected when you have unlimited keep-alives configured. Each HTTP connection requires a separate thread with JIO, whereas the NIO and APR connectors use a single poller thread.
>
> - Chuck
>
>
> THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
>
>
> ______________________________________________________________________
> This email has been scanned by the MessageLabs Email Security System.
> For more information please visit http://www.messagelabs.com/email
> ______________________________________________________________________
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
> Subject: RE: jvm exits without trace
>
> where peak busy-threads used to be ~50 with APR, now it has become ~200
> with JIO.
To be expected when you have unlimited keep-alives configured. Each HTTP connection requires a separate thread with JIO, whereas the NIO and APR connectors use a single poller thread.
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
______________________________________________________________________
This email has been scanned by the MessageLabs Email Security System.
For more information please visit http://www.messagelabs.com/email
______________________________________________________________________
RE: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
The switch is from APR to JIO. SSL practically doesn't get used.
Almost all pages served are jsp or java, very little static files are
served and keep-alive is on.
where peak busy-threads used to be ~50 with APR, now it has become ~200
with JIO.
Here are the connector definitions for reference (no executor is used):
- APR:
<Connector port="80"
protocol="org.apache.coyote.http11.Http11AprProtocol"
compression="1024" keepAliveTimeout="60000"
maxKeepAliveRequests="-1"
enableLookups="false" redirectPort="443" maxThreads="150"
pollerSize="32768"
/>
- JIO:
<Connector port="80"
protocol="org.apache.coyote.http11.Http11Protocol"
compression="1024" connectionTimeout="10000"
keepAliveTimeout="60000" maxKeepAliveRequests="-1"
enableLookups="false" redirectPort="443"
maxThreads="720"/>
On Fri, 2010-03-05 at 19:13 +0100, Caldarale, Charles R wrote:
> > From: Christopher Schultz [mailto:chris@christopherschultz.net]
> > Subject: Re: jvm exits without trace
> >
> > I thought he said he was using APR, not NIO.
>
> He was, but IIRC, switched away from it to see if that would affect the outages. What we don't know is what was switched to - JIO or NIO. If it's JIO, there may be a lot of threads tied up handling persistent HTTP connections, possibly causing heap or other resource problems.
>
> - Chuck
>
>
> THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Christopher Schultz [mailto:chris@christopherschultz.net]
> Subject: Re: jvm exits without trace
>
> I thought he said he was using APR, not NIO.
He was, but IIRC, switched away from it to see if that would affect the outages. What we don't know is what was switched to - JIO or NIO. If it's JIO, there may be a lot of threads tied up handling persistent HTTP connections, possibly causing heap or other resource problems.
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
Re: jvm exits without trace
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Chuck,
On 3/5/2010 10:07 AM, Caldarale, Charles R wrote:
>> From: Christopher Schultz [mailto:chris@christopherschultz.net]
>> Subject: Re: jvm exits without trace
>>
>> Do you have a lot of static resources being served?
>
> Or still allow keep-alives with the non-NIO connector?
I thought he said he was using APR, not NIO. I would have expected that
JIO vs. APR would be roughly the same unless SSL or sendFile was getting
significant use. NIO of course has a different threading model, so that
would make sense.
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkuRPYkACgkQ9CaO5/Lv0PCVzQCeIIVq9ytWtbuou1X+Xfgq6dm4
bW4AoIQnno0lrU3AuztXxf0kut1ZG77k
=bchZ
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Christopher Schultz [mailto:chris@christopherschultz.net]
> Subject: Re: jvm exits without trace
>
> Do you have a lot of static resources being served?
Or still allow keep-alives with the non-NIO connector?
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
Re: jvm exits without trace
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Taylan,
On 3/5/2010 4:45 AM, Taylan Develioglu wrote:
> It's performing rather poorly performance wise, compared to the apr
> connector. The number of threads required to handle the requests has
> gone up significantly over the board.
That's interesting. Do you have a lot of static resources being served?
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkuRHTEACgkQ9CaO5/Lv0PAcvgCdGgsGpip78k06ca1SMwxXPzZO
4wAAoLKlLKPoY67GE4ZIRKEf3I2glzGP
=l7vd
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by Konstantin Kolinko <kn...@gmail.com>.
2010/4/1 Konstantin Kolinko <kn...@gmail.com>:
>> [snip]
>>
>>> # Problematic frame:
>>> # C [libapr-1.so.0+0x1c0a0]
>>
>> [snip]
>>>
>>> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
>>> j org.apache.tomcat.jni.Socket.accept(J)J+0
>>
>> So, this happens in APR's Socket.accept method? I suspect that if
>> something were wrong in that method, it would be apparent to roughly 50%
>> of the world's web servers.
>>
>
> That is TC-Native's Socket.accept method.
Actually yet, it is some APR method, called from TC-Native's
Socket.accept(). I was a bit confused that BZ 48584 mentions only
"tcnative-1.dll", but that is because APR + TC-Native are statically
linked into single DLL in the Windows versions of TC-Native.
The error should be happening in APR (because another thread already
destroyed one of APR pools during shutdown -- see BZ 48584 for
details).
There are certainly some native call frames between Java class of
"org.apache.tomcat.jni.Socket" and that native frame of "libapr-1.so"
(because Java code calls its native counterpart, and not directly the APR),
but those are not shown in the stack dump.
Best regards,
Konstantin Kolinko
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by Konstantin Kolinko <kn...@gmail.com>.
> [snip]
>
>> # Problematic frame:
>> # C [libapr-1.so.0+0x1c0a0]
>
> [snip]
>>
>> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
>> j org.apache.tomcat.jni.Socket.accept(J)J+0
>
> So, this happens in APR's Socket.accept method? I suspect that if
> something were wrong in that method, it would be apparent to roughly 50%
> of the world's web servers.
>
That is TC-Native's Socket.accept method.
If that happens at shutdown, then that is a known issue:
https://issues.apache.org/bugzilla/show_bug.cgi?id=48584
It is already fixed in native 1.1.20.
Best regards,
Konstantin Kolinko
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: [OT] Re: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Christopher Schultz [mailto:chris@christopherschultz.net]
> Subject: Re: [OT] Re: jvm exits without trace
>
> So, this happens in APR's Socket.accept method? I suspect that if
> something were wrong in that method, it would be apparent to roughly
> 50% of the world's web servers.
Depends. Try turning off IPv6 and see what happens. Some versions of glibc on some platforms seem to have problems with it.
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
Re: [OT] Re: jvm exits without trace
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Taylan,
On 3/30/2010 5:51 AM, Taylan Develioglu wrote:
> We're still having some crashes (segfaults), they may or not be related
> to the previous ones.
:(
> It seems libapr had something to do with it.
[snip]
> # Problematic frame:
> # C [libapr-1.so.0+0x1c0a0]
[snip]
> Stack: [0x0000000041d86000,0x0000000041da7000], sp=0x0000000041da57d0,
> free space=7d0000000000000018k
> Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
> C=native code)
> C [libapr-1.so.0+0x1c0a0]
>
> Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
> j org.apache.tomcat.jni.Socket.accept(J)J+0
So, this happens in APR's Socket.accept method? I suspect that if
something were wrong in that method, it would be apparent to roughly 50%
of the world's web servers.
Do you have large electromagnetic flux sources anywhere near your
servers? Your problems just don't seem to make any kind of sense whatsoever.
Can you bring a server to your home and hit it with JMeter for a week or
so and see if you can get it to crash? Maybe you have toxic mold in your
rack and the JVM is trying to commit suicide to put itself out of its
misery...
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkuzqPgACgkQ9CaO5/Lv0PD7rgCcDWhOzY93YAxoRcGvoXcx9awM
TbYAoIP641cecvi4SVpaW1ZW4nWnP/gS
=IV6q
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
We're still having some crashes (segfaults), they may or not be related
to the previous ones.
It seems libapr had something to do with it.
The hs_err :
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007fd49129b0a0, pid=16402, tid=1104832848
#
# JRE version: 6.0_18-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode
linux-amd64 )
# Problematic frame:
# C [libapr-1.so.0+0x1c0a0]
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
--------------- T H R E A D ---------------
Current thread (0x00007fd48d305800): JavaThread "http-80-Acceptor-0"
daemon [_thread_in_native, id=16469,
stack(0x0000000041d86000,0x0000000041da7000)]
siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
si_addr=0x0000000000000000
Registers:
RAX=0x0000000000000000, RBX=0x0000000000000000, RCX=0x000000000000000a,
RDX=0x0000000000000000
RSP=0x0000000041da57d0, RBP=0x00000000000000e3, RSI=0x00007fd4893b3f20,
RDI=0x0000000000000000
R8 =0x00007fd48c457ff0, R9 =0x00007fd491e12a00, R10=0x00007fd4ab8f5c1b,
R11=0x0000000000000202
R12=0x00007fd4893b1f48, R13=0x0000000000000000, R14=0x0000000041da58f0,
R15=0x00007fd48d305800
RIP=0x00007fd49129b0a0, EFL=0x0000000000010246,
CSGSFS=0x0000000000000033, ERR=0x0000000000000006
TRAPNO=0x000000000000000e
Top of Stack: (sp=0x0000000041da57d0)
0x0000000041da57d0: 0000000000000000 00007fd48c1328e0
0x0000000041da57e0: 0000000041da58f0 00007fd4893b1f48
0x0000000041da57f0: 0000000041da59a0 00007fd49129b471
0x0000000041da5800: 0000000041da5830 00007fd4b01e6c68
0x0000000041da5810: 0000000041da5850 0000000000000000
0x0000000041da5820: 0000000000000010 00007fd4688b4e30
0x0000000041da5830: 0000000041da5840 00007fd4b02a6768
0x0000000041da5840: c30bf03f38c50002 0000000000000000
0x0000000041da5850: 00007fd48d305800 00007fd48d305800
0x0000000041da5860: 00002aac28c05998 0000000041da5930
0x0000000041da5870: 0000000041da59a8 00007fd4893b1f48
0x0000000041da5880: 00007fd48c457fe8 00007fd48c162290
0x0000000041da5890: 00007fd48c134838 0000000000000000
0x0000000041da58a0: 0000000041da58f8 00007fd491296ee1
0x0000000041da58b0: 0000000041da5910 00007fd48c1328a8
0x0000000041da58c0: 0000000041da5978 00007fd48c1328a8
0x0000000041da58d0: 00007fd4893b1fc8 00007fd48d3059b8
0x0000000041da58e0: 00002aaf2b4be058 00007fd491aabb6a
0x0000000041da58f0: 0000000000000000 00007fd4893b1f48
0x0000000041da5900: 00002aaf2b4be060 0000000041da5978
0x0000000041da5910: 0000000041da5900 00007fd4ab8f5c48
0x0000000041da5920: 00007fd4ab8eaa42 00007fd4ab8ff94c
0x0000000041da5930: 0000000000000003 0000000041da5938
0x0000000041da5940: 0000000000000000 0000000041da59a0
0x0000000041da5950: 00002aaf2b4bf8e8 0000000000000000
0x0000000041da5960: 00002aaf2b4be060 0000000000000000
0x0000000041da5970: 0000000041da59b0 00002aab6ac225b0
0x0000000041da5980: 00007fd4ac1a2e40 00002aaf2b4bf830
0x0000000041da5990: 00007fd4ab8f2f17 00007fd48c1328a8
0x0000000041da59a0: 00002aac28c05998 00007fd4ac1a2e40
0x0000000041da59b0: 00002aab6ac225a0 00002aaf2c96d8d8
0x0000000041da59c0: 00007fd46f4400d8 0000000041da59f0
Instructions: (pc=0x00007fd49129b0a0)
0x00007fd49129b090: 89 c3 45 31 ed b9 0a 00 00 00 48 89 c7 4c 89 e8
0x00007fd49129b0a0: f3 48 ab 49 89 1e 4c 89 23 be c0 00 00 00 4c 89
Stack: [0x0000000041d86000,0x0000000041da7000], sp=0x0000000041da57d0,
free space=7d0000000000000018k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
C=native code)
C [libapr-1.so.0+0x1c0a0]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j org.apache.tomcat.jni.Socket.accept(J)J+0
J org.apache.tomcat.util.net.AprEndpoint$Acceptor.run()V
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x00007fd46889e800 JavaThread "DestroyJavaVM" [_thread_in_native,
id=16403, stack(0x0000000041c0e000,0x0000000041c2f000)]
0x00007fd48d5a5800 JavaThread "MultiBackend-Executor-Thread-2320"
daemon [_thread_blocked, id=465,
stack(0x00000000428b9000,0x00000000428da000)]
0x00007fd48c125800 JavaThread "MultiBackend-Executor-Thread-2319"
daemon [_thread_blocked, id=464,
stack(0x00000000461b3000,0x00000000461d4000)]
0x00007fd48cf81000 JavaThread "MultiBackend-Executor-Thread-2318"
daemon [_thread_blocked, id=447,
stack(0x000000004901b000,0x000000004903c000)]
0x00007fd48d0c4800 JavaThread "MultiBackend-Executor-Thread-2317"
daemon [_thread_blocked, id=446,
stack(0x0000000047719000,0x000000004773a000)]
0x00007fd484200000 JavaThread "MultiBackend-Executor-Thread-2316"
daemon [_thread_blocked, id=445,
stack(0x0000000047b9c000,0x0000000047bbd000)]
0x00007fd48c3d6000 JavaThread "MultiBackend-Executor-Thread-2315"
daemon [_thread_blocked, id=444,
stack(0x0000000041da7000,0x0000000041dc8000)]
0x00007fd48400b000 JavaThread "MultiBackend-Executor-Thread-2314"
daemon [_thread_blocked, id=443,
stack(0x0000000041c50000,0x0000000041c71000)]
0x00007fd48d0c5800 JavaThread "MultiBackend-Executor-Thread-2313"
daemon [_thread_blocked, id=442,
stack(0x00000000410c2000,0x00000000410e3000)]
0x00007fd48416a800 JavaThread "Timeout guard" daemon
[_thread_in_native, id=384,
stack(0x000000004987c000,0x000000004989d000)]
0x00007fd48465f000 JavaThread "Timeout guard" daemon
[_thread_in_native, id=379,
stack(0x0000000046591000,0x00000000465b2000)]
0x00007fd484072800 JavaThread "Timeout guard" daemon
[_thread_in_native, id=370,
stack(0x00000000411f3000,0x0000000041214000)]
0x00007fd47c4fa800 JavaThread "MultiBackend-Executor-Thread-2310"
daemon [_thread_blocked, id=31737,
stack(0x00000000496f0000,0x0000000049711000)]
0x00007fd4740d8000 JavaThread "MultiBackend-Executor-Thread-1765"
daemon [_thread_blocked, id=27419,
stack(0x0000000045553000,0x0000000045574000)]
0x00007fd4709e4800 JavaThread "SOCKETS-3254" daemon [_thread_blocked,
id=13000, stack(0x0000000046888000,0x00000000468a9000)]
0x00007fd468c30000 JavaThread "SOCKETS-3253" daemon [_thread_blocked,
id=12961, stack(0x000000004907e000,0x000000004909f000)]
0x00007fd48c0f4800 JavaThread "SOCKETS-3252" daemon [_thread_blocked,
id=12960, stack(0x00000000455d7000,0x00000000455f8000)]
0x00007fd4743bb000 JavaThread "SOCKETS-3251" daemon [_thread_blocked,
id=12862, stack(0x000000004a770000,0x000000004a791000)]
0x00007fd48c3e2800 JavaThread "SOCKETS-3250" daemon [_thread_blocked,
id=12861, stack(0x000000004a93e000,0x000000004a95f000)]
0x00007fd48d03d000 JavaThread "SOCKETS-3249" daemon [_thread_blocked,
id=12732, stack(0x000000004c747000,0x000000004c768000)]
0x00007fd48c14e000 JavaThread "SOCKETS-3241" daemon [_thread_blocked,
id=4456, stack(0x0000000044557000,0x0000000044578000)]
0x00007fd47034f000 JavaThread "SOCKETS-3231" daemon [_thread_blocked,
id=31247, stack(0x00000000424db000,0x00000000424fc000)]
0x00007fd48c17c000 JavaThread "SOCKETS-3209" daemon [_thread_blocked,
id=22570, stack(0x0000000049e6a000,0x0000000049e8b000)]
0x00007fd489b19800 JavaThread "SOCKETS-3205" daemon [_thread_blocked,
id=18798, stack(0x000000004c789000,0x000000004c7aa000)]
0x00007fd48b4c9000 JavaThread "http-443-6" daemon [_thread_blocked,
id=13893, stack(0x00000000486d3000,0x00000000486f4000)]
0x00007fd47b6f2000 JavaThread "http-443-5" daemon [_thread_blocked,
id=8863, stack(0x0000000048ffa000,0x000000004901b000)]
0x00007fd491f5b800 JavaThread "http-443-4" daemon [_thread_blocked,
id=5231, stack(0x0000000043cd5000,0x0000000043cf6000)]
0x00007fd480215000 JavaThread "http-80-75" daemon [_thread_blocked,
id=5414, stack(0x00000000459d6000,0x00000000459f7000)]
0x00007fd48005e800 JavaThread "http-80-74" daemon [_thread_blocked,
id=5413, stack(0x0000000044ee1000,0x0000000044f02000)]
0x00007fd48001f000 JavaThread "http-80-73" daemon [_thread_blocked,
id=5412, stack(0x0000000045cac000,0x0000000045ccd000)]
0x00007fd48103a000 JavaThread "http-80-72" daemon [_thread_blocked,
id=5411, stack(0x0000000046e34000,0x0000000046e55000)]
0x00007fd4702a9800 JavaThread "http-80-71" daemon [_thread_blocked,
id=5410, stack(0x000000004629a000,0x00000000462bb000)]
0x00007fd4701cb000 JavaThread "http-80-70" daemon [_thread_blocked,
id=5409, stack(0x0000000045511000,0x0000000045532000)]
0x00007fd4704a3000 JavaThread "http-80-69" daemon [_thread_blocked,
id=5408, stack(0x0000000046804000,0x0000000046825000)]
0x00007fd4708d9800 JavaThread "http-80-68" daemon [_thread_blocked,
id=5407, stack(0x0000000042181000,0x00000000421a2000)]
0x00007fd47051d800 JavaThread "http-80-67" daemon [_thread_blocked,
id=2656, stack(0x000000004504c000,0x000000004506d000)]
0x00007fd4808cb000 JavaThread "http-80-66" daemon [_thread_blocked,
id=2655, stack(0x0000000045b83000,0x0000000045ba4000)]
0x00007fd4803b1800 JavaThread "http-80-65" daemon [_thread_blocked,
id=2654, stack(0x000000004521a000,0x000000004523b000)]
0x00007fd480337000 JavaThread "http-80-64" daemon [_thread_blocked,
id=2653, stack(0x0000000041256000,0x0000000041277000)]
0x00007fd47b95e800 JavaThread "http-443-3" daemon [_thread_blocked,
id=18379, stack(0x0000000044fc8000,0x0000000044fe9000)]
0x00007fd480665000 JavaThread "http-80-63" daemon [_thread_blocked,
id=2270, stack(0x000000004230d000,0x000000004232e000)]
0x00007fd480773800 JavaThread "http-80-62" daemon [_thread_blocked,
id=32657, stack(0x0000000045931000,0x0000000045952000)]
0x00007fd4805b3800 JavaThread "http-80-61" daemon [_thread_blocked,
id=32656, stack(0x0000000045910000,0x0000000045931000)]
0x00007fd480683800 JavaThread "http-80-60" daemon [_thread_blocked,
id=32655, stack(0x00000000458ef000,0x0000000045910000)]
0x00007fd4814e0000 JavaThread "http-80-59" daemon [_thread_blocked,
id=32654, stack(0x00000000458ce000,0x00000000458ef000)]
0x00007fd4746b8800 JavaThread "http-80-58" daemon [_thread_blocked,
id=32653, stack(0x00000000458ad000,0x00000000458ce000)]
0x00007fd4740a2800 JavaThread "http-80-57" daemon [_thread_blocked,
id=32652, stack(0x000000004588c000,0x00000000458ad000)]
0x00007fd47418a800 JavaThread "http-80-56" daemon [_thread_blocked,
id=29908, stack(0x000000004374a000,0x000000004376b000)]
0x00007fd474542800 JavaThread "http-80-55" daemon [_thread_blocked,
id=29907, stack(0x0000000043dbc000,0x0000000043ddd000)]
0x00007fd4746d2800 JavaThread "http-80-54" daemon [_thread_blocked,
id=29906, stack(0x000000004544b000,0x000000004546c000)]
0x00007fd47409a800 JavaThread "http-80-53" daemon [_thread_blocked,
id=27807, stack(0x0000000044470000,0x0000000044491000)]
0x00007fd47493e800 JavaThread "http-80-52" daemon [_thread_blocked,
id=26729, stack(0x0000000044cf2000,0x0000000044d13000)]
0x00007fd475583000 JavaThread "http-80-51" daemon [_thread_blocked,
id=26728, stack(0x0000000041f71000,0x0000000041f92000)]
0x00007fd4742de800 JavaThread "http-80-50" daemon [_thread_blocked,
id=26727, stack(0x0000000044368000,0x0000000044389000)]
0x00007fd490dd3000 JavaThread "http-443-2" daemon [_thread_blocked,
id=25492, stack(0x0000000043e61000,0x0000000043e82000)]
0x00007fd4742dd000 JavaThread "http-80-49" daemon [_thread_blocked,
id=25129, stack(0x00000000444f4000,0x0000000044515000)]
0x00007fd48b2dd800 JavaThread "http-80-48" daemon [_thread_blocked,
id=25128, stack(0x0000000043b8b000,0x0000000043bac000)]
0x00007fd47b230800 JavaThread "http-80-47" daemon [_thread_blocked,
id=24785, stack(0x0000000044fa7000,0x0000000044fc8000)]
0x00007fd474150000 JavaThread "http-80-46" daemon [_thread_blocked,
id=24143, stack(0x000000004486f000,0x0000000044890000)]
0x00007fd474574000 JavaThread "http-80-45" daemon [_thread_blocked,
id=24139, stack(0x000000004234f000,0x0000000042370000)]
0x00007fd48b517000 JavaThread "http-80-44" daemon [_thread_blocked,
id=23716, stack(0x0000000045409000,0x000000004542a000)]
0x00007fd47bcfe000 JavaThread "http-443-1" daemon [_thread_blocked,
id=22443, stack(0x000000004232e000,0x000000004234f000)]
0x00007fd48c0f8000 JavaThread "ESKIMO-10" daemon [_thread_blocked,
id=20075, stack(0x0000000044d13000,0x0000000044d34000)]
0x00007fd475407000 JavaThread "ESKIMO-9" daemon [_thread_blocked,
id=20067, stack(0x0000000044f02000,0x0000000044f23000)]
0x00007fd4923aa000 JavaThread "http-80-43" daemon [_thread_blocked,
id=19786, stack(0x000000004482d000,0x000000004484e000)]
0x00007fd476727800 JavaThread "http-80-42" daemon [_thread_blocked,
id=19785, stack(0x0000000041277000,0x0000000041298000)]
0x00007fd4921c1800 JavaThread "http-80-41" daemon [_thread_blocked,
id=19784, stack(0x00000000437ad000,0x00000000437ce000)]
0x00007fd474b47800 JavaThread "http-80-40" daemon [_thread_blocked,
id=19783, stack(0x00000000400d7000,0x00000000400f8000)]
0x00007fd47c1d6800 JavaThread "ESKIMO-8" daemon [_thread_blocked,
id=19773, stack(0x0000000044e7e000,0x0000000044e9f000)]
0x00007fd475822800 JavaThread "ESKIMO-7" daemon [_thread_blocked,
id=19748, stack(0x0000000044935000,0x0000000044956000)]
0x00007fd491cd4000 JavaThread "http-80-39" daemon [_thread_blocked,
id=19746, stack(0x0000000044ec0000,0x0000000044ee1000)]
0x00007fd480418800 JavaThread "ESKIMO-6" daemon [_thread_blocked,
id=19732, stack(0x0000000041d13000,0x0000000041d34000)]
0x00007fd47493f000 JavaThread "http-80-38" daemon [_thread_blocked,
id=19146, stack(0x0000000045301000,0x0000000045322000)]
0x00007fd48a529000 JavaThread "http-80-37" daemon [_thread_blocked,
id=19142, stack(0x000000004529e000,0x00000000452bf000)]
0x00007fd47411e000 JavaThread "http-80-36" daemon [_thread_blocked,
id=19141, stack(0x000000004527d000,0x000000004529e000)]
0x00007fd488246800 JavaThread "http-80-35" daemon [_thread_blocked,
id=19140, stack(0x000000004525c000,0x000000004527d000)]
0x00007fd475400000 JavaThread "http-80-34" daemon [_thread_blocked,
id=19139, stack(0x000000004523b000,0x000000004525c000)]
0x00007fd48c28c000 JavaThread "ESKIMO-5" daemon [_thread_blocked,
id=19097, stack(0x0000000044704000,0x0000000044725000)]
0x00007fd4746ac800 JavaThread "MultiBackend-Executor-Thread-57" daemon
[_thread_blocked, id=19042,
stack(0x0000000044e3c000,0x0000000044e5d000)]
0x00007fd48b7a1000 JavaThread "MultiBackend-Executor-Thread-53" daemon
[_thread_blocked, id=19037,
stack(0x0000000044db8000,0x0000000044dd9000)]
0x00007fd4746db800 JavaThread "http-80-33" daemon [_thread_blocked,
id=18706, stack(0x00000000443ec000,0x000000004440d000)]
0x00007fd48b738000 JavaThread "ESKIMO-4" daemon [_thread_blocked,
id=18657, stack(0x0000000043ec4000,0x0000000043ee5000)]
0x00007fd4740ea800 JavaThread "http-80-32" daemon [_thread_blocked,
id=18406, stack(0x0000000043d9b000,0x0000000043dbc000)]
0x00007fd48bd6d000 JavaThread "http-80-31" daemon [_thread_blocked,
id=18405, stack(0x0000000043dfe000,0x0000000043e1f000)]
0x00007fd4748cd800 JavaThread "http-80-30" daemon [_thread_blocked,
id=18404, stack(0x0000000044956000,0x0000000044977000)]
0x00007fd48a456800 JavaThread "http-80-29" daemon [_thread_blocked,
id=18403, stack(0x0000000041dff000,0x0000000041e20000)]
0x00007fd47448a000 JavaThread "http-80-28" daemon [_thread_blocked,
id=18402, stack(0x00000000449da000,0x00000000449fb000)]
0x00007fd4742bd800 JavaThread "http-80-27" daemon [_thread_blocked,
id=18401, stack(0x00000000444b2000,0x00000000444d3000)]
0x00007fd48c937800 JavaThread "ESKIMO-3" daemon [_thread_blocked,
id=18065, stack(0x0000000043495000,0x00000000434b6000)]
0x00007fd474d48800 JavaThread "http-80-26" daemon [_thread_blocked,
id=18021, stack(0x0000000043f69000,0x0000000043f8a000)]
0x00007fd48c4d7000 JavaThread "MultiBackend-Executor-Thread-40" daemon
[_thread_blocked, id=17738,
stack(0x0000000044a7f000,0x0000000044aa0000)]
0x00007fd4744ed800 JavaThread "http-80-25" daemon [_thread_blocked,
id=17681, stack(0x0000000042604000,0x0000000042625000)]
0x00007fd4741ff800 JavaThread "http-80-24" daemon [_thread_blocked,
id=17680, stack(0x00000000438d6000,0x00000000438f7000)]
0x00007fd47404c800 JavaThread "http-80-23" daemon [_thread_blocked,
id=17401, stack(0x00000000446a1000,0x00000000446c2000)]
0x00007fd48ba3e000 JavaThread "http-80-22" daemon [_thread_blocked,
id=17400, stack(0x00000000446c2000,0x00000000446e3000)]
0x00007fd4897f5000 JavaThread "ESKIMO-2" daemon [_thread_blocked,
id=17372, stack(0x0000000044326000,0x0000000044347000)]
0x00007fd4741b9000 JavaThread "JOSCAR-MISC-THREAD-5" daemon
[_thread_blocked, id=17366,
stack(0x0000000044977000,0x0000000044998000)]
0x00007fd474259800 JavaThread "http-80-21" daemon [_thread_blocked,
id=17360, stack(0x00000000448d2000,0x00000000448f3000)]
0x00007fd48b1b0000 JavaThread "http-80-20" daemon [_thread_blocked,
id=17359, stack(0x00000000448b1000,0x00000000448d2000)]
0x00007fd491d34800 JavaThread "http-80-19" daemon [_thread_blocked,
id=17358, stack(0x0000000044890000,0x00000000448b1000)]
0x00007fd4741e6800 JavaThread "http-80-18" daemon [_thread_blocked,
id=17357, stack(0x00000000441dc000,0x00000000441fd000)]
0x00007fd48002f000 JavaThread "JOSCAR-MISC-THREAD-4" daemon
[_thread_blocked, id=17339,
stack(0x00000000447a9000,0x00000000447ca000)]
0x00007fd480349000 JavaThread "OSCAR-EXTERNAL-SERVICE-4" daemon
[_thread_blocked, id=17338,
stack(0x0000000044788000,0x00000000447a9000)]
0x00007fd4804df000 JavaThread "OSCAR-BUDDY-INFO-4" daemon
[_thread_blocked, id=17337,
stack(0x0000000044767000,0x0000000044788000)]
0x00007fd48052a000 JavaThread "MultiBackend-Executor-Thread-28" daemon
[_thread_blocked, id=17333,
stack(0x00000000446e3000,0x0000000044704000)]
0x00007fd474371800 JavaThread "http-80-17" daemon [_thread_blocked,
id=17330, stack(0x0000000044680000,0x00000000446a1000)]
0x00007fd48b54b800 JavaThread "OSCAR-KEEPALIVE-4" daemon
[_thread_blocked, id=17329,
stack(0x000000004465f000,0x0000000044680000)]
0x00007fd47be2f800 JavaThread "JOSCAR-MISC-THREAD-3" daemon
[_thread_blocked, id=17328,
stack(0x000000004463e000,0x000000004465f000)]
0x00007fd48b591800 JavaThread "OSCAR-KEEPALIVE-3" daemon
[_thread_blocked, id=17327,
stack(0x000000004461d000,0x000000004463e000)]
0x00007fd474078800 JavaThread "JOSCAR-MISC-THREAD-2" daemon
[_thread_blocked, id=17326,
stack(0x00000000445fc000,0x000000004461d000)]
0x00007fd48bb1c000 JavaThread "OSCAR-EXTERNAL-SERVICE-3" daemon
[_thread_blocked, id=17324,
stack(0x00000000445db000,0x00000000445fc000)]
0x00007fd48a925800 JavaThread "OSCAR-BUDDY-INFO-3" daemon
[_thread_blocked, id=17323,
stack(0x00000000445ba000,0x00000000445db000)]
0x00007fd47432b800 JavaThread "OSCAR-EXTERNAL-SERVICE-2" daemon
[_thread_blocked, id=17322,
stack(0x0000000044599000,0x00000000445ba000)]
0x00007fd4744d5800 JavaThread "OSCAR-BUDDY-INFO-2" daemon
[_thread_blocked, id=17321,
stack(0x0000000044578000,0x0000000044599000)]
0x00007fd489230000 JavaThread "http-80-16" daemon [_thread_blocked,
id=17316, stack(0x0000000044536000,0x0000000044557000)]
0x00007fd4740a7800 JavaThread "http-80-15" daemon [_thread_blocked,
id=17315, stack(0x0000000044515000,0x0000000044536000)]
0x00007fd4741f5000 JavaThread "http-80-14" daemon [_thread_blocked,
id=17313, stack(0x00000000444d3000,0x00000000444f4000)]
0x00007fd48a955000 JavaThread "OSCAR-EXTERNAL-SERVICE-1" daemon
[_thread_blocked, id=17071,
stack(0x00000000443cb000,0x00000000443ec000)]
0x00007fd48b2f9000 JavaThread "OSCAR-BUDDY-INFO-1" daemon
[_thread_blocked, id=17070,
stack(0x00000000443aa000,0x00000000443cb000)]
0x00007fd48b54c800 JavaThread "OSCAR-FLAP-PROCESSOR-4" daemon
[_thread_blocked, id=17069,
stack(0x0000000044389000,0x00000000443aa000)]
0x00007fd474016000 JavaThread "http-80-13" daemon [_thread_blocked,
id=17055, stack(0x0000000044347000,0x0000000044368000)]
0x00007fd48bc89800 JavaThread "OSCAR-KEEPALIVE-2" daemon
[_thread_blocked, id=17052,
stack(0x00000000442e4000,0x0000000044305000)]
0x00007fd47b8ca800 JavaThread "OSCAR-FLAP-PROCESSOR-3" daemon
[_thread_blocked, id=17051,
stack(0x00000000442c3000,0x00000000442e4000)]
0x00007fd48b1ef000 JavaThread "OSCAR-KEEPALIVE-1" daemon
[_thread_blocked, id=17050,
stack(0x00000000442a2000,0x00000000442c3000)]
0x00007fd4740a9000 JavaThread "OSCAR-FLAP-PROCESSOR-2" daemon
[_thread_blocked, id=17048,
stack(0x0000000044260000,0x0000000044281000)]
0x00007fd4740a8800 JavaThread "http-80-12" daemon [_thread_blocked,
id=17047, stack(0x000000004423f000,0x0000000044260000)]
0x00007fd48823b800 JavaThread "http-80-11" daemon [_thread_blocked,
id=17046, stack(0x000000004421e000,0x000000004423f000)]
0x00007fd48a342000 JavaThread "http-80-10" daemon [_thread_blocked,
id=17044, stack(0x00000000441fd000,0x000000004421e000)]
0x00007fd489230800 JavaThread "OSCAR-KEEPALIVE-0" daemon
[_thread_blocked, id=17033,
stack(0x0000000044092000,0x00000000440b3000)]
0x00007fd47c2c5000 JavaThread "JOSCAR-MISC-THREAD-1" daemon
[_thread_blocked, id=17032,
stack(0x0000000044071000,0x0000000044092000)]
0x00007fd47c303000 JavaThread "OSCAR-FLAP-PROCESSOR-1" daemon
[_thread_blocked, id=17028,
stack(0x0000000043fed000,0x000000004400e000)]
0x00007fd47c58a800 JavaThread "OSCAR-EXTERNAL-SERVICE-0" daemon
[_thread_blocked, id=17027,
stack(0x0000000043fcc000,0x0000000043fed000)]
0x00007fd47c5e9000 JavaThread "OSCAR-BUDDY-INFO-0" daemon
[_thread_blocked, id=17026,
stack(0x0000000043fab000,0x0000000043fcc000)]
0x00007fd4801bf000 JavaThread "OSCAR-FLAP-PROCESSOR-0" daemon
[_thread_blocked, id=17025,
stack(0x0000000043f8a000,0x0000000043fab000)]
0x00007fd489eef800 JavaThread "http-80-9" daemon [_thread_blocked,
id=17020, stack(0x0000000043ee5000,0x0000000043f06000)]
0x00007fd48902d000 JavaThread "http-80-8" daemon [_thread_blocked,
id=17007, stack(0x0000000043e1f000,0x0000000043e40000)]
0x00007fd48a3fe800 JavaThread "http-80-7" daemon [_thread_blocked,
id=17005, stack(0x0000000043ddd000,0x0000000043dfe000)]
0x00007fd4845de800 JavaThread
"RefQueueWorker@org.apache.http.impl.conn.tsccm.ConnPoolByRoute@5c09b65"
daemon [_thread_blocked, id=17003,
stack(0x0000000043894000,0x00000000438b5000)]
0x00007fd491f99800 JavaThread "http-80-6" daemon [_thread_blocked,
id=16994, stack(0x0000000043d59000,0x0000000043d7a000)]
0x00007fd48b1c7800 JavaThread "MultiBackend-Executor-Thread-16" daemon
[_thread_blocked, id=16989,
stack(0x0000000043d38000,0x0000000043d59000)]
0x00007fd480021000 JavaThread "MultiBackend-Executor-Thread-15" daemon
[_thread_blocked, id=16988,
stack(0x0000000043d17000,0x0000000043d38000)]
0x00007fd492288800 JavaThread "MultiBackend-Executor-Thread-14" daemon
[_thread_blocked, id=16987,
stack(0x0000000043cf6000,0x0000000043d17000)]
0x00007fd48b294000 JavaThread "MultiBackend-Executor-Thread-13" daemon
[_thread_blocked, id=16985,
stack(0x0000000043cb4000,0x0000000043cd5000)]
0x00007fd48a8ed800 JavaThread "MultiBackend-Executor-Thread-12" daemon
[_thread_blocked, id=16983,
stack(0x0000000043c72000,0x0000000043c93000)]
0x00007fd48000b000 JavaThread "MultiBackend-Executor-Thread-11" daemon
[_thread_blocked, id=16981,
stack(0x0000000043c51000,0x0000000043c72000)]
0x00007fd48b232800 JavaThread "MultiBackend-Executor-Thread-10" daemon
[_thread_blocked, id=16980,
stack(0x0000000043c30000,0x0000000043c51000)]
0x00007fd48add0800 JavaThread "MultiBackend-Executor-Thread-9" daemon
[_thread_blocked, id=16979,
stack(0x0000000043852000,0x0000000043873000)]
0x00007fd48b13b800 JavaThread "ESKIMO-1" daemon [_thread_blocked,
id=16977, stack(0x0000000043bee000,0x0000000043c0f000)]
0x00007fd4922ef800 JavaThread "MultiBackend-Executor-Thread-8" daemon
[_thread_blocked, id=16975,
stack(0x0000000043bac000,0x0000000043bcd000)]
0x00007fd48b866000 JavaThread "MultiBackend-Executor-Thread-7" daemon
[_thread_blocked, id=16971,
stack(0x0000000043b28000,0x0000000043b49000)]
0x00007fd491fe1800 JavaThread "MultiBackend-Executor-Thread-6" daemon
[_thread_blocked, id=16970,
stack(0x0000000043b07000,0x0000000043b28000)]
0x00007fd48bd2a000 JavaThread "http-80-5" daemon [_thread_blocked,
id=16969, stack(0x0000000043ae6000,0x0000000043b07000)]
0x00007fd492040000 JavaThread "MultiBackend-Executor-Thread-5" daemon
[_thread_blocked, id=16963,
stack(0x0000000043a62000,0x0000000043a83000)]
0x00007fd4920b1800 JavaThread "http-80-4" daemon [_thread_blocked,
id=16962, stack(0x0000000043810000,0x0000000043831000)]
0x00007fd48b4cd000 JavaThread "MultiBackend-Executor-Thread-4" daemon
[_thread_blocked, id=16961,
stack(0x0000000043a41000,0x0000000043a62000)]
0x00007fd48bdb8800 JavaThread "Java2D Disposer" daemon
[_thread_blocked, id=16938,
stack(0x0000000043831000,0x0000000043852000)]
0x00007fd490b43000 JavaThread "MultiBackend-Executor-Thread-3" daemon
[_thread_blocked, id=16936,
stack(0x00000000437ef000,0x0000000043810000)]
0x00007fd492254000 JavaThread "SocketConnectorIoProcessor-2.1" daemon
[_thread_in_native, id=16917,
stack(0x00000000437ce000,0x00000000437ef000)]
0x00007fd492093800 JavaThread "http-80-3" daemon [_thread_blocked,
id=16912, stack(0x0000000043729000,0x000000004374a000)]
0x00007fd48ce80800 JavaThread "BANNERSERVICEPROXY-50" daemon
[_thread_blocked, id=16911,
stack(0x0000000043708000,0x0000000043729000)]
0x00007fd484172000 JavaThread "BANNERSERVICEPROXY-49" daemon
[_thread_blocked, id=16910,
stack(0x00000000436e7000,0x0000000043708000)]
0x00007fd484170800 JavaThread "BANNERSERVICEPROXY-48" daemon
[_thread_blocked, id=16909,
stack(0x00000000436c6000,0x00000000436e7000)]
0x00007fd48b97d000 JavaThread "IGLO-MESSENGER-39" daemon
[_thread_blocked, id=16908,
stack(0x00000000436a5000,0x00000000436c6000)]
0x00007fd48b712000 JavaThread "IGLO-MESSENGER-38" daemon
[_thread_blocked, id=16907,
stack(0x0000000043684000,0x00000000436a5000)]
0x00007fd48b886000 JavaThread "IGLO-MESSENGER-37" daemon
[_thread_blocked, id=16906,
stack(0x0000000043663000,0x0000000043684000)]
0x00007fd48b710000 JavaThread "IGLO-MESSENGER-36" daemon
[_thread_blocked, id=16905,
stack(0x0000000043642000,0x0000000043663000)]
0x00007fd48416f000 JavaThread "BANNERSERVICEPROXY-47" daemon
[_thread_blocked, id=16898,
stack(0x000000004355b000,0x000000004357c000)]
0x00007fd48c0f9000 JavaThread "BANNERSERVICEPROXY-46" daemon
[_thread_blocked, id=16896,
stack(0x0000000043519000,0x000000004353a000)]
0x00007fd48b6b9800 JavaThread "BANNERSERVICEPROXY-45" daemon
[_thread_blocked, id=16891,
stack(0x0000000043474000,0x0000000043495000)]
0x00007fd48b6b4000 JavaThread "IGLO-MESSENGER-35" daemon
[_thread_blocked, id=16890,
stack(0x0000000043453000,0x0000000043474000)]
0x00007fd48b6b3000 JavaThread "IGLO-MESSENGER-34" daemon
[_thread_blocked, id=16889,
stack(0x0000000043432000,0x0000000043453000)]
0x00007fd491e92000 JavaThread "IGLO-MESSENGER-33" daemon
[_thread_blocked, id=16888,
stack(0x0000000043411000,0x0000000043432000)]
0x00007fd491ec9800 JavaThread "IGLO-MESSENGER-32" daemon
[_thread_blocked, id=16887,
stack(0x00000000433f0000,0x0000000043411000)]
0x00007fd48c310000 JavaThread "BANNERSERVICEPROXY-44" daemon
[_thread_blocked, id=16886,
stack(0x00000000433cf000,0x00000000433f0000)]
0x00007fd48c900000 JavaThread "BANNERSERVICEPROXY-43" daemon
[_thread_blocked, id=16884,
stack(0x000000004338d000,0x00000000433ae000)]
0x00007fd48c8fe800 JavaThread "BANNERSERVICEPROXY-42" daemon
[_thread_blocked, id=16883,
stack(0x000000004336c000,0x000000004338d000)]
0x00007fd48b85f800 JavaThread "IGLO-MESSENGER-31" daemon
[_thread_blocked, id=16882,
stack(0x000000004334b000,0x000000004336c000)]
0x00007fd48cf94000 JavaThread "BANNERSERVICEPROXY-41" daemon
[_thread_blocked, id=16881,
stack(0x000000004332a000,0x000000004334b000)]
0x00007fd490a53800 JavaThread "IGLO-MESSENGER-30" daemon
[_thread_blocked, id=16880,
stack(0x0000000043309000,0x000000004332a000)]
0x00007fd484092800 JavaThread "BANNERSERVICEPROXY-40" daemon
[_thread_blocked, id=16879,
stack(0x00000000432e8000,0x0000000043309000)]
0x00007fd48c24b000 JavaThread "BANNERSERVICEPROXY-39" daemon
[_thread_blocked, id=16878,
stack(0x00000000432c7000,0x00000000432e8000)]
0x00007fd48bb07800 JavaThread "IGLO-MESSENGER-29" daemon
[_thread_blocked, id=16877,
stack(0x00000000432a6000,0x00000000432c7000)]
0x00007fd4922f2800 JavaThread "IGLO-MESSENGER-28" daemon
[_thread_blocked, id=16876,
stack(0x0000000043285000,0x00000000432a6000)]
0x00007fd491fdb000 JavaThread "IGLO-MESSENGER-27" daemon
[_thread_blocked, id=16875,
stack(0x0000000043264000,0x0000000043285000)]
0x00007fd48bc31000 JavaThread "IGLO-MESSENGER-26" daemon
[_thread_blocked, id=16874,
stack(0x0000000043243000,0x0000000043264000)]
0x00007fd484080000 JavaThread "BANNERSERVICEPROXY-38" daemon
[_thread_blocked, id=16873,
stack(0x0000000043222000,0x0000000043243000)]
0x00007fd490a6b800 JavaThread "MultiBackend-Executor-Thread-15" daemon
[_thread_blocked, id=16872,
stack(0x0000000043201000,0x0000000043222000)]
0x00007fd491f21000 JavaThread "IGLO-MESSENGER-25" daemon
[_thread_blocked, id=16871,
stack(0x00000000431e0000,0x0000000043201000)]
0x00007fd491e86000 JavaThread "IGLO-MESSENGER-24" daemon
[_thread_blocked, id=16870,
stack(0x00000000431bf000,0x00000000431e0000)]
0x00007fd4923a6800 JavaThread "IGLO-MESSENGER-23" daemon
[_thread_blocked, id=16869,
stack(0x000000004319e000,0x00000000431bf000)]
0x00007fd491f25000 JavaThread "IGLO-MESSENGER-22" daemon
[_thread_blocked, id=16867,
stack(0x000000004315c000,0x000000004317d000)]
0x00007fd491fac000 JavaThread "IGLO-MESSENGER-21" daemon
[_thread_blocked, id=16866,
stack(0x000000004313b000,0x000000004315c000)]
0x00007fd491ff5800 JavaThread "IGLO-MESSENGER-20" daemon
[_thread_blocked, id=16865,
stack(0x000000004311a000,0x000000004313b000)]
0x00007fd48bd2e000 JavaThread "http-80-2" daemon [_thread_blocked,
id=16864, stack(0x00000000430f9000,0x000000004311a000)]
0x00007fd48bd2c800 JavaThread "IGLO-MESSENGER-19" daemon
[_thread_blocked, id=16863,
stack(0x00000000430d8000,0x00000000430f9000)]
0x00007fd48407a000 JavaThread "BANNERSERVICEPROXY-37" daemon
[_thread_blocked, id=16862,
stack(0x00000000430b7000,0x00000000430d8000)]
0x00007fd484078800 JavaThread "BANNERSERVICEPROXY-36" daemon
[_thread_blocked, id=16861,
stack(0x0000000043096000,0x00000000430b7000)]
0x00007fd484077800 JavaThread "BANNERSERVICEPROXY-35" daemon
[_thread_blocked, id=16860,
stack(0x0000000043075000,0x0000000043096000)]
0x00007fd49208a800 JavaThread "IGLO-MESSENGER-18" daemon
[_thread_blocked, id=16859,
stack(0x0000000043054000,0x0000000043075000)]
0x00007fd484059800 JavaThread "BANNERSERVICEPROXY-34" daemon
[_thread_blocked, id=16858,
stack(0x0000000043033000,0x0000000043054000)]
0x00007fd491ea4000 JavaThread "IGLO-MESSENGER-17" daemon
[_thread_blocked, id=16857,
stack(0x0000000043012000,0x0000000043033000)]
0x00007fd484048000 JavaThread "BANNERSERVICEPROXY-33" daemon
[_thread_blocked, id=16856,
stack(0x0000000042ff1000,0x0000000043012000)]
0x00007fd484047000 JavaThread "BANNERSERVICEPROXY-32" daemon
[_thread_blocked, id=16855,
stack(0x0000000042fd0000,0x0000000042ff1000)]
0x00007fd491d3d800 JavaThread "IGLO-MESSENGER-16" daemon
[_thread_blocked, id=16854,
stack(0x0000000042faf000,0x0000000042fd0000)]
0x00007fd4922a1800 JavaThread "IGLO-MESSENGER-15" daemon
[_thread_blocked, id=16853,
stack(0x0000000042f8e000,0x0000000042faf000)]
0x00007fd492081800 JavaThread "IGLO-MESSENGER-14" daemon
[_thread_blocked, id=16852,
stack(0x0000000042f6d000,0x0000000042f8e000)]
0x00007fd484645800 JavaThread "BANNERSERVICEPROXY-31" daemon
[_thread_blocked, id=16851,
stack(0x0000000042f4c000,0x0000000042f6d000)]
0x00007fd491f6c800 JavaThread "IGLO-MESSENGER-13" daemon
[_thread_blocked, id=16850,
stack(0x0000000042f2b000,0x0000000042f4c000)]
0x00007fd484644000 JavaThread "BANNERSERVICEPROXY-30" daemon
[_thread_blocked, id=16849,
stack(0x0000000042f0a000,0x0000000042f2b000)]
0x00007fd484642800 JavaThread "BANNERSERVICEPROXY-29" daemon
[_thread_blocked, id=16848,
stack(0x0000000042ee9000,0x0000000042f0a000)]
0x00007fd484640800 JavaThread "BANNERSERVICEPROXY-28" daemon
[_thread_blocked, id=16847,
stack(0x0000000042ec8000,0x0000000042ee9000)]
0x00007fd48463f000 JavaThread "BANNERSERVICEPROXY-27" daemon
[_thread_blocked, id=16846,
stack(0x0000000042ea7000,0x0000000042ec8000)]
0x00007fd48463d800 JavaThread "BANNERSERVICEPROXY-26" daemon
[_thread_blocked, id=16845,
stack(0x0000000042e86000,0x0000000042ea7000)]
0x00007fd48463c000 JavaThread "BANNERSERVICEPROXY-25" daemon
[_thread_blocked, id=16844,
stack(0x0000000042e65000,0x0000000042e86000)]
0x00007fd48463a800 JavaThread "BANNERSERVICEPROXY-24" daemon
[_thread_blocked, id=16843,
stack(0x0000000042e44000,0x0000000042e65000)]
0x00007fd484639000 JavaThread "BANNERSERVICEPROXY-23" daemon
[_thread_blocked, id=16842,
stack(0x0000000042e23000,0x0000000042e44000)]
0x00007fd492504800 JavaThread "IGLO-MESSENGER-12" daemon
[_thread_blocked, id=16841,
stack(0x0000000042e02000,0x0000000042e23000)]
0x00007fd484635000 JavaThread "BANNERSERVICEPROXY-22" daemon
[_thread_blocked, id=16840,
stack(0x0000000042de1000,0x0000000042e02000)]
0x00007fd491d45800 JavaThread "IGLO-MESSENGER-11" daemon
[_thread_blocked, id=16839,
stack(0x0000000042dc0000,0x0000000042de1000)]
0x00007fd484615000 JavaThread "BANNERSERVICEPROXY-21" daemon
[_thread_blocked, id=16838,
stack(0x0000000042d9f000,0x0000000042dc0000)]
0x00007fd484613800 JavaThread "BANNERSERVICEPROXY-20" daemon
[_thread_blocked, id=16837,
stack(0x0000000042d7e000,0x0000000042d9f000)]
0x00007fd48bc6d000 JavaThread "IGLO-MESSENGER-10" daemon
[_thread_blocked, id=16836,
stack(0x0000000042d5d000,0x0000000042d7e000)]
0x00007fd48ceb2000 JavaThread "BANNERSERVICEPROXY-19" daemon
[_thread_blocked, id=16835,
stack(0x0000000042d3c000,0x0000000042d5d000)]
0x00007fd48c905800 JavaThread "BANNERSERVICEPROXY-18" daemon
[_thread_blocked, id=16834,
stack(0x0000000042d1b000,0x0000000042d3c000)]
0x00007fd491da9000 JavaThread "MultiBackend-Executor-Thread-2" daemon
[_thread_blocked, id=16832,
stack(0x0000000042cb8000,0x0000000042cd9000)]
0x00007fd48ba02000 JavaThread "MultiBackend-Executor-Thread-13" daemon
[_thread_blocked, id=16831,
stack(0x0000000042cfa000,0x0000000042d1b000)]
0x00007fd48c189000 JavaThread "BANNERSERVICEPROXY-17" daemon
[_thread_blocked, id=16828,
stack(0x0000000042c97000,0x0000000042cb8000)]
0x00007fd48c187000 JavaThread "BANNERSERVICEPROXY-16" daemon
[_thread_blocked, id=16827,
stack(0x0000000042c76000,0x0000000042c97000)]
0x00007fd48c185000 JavaThread "BANNERSERVICEPROXY-15" daemon
[_thread_blocked, id=16826,
stack(0x00000000405ce000,0x00000000405ef000)]
0x00007fd48d413800 JavaThread "BANNERSERVICEPROXY-14" daemon
[_thread_blocked, id=16825,
stack(0x0000000042c55000,0x0000000042c76000)]
0x00007fd48d412000 JavaThread "BANNERSERVICEPROXY-13" daemon
[_thread_blocked, id=16824,
stack(0x0000000042c34000,0x0000000042c55000)]
0x00007fd48d410800 JavaThread "BANNERSERVICEPROXY-12" daemon
[_thread_blocked, id=16823,
stack(0x0000000042c13000,0x0000000042c34000)]
0x00007fd491de3000 JavaThread "IGLO-MESSENGER-9" daemon
[_thread_blocked, id=16822,
stack(0x0000000042bf2000,0x0000000042c13000)]
0x00007fd48d40f000 JavaThread "BANNERSERVICEPROXY-11" daemon
[_thread_blocked, id=16821,
stack(0x0000000042bd1000,0x0000000042bf2000)]
0x00007fd48c3e8800 JavaThread "BANNERSERVICEPROXY-10" daemon
[_thread_blocked, id=16815,
stack(0x0000000042bb0000,0x0000000042bd1000)]
0x00007fd491dfb000 JavaThread "IGLO-MESSENGER-8" daemon
[_thread_blocked, id=16814,
stack(0x0000000042b8f000,0x0000000042bb0000)]
0x00007fd491df9000 JavaThread "IGLO-MESSENGER-7" daemon
[_thread_blocked, id=16813,
stack(0x0000000042b6e000,0x0000000042b8f000)]
0x00007fd48c3e5800 JavaThread "BANNERSERVICEPROXY-9" daemon
[_thread_blocked, id=16812,
stack(0x0000000042b4d000,0x0000000042b6e000)]
0x00007fd48c313000 JavaThread "BANNERSERVICEPROXY-8" daemon
[_thread_blocked, id=16811,
stack(0x0000000042b2c000,0x0000000042b4d000)]
0x00007fd491fc0000 JavaThread "IGLO-MESSENGER-6" daemon
[_thread_blocked, id=16810,
stack(0x0000000042b0b000,0x0000000042b2c000)]
0x00007fd484601000 JavaThread "BANNERSERVICEPROXY-7" daemon
[_thread_blocked, id=16809,
stack(0x0000000042aea000,0x0000000042b0b000)]
0x00007fd48bb63000 JavaThread "IGLO-MESSENGER-5" daemon
[_thread_blocked, id=16808,
stack(0x0000000042ac9000,0x0000000042aea000)]
0x00007fd4845be000 JavaThread "BANNERSERVICEPROXY-6" daemon
[_thread_blocked, id=16807,
stack(0x0000000042aa8000,0x0000000042ac9000)]
0x00007fd4845bd800 JavaThread "BANNERSERVICEPROXY-5" daemon
[_thread_blocked, id=16806,
stack(0x0000000042a87000,0x0000000042aa8000)]
0x00007fd492021800 JavaThread "IGLO-MESSENGER-4" daemon
[_thread_blocked, id=16803,
stack(0x00000000405ad000,0x00000000405ce000)]
0x00007fd48c0d5000 JavaThread "BANNERSERVICEPROXY-4" daemon
[_thread_blocked, id=16800,
stack(0x0000000042a03000,0x0000000042a24000)]
0x00007fd490ac9000 JavaThread "IGLO-MESSENGER-3" daemon
[_thread_blocked, id=16799,
stack(0x00000000429e2000,0x0000000042a03000)]
0x00007fd492202800 JavaThread "SocketConnectorIoProcessor-1.0" daemon
[_thread_in_native, id=16798,
stack(0x00000000429c1000,0x00000000429e2000)]
0x00007fd48c0d2800 JavaThread "BANNERSERVICEPROXY-3" daemon
[_thread_blocked, id=16797,
stack(0x00000000429a0000,0x00000000429c1000)]
0x00007fd48caa7800 JavaThread "BANNERSERVICEPROXY-2" daemon
[_thread_blocked, id=16796,
stack(0x000000004297f000,0x00000000429a0000)]
0x00007fd48caa7000 JavaThread "BANNERSERVICEPROXY-1" daemon
[_thread_blocked, id=16795,
stack(0x000000004295e000,0x000000004297f000)]
0x00007fd4843fe800 JavaThread "IGLO-MESSENGER-2" daemon
[_thread_blocked, id=16792,
stack(0x000000004053e000,0x000000004055f000)]
0x00007fd48b54e800 JavaThread "SocketConnectorIoProcessor-3.1" daemon
[_thread_in_native, id=16782,
stack(0x0000000042835000,0x0000000042856000)]
0x00007fd484476800 JavaThread "IGLO-MESSENGER-1" daemon
[_thread_blocked, id=16781,
stack(0x0000000042814000,0x0000000042835000)]
0x00007fd484474000 JavaThread "MultiBackend-Executor-Thread-1" daemon
[_thread_blocked, id=16779,
stack(0x00000000427d2000,0x00000000427f3000)]
0x00007fd48baa7800 JavaThread "SocketConnectorIoProcessor-3.0" daemon
[_thread_in_native, id=16774,
stack(0x000000004274e000,0x000000004276f000)]
0x00007fd484517800 JavaThread "SocketConnector-3" daemon
[_thread_in_native, id=16773,
stack(0x000000004272d000,0x000000004274e000)]
0x00007fd4844d1800 JavaThread "IGLO-MESSENGER-0" daemon
[_thread_blocked, id=16772,
stack(0x000000004270c000,0x000000004272d000)]
0x00007fd48b471800 JavaThread "CompressionSteamerFactory -
flushExecutor-17" daemon [_thread_blocked, id=16734,
stack(0x00000000425e3000,0x0000000042604000)]
0x00007fd48b473000 JavaThread "CompressionSteamerFactory -
flushExecutor-16" daemon [_thread_blocked, id=16729,
stack(0x00000000425c2000,0x00000000425e3000)]
0x00007fd48ba25800 JavaThread "CompressionSteamerFactory -
flushExecutor-15" daemon [_thread_blocked, id=16726,
stack(0x000000004255f000,0x0000000042580000)]
0x00007fd48bde6800 JavaThread "SocketConnectorIoProcessor-2.0" daemon
[_thread_in_native, id=16715,
stack(0x000000004251d000,0x000000004253e000)]
0x00007fd48c9ca000 JavaThread "CompressionSteamerFactory -
flushExecutor-14" daemon [_thread_blocked, id=16714,
stack(0x0000000040009000,0x000000004002a000)]
0x00007fd4841ac800 JavaThread "CompressionSteamerFactory -
flushExecutor-13" daemon [_thread_blocked, id=16709,
stack(0x00000000424fc000,0x000000004251d000)]
0x00007fd4841c8800 JavaThread "CompressionSteamerFactory -
flushExecutor-12" daemon [_thread_blocked, id=16707,
stack(0x00000000424ba000,0x00000000424db000)]
0x00007fd48b630800 JavaThread "CompressionSteamerFactory -
flushExecutor-11" daemon [_thread_blocked, id=16706,
stack(0x0000000042499000,0x00000000424ba000)]
0x00007fd48c870000 JavaThread "CompressionSteamerFactory -
flushExecutor-10" daemon [_thread_blocked, id=16703,
stack(0x0000000042457000,0x0000000042478000)]
0x00007fd484001800 JavaThread "CompressionSteamerFactory -
flushExecutor-9" daemon [_thread_blocked, id=16668,
stack(0x0000000042268000,0x0000000042289000)]
0x00007fd490b84000 JavaThread "CompressionSteamerFactory -
flushExecutor-8" daemon [_thread_blocked, id=16667,
stack(0x0000000040390000,0x00000000403b1000)]
0x00007fd48400b800 JavaThread "MultiBackend-Executor-Thread-8" daemon
[_thread_blocked, id=16662,
stack(0x0000000042247000,0x0000000042268000)]
0x00007fd48c725800 JavaThread "CompressionSteamerFactory -
flushExecutor-7" daemon [_thread_blocked, id=16659,
stack(0x00000000421e4000,0x0000000042205000)]
0x00007fd48cec6800 JavaThread "CompressionSteamerFactory -
flushExecutor-6" daemon [_thread_blocked, id=16656,
stack(0x00000000421a2000,0x00000000421c3000)]
0x00007fd48c4d8000 JavaThread "CompressionSteamerFactory -
flushExecutor-5" daemon [_thread_blocked, id=16647,
stack(0x00000000420bb000,0x00000000420dc000)]
0x00007fd48b871000 JavaThread "CompressionSteamerFactory -
flushExecutor-4" daemon [_thread_blocked, id=16639,
stack(0x0000000041fb3000,0x0000000041fd4000)]
0x00007fd48b870000 JavaThread "CompressionSteamerFactory -
flushExecutor-3" daemon [_thread_blocked, id=16638,
stack(0x0000000041f92000,0x0000000041fb3000)]
0x00007fd48c0b4000 JavaThread "CompressionSteamerFactory -
flushExecutor-2" daemon [_thread_blocked, id=16637,
stack(0x0000000041e41000,0x0000000041e62000)]
0x00007fd48cef2000 JavaThread "CompressionSteamerFactory -
flushExecutor-1" daemon [_thread_blocked, id=16634,
stack(0x0000000041dc8000,0x0000000041de9000)]
0x00007fd491cd7000 JavaThread "http-80-1" daemon [_thread_blocked,
id=16473, stack(0x000000004085d000,0x000000004087e000)]
0x00007fd48c096800 JavaThread "http-443-Acceptor-0" daemon
[_thread_in_native, id=16472,
stack(0x0000000041cd1000,0x0000000041cf2000)]
0x00007fd48c3d9800 JavaThread "http-443-CometPoller-0" daemon
[_thread_blocked, id=16471,
stack(0x000000004036f000,0x0000000040390000)]
0x00007fd48c300800 JavaThread "http-443-Poller-0" daemon
[_thread_blocked, id=16470,
stack(0x0000000041e20000,0x0000000041e41000)]
=>0x00007fd48d305800 JavaThread "http-80-Acceptor-0" daemon
[_thread_in_native, id=16469,
stack(0x0000000041d86000,0x0000000041da7000)]
0x00007fd48c407000 JavaThread "http-80-Sendfile-0" daemon
[_thread_blocked, id=16468,
stack(0x000000004034e000,0x000000004036f000)]
0x00007fd48c787000 JavaThread "http-80-CometPoller-0" daemon
[_thread_blocked, id=16467,
stack(0x0000000041214000,0x0000000041235000)]
0x00007fd48d12b800 JavaThread "http-80-Poller-0" daemon
[_thread_blocked, id=16466,
stack(0x000000004071a000,0x000000004073b000)]
0x00007fd4a67bd000 JavaThread "MultiBackend-Executor-Thread-2" daemon
[_thread_blocked, id=16450,
stack(0x0000000041cb0000,0x0000000041cd1000)]
0x00007fd4a67eb800 JavaThread "MultiBackend-Executor-Thread-1" daemon
[_thread_blocked, id=16449,
stack(0x0000000041b86000,0x0000000041ba7000)]
0x00007fd48d3ac800 JavaThread "MaintThread" daemon [_thread_blocked,
id=16448, stack(0x00000000404db000,0x00000000404fc000)]
0x00007fd48c3da800 JavaThread "MaintThread" daemon [_thread_blocked,
id=16447, stack(0x0000000041b65000,0x0000000041b86000)]
0x00007fd48d047000 JavaThread "MaintThread" daemon [_thread_blocked,
id=16446, stack(0x0000000041c2f000,0x0000000041c50000)]
0x00007fd48c7b8000 JavaThread "MaintThread" daemon [_thread_blocked,
id=16445, stack(0x0000000041b44000,0x0000000041b65000)]
0x00007fd48cc06800 JavaThread "PooledByteBufferExpirer-0" daemon
[_thread_blocked, id=16444,
stack(0x0000000040f27000,0x0000000040f48000)]
0x00007fd4922b5000 JavaThread "Timer-0" daemon [_thread_blocked,
id=16442, stack(0x0000000041b23000,0x0000000041b44000)]
0x00007fd4922b0000 JavaThread "Thread-4" daemon [_thread_blocked,
id=16441, stack(0x0000000041b02000,0x0000000041b23000)]
0x00007fd491cfc800 JavaThread "MySQL Statement Cancellation Timer"
daemon [_thread_blocked, id=16440,
stack(0x0000000040f06000,0x0000000040f27000)]
0x00007fd4a67a4800 JavaThread "Low Memory Detector" daemon
[_thread_blocked, id=16429,
stack(0x00000000419e0000,0x0000000041a01000)]
0x00007fd48c06e800 JavaThread "CompilerThread1" daemon
[_thread_blocked, id=16428,
stack(0x000000004022c000,0x000000004032d000)]
0x00007fd48c06c800 JavaThread "CompilerThread0" daemon
[_thread_blocked, id=16427,
stack(0x00000000418df000,0x00000000419e0000)]
0x00007fd48c06a800 JavaThread "Signal Dispatcher" daemon
[_thread_blocked, id=16426,
stack(0x0000000040eb4000,0x0000000040ed5000)]
0x00007fd48c068800 JavaThread "Surrogate Locker Thread (CMS)" daemon
[_thread_blocked, id=16425,
stack(0x000000004020b000,0x000000004022c000)]
0x00007fd48c049000 JavaThread "Finalizer" daemon [_thread_blocked,
id=16424, stack(0x0000000040ee5000,0x0000000040f06000)]
0x00007fd48c047000 JavaThread "Reference Handler" daemon
[_thread_blocked, id=16423,
stack(0x00000000410a1000,0x00000000410c2000)]
Other Threads:
0x00007fd48c042800 VMThread [stack:
0x0000000041e70000,0x0000000041f71000] [id=16422]
0x00007fd48c073800 WatcherThread [stack:
0x0000000041a01000,0x0000000041b02000] [id=16430]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
par new generation total 2831168K, used 131140K [0x00002aaaaac00000,
0x00002aab6ac00000, 0x00002aab6ac00000)
eden space 2516608K, 4% used [0x00002aaaaac00000,
0x00002aaab144d540, 0x00002aab445a0000)
from space 314560K, 7% used [0x00002aab445a0000, 0x00002aab45d63d80,
0x00002aab578d0000)
to space 314560K, 0% used [0x00002aab578d0000, 0x00002aab578d0000,
0x00002aab6ac00000)
concurrent mark-sweep generation total 15728640K, used 7446994K
[0x00002aab6ac00000, 0x00002aaf2ac00000, 0x00002aaf2ac00000)
concurrent-mark-sweep perm gen total 131072K, used 57831K
[0x00002aaf2ac00000, 0x00002aaf32c00000, 0x00002aaf32c00000)
Dynamic libraries:
40000000-40009000 r-xp 00000000 08:01
6570548 /opt/jdk1.6.0_18/bin/java
40009000-4000c000 ---p 00000000 00:00 0
4000c000-4002a000 rwxp 00000000 00:00 0
40068000-4006b000 ---p 00000000 00:00 0
4006b000-40089000 rwxp 00000000 00:00 0
400b3000-400b6000 ---p 00000000 00:00 0
400b6000-400d4000 rwxp 00000000 00:00 0
400d7000-400da000 ---p 00000000 00:00 0
400da000-400f8000 rwxp 00000000 00:00 0
40108000-4010a000 rwxp 00008000 08:01
6570548 /opt/jdk1.6.0_18/bin/java
4010a000-4010b000 ---p 00000000 00:00 0
4010b000-4020b000 rwxp 00000000 00:00 0
4020b000-4020e000 ---p 00000000 00:00 0
4020e000-4022c000 rwxp 00000000 00:00 0
4022c000-4022f000 ---p 00000000 00:00 0
4022f000-4032d000 rwxp 00000000 00:00 0
4032d000-40330000 ---p 00000000 00:00 0
40330000-4034e000 rwxp 00000000 00:00 0
4034e000-40351000 ---p 00000000 00:00 0
40351000-4036f000 rwxp 00000000 00:00 0
4036f000-40372000 ---p 00000000 00:00 0
40372000-40390000 rwxp 00000000 00:00 0
40390000-40393000 ---p 00000000 00:00 0
40393000-403b1000 rwxp 00000000 00:00 0
403b1000-403b4000 ---p 00000000 00:00 0
403b4000-403d2000 rwxp 00000000 00:00 0
403da000-403db000 ---p 00000000 00:00 0
403db000-404db000 rwxp 00000000 00:00 0
404db000-404de000 ---p 00000000 00:00 0
404de000-404fc000 rwxp 00000000 00:00 0
404fc000-404ff000 ---p 00000000 00:00 0
404ff000-4051d000 rwxp 00000000 00:00 0
4051d000-40520000 ---p 00000000 00:00 0
40520000-4053e000 rwxp 00000000 00:00 0
4053e000-40541000 ---p 00000000 00:00 0
40541000-4055f000 rwxp 00000000 00:00 0
4055f000-40562000 ---p 00000000 00:00 0
40562000-40580000 rwxp 00000000 00:00 0
405ad000-405b0000 ---p 00000000 00:00 0
405b0000-405ce000 rwxp 00000000 00:00 0
405ce000-405d1000 ---p 00000000 00:00 0
405d1000-405ef000 rwxp 00000000 00:00 0
405f8000-405f9000 ---p 00000000 00:00 0
405f9000-406f9000 rwxp 00000000 00:00 0
406f9000-406fc000 ---p 00000000 00:00 0
406fc000-4071a000 rwxp 00000000 00:00 0
4071a000-4071d000 ---p 00000000 00:00 0
4071d000-4073b000 rwxp 00000000 00:00 0
4073b000-4073e000 ---p 00000000 00:00 0
4073e000-4075c000 rwxp 00000000 00:00 0
4075c000-4075d000 ---p 00000000 00:00 0
4075d000-4085d000 rwxp 00000000 00:00 0
4085d000-40860000 ---p 00000000 00:00 0
40860000-4087e000 rwxp 00000000 00:00 0
408ae000-408af000 ---p 00000000 00:00 0
408af000-409af000 rwxp 00000000 00:00 0
409af000-409b0000 ---p 00000000 00:00 0
409b0000-40ab0000 rwxp 00000000 00:00 0
40ab0000-40ab1000 ---p 00000000 00:00 0
40ab1000-40bb1000 rwxp 00000000 00:00 0
40bb1000-40bb2000 ---p 00000000 00:00 0
40bb2000-40cb2000 rwxp 00000000 00:00 0
40cb2000-40cb3000 ---p 00000000 00:00 0
40cb3000-40db3000 rwxp 00000000 00:00 0
40db3000-40db4000 ---p 00000000 00:00 0
40db4000-40eb4000 rwxp 00000000 00:00 0
40eb4000-40eb7000 ---p 00000000 00:00 0
40eb7000-40ed5000 rwxp 00000000 00:00 0
40ee5000-40ee8000 ---p 00000000 00:00 0
40ee8000-40f06000 rwxp 00000000 00:00 0
40f06000-40f09000 ---p 00000000 00:00 0
40f09000-40f27000 rwxp 00000000 00:00 0
40f27000-40f2a000 ---p 00000000 00:00 0
40f2a000-40f48000 rwxp 00000000 00:00 0
40f48000-40f4b000 ---p 00000000 00:00 0
40f4b000-40f69000 rwxp 00000000 00:00 0
40fa0000-40fa1000 ---p 00000000 00:00 0
40fa1000-410a1000 rwxp 00000000 00:00 0
410a1000-410a4000 ---p 00000000 00:00 0
410a4000-410c2000 rwxp 00000000 00:00 0
410c2000-410c5000 ---p 00000000 00:00 0
410c5000-410e3000 rwxp 00000000 00:00 0
410f2000-410f3000 ---p 00000000 00:00 0
410f3000-411f3000 rwxp 00000000 00:00 0
411f3000-411f6000 ---p 00000000 00:00 0
411f6000-41214000 rwxp 00000000 00:00 0
41214000-41217000 ---p 00000000 00:00 0
41217000-41235000 rwxp 00000000 00:00 0
41235000-41238000 ---p 00000000 00:00 0
41238000-41256000 rwxp 00000000 00:00 0
41256000-41259000 ---p 00000000 00:00 0
41259000-41277000 rwxp 00000000 00:00 0
41277000-4127a000 ---p 00000000 00:00 0
4127a000-41298000 rwxp 00000000 00:00 0
412b8000-412d9000 rwxp 00000000 00:00 0
[heap]
412d9000-412da000 ---p 00000000 00:00 0
412da000-413da000 rwxp 00000000 00:00 0
413da000-413db000 ---p 00000000 00:00 0
413db000-414db000 rwxp 00000000 00:00 0
414db000-414dc000 ---p 00000000 00:00 0
414dc000-415dc000 rwxp 00000000 00:00 0
415dc000-415dd000 ---p 00000000 00:00 0
415dd000-416dd000 rwxp 00000000 00:00 0
416dd000-416de000 ---p 00000000 00:00 0
416de000-417de000 rwxp 00000000 00:00 0
417de000-417df000 ---p 00000000 00:00 0
417df000-418df000 rwxp 00000000 00:00 0
418df000-418e2000 ---p 00000000 00:00 0
418e2000-419e0000 rwxp 00000000 00:00 0
419e0000-419e3000 ---p 00000000 00:00 0
419e3000-41a01000 rwxp 00000000 00:00 0
41a01000-41a02000 ---p 00000000 00:00 0
41a02000-41b02000 rwxp 00000000 00:00 0
41b02000-41b05000 ---p 00000000 00:00 0
41b05000-41b23000 rwxp 00000000 00:00 0
41b23000-41b26000 ---p 00000000 00:00 0
41b26000-41b44000 rwxp 00000000 00:00 0
41b44000-41b47000 ---p 00000000 00:00 0
41b47000-41b65000 rwxp 00000000 00:00 0
41b65000-41b68000 ---p 00000000 00:00 0
41b68000-41b86000 rwxp 00000000 00:00 0
41b86000-41b89000 ---p 00000000 00:00 0
41b89000-41ba7000 rwxp 00000000 00:00 0
41ba7000-41baa000 ---p 00000000 00:00 0
41baa000-41bc8000 rwxp 00000000 00:00 0
41bc8000-41bcb000 ---p 00000000 00:00 0
41bcb000-41be9000 rwxp 00000000 00:00 0
41be9000-41bec000 ---p 00000000 00:00 0
41bec000-41c0a000 rwxp 00000000 00:00 0
41c0e000-41c11000 ---p 00000000 00:00 0
41c11000-41c2f000 rwxp 00000000 00:00 0
41c2f000-41c32000 ---p 00000000 00:00 0
41c32000-41c50000 rwxp 00000000 00:00 0
41c50000-41c53000 ---p 00000000 00:00 0
41c53000-41c71000 rwxp 00000000 00:00 0
41c8f000-41c92000 ---p 00000000 00:00 0
41c92000-41cb0000 rwxp 00000000 00:00 0
41cb0000-41cb3000 ---p 00000000 00:00 0
41cb3000-41cd1000 rwxp 00000000 00:00 0
41cd1000-41cd4000 ---p 00000000 00:00 0
41cd4000-41cf2000 rwxp 00000000 00:00 0
41d13000-41d16000 ---p 00000000 00:00 0
41d16000-41d34000 rwxp 00000000 00:00 0
41d34000-41d37000 ---p 00000000 00:00 0
41d37000-41d55000 rwxp 00000000 00:00 0
41d55000-41d58000 ---p 00000000 00:00 0
41d58000-41d76000 rwxp 00000000 00:00 0
41d86000-41d89000 ---p 00000000 00:00 0
41d89000-41da7000 rwxp 00000000 00:00 0
41da7000-41daa000 ---p 00000000 00:00 0
41daa000-41dc8000 rwxp 00000000 00:00 0
41dc8000-41dcb000 ---p 00000000 00:00 0
41dcb000-41de9000 rwxp 00000000 00:00 0
41dff000-41e02000 ---p 00000000 00:00 0
41e02000-41e20000 rwxp 00000000 00:00 0
41e20000-41e23000 ---p 00000000 00:00 0
41e23000-41e41000 rwxp 00000000 00:00 0
41e41000-41e44000 ---p 00000000 00:00 0
41e44000-41e62000 rwxp 00000000 00:00 0
41e70000-41e71000 ---p 00000000 00:00 0
41e71000-41f71000 rwxp 00000000 00:00 0
41f71000-41f74000 ---p 00000000 00:00 0
41f74000-41f92000 rwxp 00000000 00:00 0
41f92000-41f95000 ---p 00000000 00:00 0
41f95000-41fb3000 rwxp 00000000 00:00 0
41fb3000-41fb6000 ---p 00000000 00:00 0
41fb6000-41fd4000 rwxp 00000000 00:00 0
41fd4000-41fd7000 ---p 00000000 00:00 0
41fd7000-41ff5000 rwxp 00000000 00:00 0
41ff5000-41ff8000 ---p 00000000 00:00 0
41ff8000-42016000 rwxp 00000000 00:00 0
42037000-4203a000 ---p 00000000 00:00 0
4203a000-42058000 rwxp 00000000 00:00 0
42058000-4205b000 ---p 00000000 00:00 0
4205b000-42079000 rwxp 00000000 00:00 0
4209a000-4209d000 ---p 00000000 00:00 0
4209d000-420bb000 rwxp 00000000 00:00 0
420bb000-420be000 ---p 00000000 00:00 0
420be000-420dc000 rwxp 00000000 00:00 0
420dc000-420df000 ---p 00000000 00:00 0
420df000-420fd000 rwxp 00000000 00:00 0
420fd000-42100000 ---p 00000000 00:00 0
42100000-4211e000 rwxp 00000000 00:00 0
4211e000-42121000 ---p 00000000 00:00 0
42121000-4213f000 rwxp 00000000 00:00 0
42160000-42163000 ---p 00000000 00:00 0
42163000-42181000 rwxp 00000000 00:00 0
42181000-42184000 ---p 00000000 00:00 0
42184000-421a2000 rwxp 00000000 00:00 0
421a2000-421a5000 ---p 00000000 00:00 0
421a5000-421c3000 rwxp 00000000 00:00 0
421c3000-421c6000 ---p 00000000 00:00 0
421c6000-421e4000 rwxp 00000000 00:00 0
421e4000-421e7000 ---p 00000000 00:00 0
421e7000-42205000 rwxp 00000000 00:00 0
42205000-42208000 ---p 00000000 00:00 0
42208000-42226000 rwxp 00000000 00:00 0
42226000-42229000 ---p 00000000 00:00 0
42229000-42247000 rwxp 00000000 00:00 0
42247000-4224a000 ---p 00000000 00:00 0
4224a000-42268000 rwxp 00000000 00:00 0
42268000-4226b000 ---p 00000000 00:00 0
4226b000-42289000 rwxp 00000000 00:00 0
42289000-4228c000 ---p 00000000 00:00 0
4228c000-422aa000 rwxp 00000000 00:00 0
422aa000-422ad000 ---p 00000000 00:00 0
422ad000-422cb000 rwxp 00000000 00:00 0
4230d000-42310000 ---p 00000000 00:00 0
42310000-4232e000 rwxp 00000000 00:00 0
4232e000-42331000 ---p 00000000 00:00 0
42331000-4234f000 rwxp 00000000 00:00 0
4234f000-42352000 ---p 00000000 00:00 0
42352000-42370000 rwxp 00000000 00:00 0
42370000-42373000 ---p 00000000 00:00 0
42373000-42391000 rwxp 00000000 00:00 0
42391000-42394000 ---p 00000000 00:00 0
42394000-423b2000 rwxp 00000000 00:00 0
423d3000-423d6000 ---p 00000000 00:00 0
423d6000-423f4000 rwxp 00000000 00:00 0
42415000-42418000 ---p 00000000 00:00 0
42418000-42436000 rwxp 00000000 00:00 0
42436000-42439000 ---p 00000000 00:00 0
42439000-42457000 rwxp 00000000 00:00 0
42457000-4245a000 ---p 00000000 00:00 0
4245a000-42478000 rwxp 00000000 00:00 0
42478000-4247b000 ---p 00000000 00:00 0
4247b000-42499000 rwxp 00000000 00:00 0
42499000-4249c000 ---p 00000000 00:00 0
4249c000-424ba000 rwxp 00000000 00:00 0
424ba000-424bd000 ---p 00000000 00:00 0
424bd000-424db000 rwxp 00000000 00:00 0
424db000-424de000 ---p 00000000 00:00 0
424de000-424fc000 rwxp 00000000 00:00 0
424fc000-424ff000 ---p 00000000 00:00 0
424ff000-4251d000 rwxp 00000000 00:00 0
4251d000-42520000 ---p 00000000 00:00 0
42520000-4253e000 rwxp 00000000 00:00 0
4253e000-42541000 ---p 00000000 00:00 0
42541000-4255f000 rwxp 00000000 00:00 0
4255f000-42562000 ---p 00000000 00:00 0
42562000-42580000 rwxp 00000000 00:00 0
42580000-42583000 ---p 00000000 00:00 0
42583000-425a1000 rwxp 00000000 00:00 0
425a1000-425a4000 ---p 00000000 00:00 0
425a4000-425c2000 rwxp 00000000 00:00 0
425c2000-425c5000 ---p 00000000 00:00 0
425c5000-425e3000 rwxp 00000000 00:00 0
425e3000-425e6000 ---p 00000000 00:00 0
425e6000-42604000 rwxp 00000000 00:00 0
42604000-42607000 ---p 00000000 00:00 0
42607000-42625000 rwxp 00000000 00:00 0
42646000-42649000 ---p 00000000 00:00 0
42649000-42667000 rwxp 00000000 00:00 0
42667000-4266a000 ---p 00000000 00:00 0
4266a000-42688000 rwxp 00000000 00:00 0
426a9000-426ac000 ---p 00000000 00:00 0
426ac000-426ca000 rwxp 00000000 00:00 0
426ca000-426cd000 ---p 00000000 00:00 0
426cd000-426eb000 rwxp 00000000 00:00 0
426eb000-426ee000 ---p 00000000 00:00 0
426ee000-4270c000 rwxp 00000000 00:00 0
4270c000-4270f000 ---p 00000000 00:00 0
4270f000-4272d000 rwxp 00000000 00:00 0
4272d000-42730000 ---p 00000000 00:00 0
42730000-4274e000 rwxp 00000000 00:00 0
4274e000-42751000 ---p 00000000 00:00 0
42751000-4276f000 rwxp 00000000 00:00 0
42790000-42793000 ---p 00000000 00:00 0
42793000-427b1000 rwxp 00000000 00:00 0
427b1000-427b4000 ---p 00000000 00:00 0
427b4000-427d2000 rwxp 00000000 00:00 0
427d2000-427d5000 ---p 00000000 00:00 0
427d5000-427f3000 rwxp 00000000 00:00 0
427f3000-427f6000 ---p 00000000 00:00 0
427f6000-42814000 rwxp 00000000 00:00 0
42814000-42817000 ---p 00000000 00:00 0
42817000-42835000 rwxp 00000000 00:00 0
42835000-42838000 ---p 00000000 00:00 0
42838000-42856000 rwxp 00000000 00:00 0
42856000-42859000 ---p 00000000 00:00 0
42859000-42877000 rwxp 00000000 00:00 0
42877000-4287a000 ---p 00000000 00:00 0
4287a000-42898000 rwxp 00000000 00:00 0
42898000-4289b000 ---p 00000000 00:00 0
4289b000-428b9000 rwxp 00000000 00:00 0
428b9000-428bc000 ---p 00000000 00:00 0
428bc000-428da000 rwxp 00000000 00:00 0
428da000-428dd000 ---p 00000000 00:00 0
428dd000-428fb000 rwxp 00000000 00:00 0
428fb000-428fe000 ---p 00000000 00:00 0
428fe000-4291c000 rwxp 00000000 00:00 0
4295e000-42961000 ---p 00000000 00:00 0
42961000-4297f000 rwxp 00000000 00:00 0
4297f000-42982000 ---p 00000000 00:00 0
42982000-429a0000 rwxp 00000000 00:00 0
429a0000-429a3000 ---p 00000000 00:00 0
429a3000-429c1000 rwxp 00000000 00:00 0
429c1000-429c4000 ---p 00000000 00:00 0
429c4000-429e2000 rwxp 00000000 00:00 0
429e2000-429e5000 ---p 00000000 00:00 0
429e5000-42a03000 rwxp 00000000 00:00 0
42a03000-42a06000 ---p 00000000 00:00 0
42a06000-42a24000 rwxp 00000000 00:00 0
42a66000-42a69000 ---p 00000000 00:00 0
42a69000-42a87000 rwxp 00000000 00:00 0
42a87000-42a8a000 ---p 00000000 00:00 0
42a8a000-42aa8000 rwxp 00000000 00:00 0
42aa8000-42aab000 ---p 00000000 00:00 0
42aab000-42ac9000 rwxp 00000000 00:00 0
42ac9000-42acc000 ---p 00000000 00:00 0
42acc000-42aea000 rwxp 00000000 00:00 0
42aea000-42aed000 ---p 00000000 00:00 0
42aed000-42b0b000 rwxp 00000000 00:00 0
42b0b000-42b0e000 ---p 00000000 00:00 0
42b0e000-42b2c000 rwxp 00000000 00:00 0
42b2c000-42b2f000 ---p 00000000 00:00 0
42b2f000-42b4d000 rwxp 00000000 00:00 0
42b4d000-42b50000 ---p 00000000 00:00 0
42b50000-42b6e000 rwxp 00000000 00:00 0
42b6e000-42b71000 ---p 00000000 00:00 0
42b71000-42b8f000 rwxp 00000000 00:00 0
42b8f000-42b92000 ---p 00000000 00:00 0
42b92000-42bb0000 rwxp 00000000 00:00 0
42bb0000-42bb3000 ---p 00000000 00:00 0
42bb3000-42bd1000 rwxp 00000000 00:00 0
42bd1000-42bd4000 ---p 00000000 00:00 0
42bd4000-42bf2000 rwxp 00000000 00:00 0
42bf2000-42bf5000 ---p 00000000 00:00 0
42bf5000-42c13000 rwxp 00000000 00:00 0
42c13000-42c16000 ---p 00000000 00:00 0
42c16000-42c34000 rwxp 00000000 00:00 0
42c34000-42c37000 ---p 00000000 00:00 0
42c37000-42c55000 rwxp 00000000 00:00 0
42c55000-42c58000 ---p 00000000 00:00 0
42c58000-42c76000 rwxp 00000000 00:00 0
42c76000-42c79000 ---p 00000000 00:00 0
42c79000-42c97000 rwxp 00000000 00:00 0
42c97000-42c9a000 ---p 00000000 00:00 0
42c9a000-42cb8000 rwxp 00000000 00:00 0
42cb8000-42cbb000 ---p 00000000 00:00 0
42cbb000-42cd9000 rwxp 00000000 00:00 0
42cfa000-42cfd000 ---p 00000000 00:00 0
42cfd000-42d1b000 rwxp 00000000 00:00 0
42d1b000-42d1e000 ---p 00000000 00:00 0
42d1e000-42d3c000 rwxp 00000000 00:00 0
42d3c000-42d3f000 ---p 00000000 00:00 0
42d3f000-42d5d000 rwxp 00000000 00:00 0
42d5d000-42d60000 ---p 00000000 00:00 0
42d60000-42d7e000 rwxp 00000000 00:00 0
42d7e000-42d81000 ---p 00000000 00:00 0
42d81000-42d9f000 rwxp 00000000 00:00 0
42d9f000-42da2000 ---p 00000000 00:00 0
42da2000-42dc0000 rwxp 00000000 00:00 0
42dc0000-42dc3000 ---p 00000000 00:00 0
42dc3000-42de1000 rwxp 00000000 00:00 0
42de1000-42de4000 ---p 00000000 00:00 0
42de4000-42e02000 rwxp 00000000 00:00 0
42e02000-42e05000 ---p 00000000 00:00 0
42e05000-42e23000 rwxp 00000000 00:00 0
42e23000-42e26000 ---p 00000000 00:00 0
42e26000-42e44000 rwxp 00000000 00:00 0
42e44000-42e47000 ---p 00000000 00:00 0
42e47000-42e65000 rwxp 00000000 00:00 0
42e65000-42e68000 ---p 00000000 00:00 0
42e68000-42e86000 rwxp 00000000 00:00 0
42e86000-42e89000 ---p 00000000 00:00 0
42e89000-42ea7000 rwxp 00000000 00:00 0
42ea7000-42eaa000 ---p 00000000 00:00 0
42eaa000-42ec8000 rwxp 00000000 00:00 0
42ec8000-42ecb000 ---p 00000000 00:00 0
42ecb000-42ee9000 rwxp 00000000 00:00 0
42ee9000-42eec000 ---p 00000000 00:00 0
42eec000-42f0a000 rwxp 00000000 00:00 0
42f0a000-42f0d000 ---p 00000000 00:00 0
42f0d000-42f2b000 rwxp 00000000 00:00 0
42f2b000-42f2e000 ---p 00000000 00:00 0
42f2e000-42f4c000 rwxp 00000000 00:00 0
42f4c000-42f4f000 ---p 00000000 00:00 0
42f4f000-42f6d000 rwxp 00000000 00:00 0
42f6d000-42f70000 ---p 00000000 00:00 0
42f70000-42f8e000 rwxp 00000000 00:00 0
42f8e000-42f91000 ---p 00000000 00:00 0
42f91000-42faf000 rwxp 00000000 00:00 0
42faf000-42fb2000 ---p 00000000 00:00 0
42fb2000-42fd0000 rwxp 00000000 00:00 0
42fd0000-42fd3000 ---p 00000000 00:00 0
42fd3000-42ff1000 rwxp 00000000 00:00 0
42ff1000-42ff4000 ---p 00000000 00:00 0
42ff4000-43012000 rwxp 00000000 00:00 0
43012000-43015000 ---p 00000000 00:00 0
43015000-43033000 rwxp 00000000 00:00 0
43033000-43036000 ---p 00000000 00:00 0
43036000-43054000 rwxp 00000000 00:00 0
43054000-43057000 ---p 00000000 00:00 0
43057000-43075000 rwxp 00000000 00:00 0
43075000-43078000 ---p 00000000 00:00 0
43078000-43096000 rwxp 00000000 00:00 0
43096000-43099000 ---p 00000000 00:00 0
43099000-430b7000 rwxp 00000000 00:00 0
430b7000-430ba000 ---p 00000000 00:00 0
430ba000-430d8000 rwxp 00000000 00:00 0
430d8000-430db000 ---p 00000000 00:00 0
430db000-430f9000 rwxp 00000000 00:00 0
430f9000-430fc000 ---p 00000000 00:00 0
430fc000-4311a000 rwxp 00000000 00:00 0
4311a000-4311d000 ---p 00000000 00:00 0
4311d000-4313b000 rwxp 00000000 00:00 0
4313b000-4313e000 ---p 00000000 00:00 0
4313e000-4315c000 rwxp 00000000 00:00 0
4315c000-4315f000 ---p 00000000 00:00 0
4315f000-4317d000 rwxp 00000000 00:00 0
4317d000-43180000 ---p 00000000 00:00 0
43180000-4319e000 rwxp 00000000 00:00 0
4319e000-431a1000 ---p 00000000 00:00 0
431a1000-431bf000 rwxp 00000000 00:00 0
431bf000-431c2000 ---p 00000000 00:00 0
431c2000-431e0000 rwxp 00000000 00:00 0
431e0000-431e3000 ---p 00000000 00:00 0
431e3000-43201000 rwxp 00000000 00:00 0
43201000-43204000 ---p 00000000 00:00 0
43204000-43222000 rwxp 00000000 00:00 0
43222000-43225000 ---p 00000000 00:00 0
43225000-43243000 rwxp 00000000 00:00 0
43243000-43246000 ---p 00000000 00:00 0
43246000-43264000 rwxp 00000000 00:00 0
43264000-43267000 ---p 00000000 00:00 0
43267000-43285000 rwxp 00000000 00:00 0
43285000-43288000 ---p 00000000 00:00 0
43288000-432a6000 rwxp 00000000 00:00 0
432a6000-432a9000 ---p 00000000 00:00 0
432a9000-432c7000 rwxp 00000000 00:00 0
432c7000-432ca000 ---p 00000000 00:00 0
432ca000-432e8000 rwxp 00000000 00:00 0
432e8000-432eb000 ---p 00000000 00:00 0
432eb000-43309000 rwxp 00000000 00:00 0
43309000-4330c000 ---p 00000000 00:00 0
4330c000-4332a000 rwxp 00000000 00:00 0
4332a000-4332d000 ---p 00000000 00:00 0
4332d000-4334b000 rwxp 00000000 00:00 0
4334b000-4334e000 ---p 00000000 00:00 0
4334e000-4336c000 rwxp 00000000 00:00 0
4336c000-4336f000 ---p 00000000 00:00 0
4336f000-4338d000 rwxp 00000000 00:00 0
4338d000-43390000 ---p 00000000 00:00 0
43390000-433ae000 rwxp 00000000 00:00 0
433cf000-433d2000 ---p 00000000 00:00 0
433d2000-433f0000 rwxp 00000000 00:00 0
433f0000-433f3000 ---p 00000000 00:00 0
433f3000-43411000 rwxp 00000000 00:00 0
43411000-43414000 ---p 00000000 00:00 0
43414000-43432000 rwxp 00000000 00:00 0
43432000-43435000 ---p 00000000 00:00 0
43435000-43453000 rwxp 00000000 00:00 0
43453000-43456000 ---p 00000000 00:00 0
43456000-43474000 rwxp 00000000 00:00 0
43474000-43477000 ---p 00000000 00:00 0
43477000-43495000 rwxp 00000000 00:00 0
43495000-43498000 ---p 00000000 00:00 0
43498000-434b6000 rwxp 00000000 00:00 0
434b6000-434b9000 ---p 00000000 00:00 0
434b9000-434d7000 rwxp 00000000 00:00 0
434d7000-434da000 ---p 00000000 00:00 0
434da000-434f8000 rwxp 00000000 00:00 0
434f8000-434fb000 ---p 00000000 00:00 0
434fb000-43519000 rwxp 00000000 00:00 0
43519000-4351c000 ---p 00000000 00:00 0
4351c000-4353a000 rwxp 00000000 00:00 0
4353a000-4353d000 ---p 00000000 00:00 0
4353d000-4355b000 rwxp 00000000 00:00 0
4355b000-4355e000 ---p 00000000 00:00 0
4355e000-4357c000 rwxp 00000000 00:00 0
4357c000-4357f000 ---p 00000000 00:00 0
4357f000-4359d000 rwxp 00000000 00:00 0
4359d000-435a0000 ---p 00000000 00:00 0
435a0000-435be000 rwxp 00000000 00:00 0
435be000-435c1000 ---p 00000000 00:00 0
435c1000-435df000 rwxp 00000000 00:00 0
435df000-435e2000 ---p 00000000 00:00 0
435e2000-43600000 rwxp 00000000 00:00 0
43600000-43603000 ---p 00000000 00:00 0
43603000-43621000 rwxp 00000000 00:00 0
43621000-43624000 ---p 00000000 00:00 0
43624000-43642000 rwxp 00000000 00:00 0
43642000-43645000 ---p 00000000 00:00 0
43645000-43663000 rwxp 00000000 00:00 0
43663000-43666000 ---p 00000000 00:00 0
43666000-43684000 rwxp 00000000 00:00 0
43684000-43687000 ---p 00000000 00:00 0
43687000-436a5000 rwxp 00000000 00:00 0
436a5000-436a8000 ---p 00000000 00:00 0
436a8000-436c6000 rwxp 00000000 00:00 0
436c6000-436c9000 ---p 00000000 00:00 0
436c9000-436e7000 rwxp 00000000 00:00 0
436e7000-436ea000 ---p 00000000 00:00 0
436ea000-43708000 rwxp 00000000 00:00 0
43708000-4370b000 ---p 00000000 00:00 0
4370b000-43729000 rwxp 00000000 00:00 0
43729000-4372c000 ---p 00000000 00:00 0
4372c000-4374a000 rwxp 00000000 00:00 0
4374a000-4374d000 ---p 00000000 00:00 0
4374d000-4376b000 rwxp 00000000 00:00 0
437ad000-437b0000 ---p 00000000 00:00 0
437b0000-437ce000 rwxp 00000000 00:00 0
437ce000-437d1000 ---p 00000000 00:00 0
437d1000-437ef000 rwxp 00000000 00:00 0
437ef000-437f2000 ---p 00000000 00:00 0
437f2000-43810000 rwxp 00000000 00:00 0
43810000-43813000 ---p 00000000 00:00 0
43813000-43831000 rwxp 00000000 00:00 0
43831000-43834000 ---p 00000000 00:00 0
43834000-43852000 rwxp 00000000 00:00 0
43852000-43855000 ---p 00000000 00:00 0
43855000-43873000 rwxp 00000000 00:00 0
43873000-43876000 ---p 00000000 00:00 0
43876000-43894000 rwxp 00000000 00:00 0
43894000-43897000 ---p 00000000 00:00 0
43897000-438b5000 rwxp 00000000 00:00 0
438b5000-438b8000 ---p 00000000 00:00 0
438b8000-438d6000 rwxp 00000000 00:00 0
438d6000-438d9000 ---p 00000000 00:00 0
438d9000-438f7000 rwxp 00000000 00:00 0
438f7000-438fa000 ---p 00000000 00:00 0
438fa000-43918000 rwxp 00000000 00:00 0
43918000-4391b000 ---p 00000000 00:00 0
4391b000-43939000 rwxp 00000000 00:00 0
43939000-4393c000 ---p 00000000 00:00 0
4393c000-4395a000 rwxp 00000000 00:00 0
4395a000-4395d000 ---p 00000000 00:00 0
4395d000-4397b000 rwxp 00000000 00:00 0
4399c000-4399f000 ---p 00000000 00:00 0
4399f000-439bd000 rwxp 00000000 00:00 0
439bd000-439c0000 ---p 00000000 00:00 0
439c0000-439de000 rwxp 00000000 00:00 0
439de000-439e1000 ---p 00000000 00:00 0
439e1000-439ff000 rwxp 00000000 00:00 0
439ff000-43a02000 ---p 00000000 00:00 0
43a02000-43a20000 rwxp 00000000 00:00 0
43a20000-43a23000 ---p 00000000 00:00 0
43a23000-43a41000 rwxp 00000000 00:00 0
43a41000-43a44000 ---p 00000000 00:00 0
43a44000-43a62000 rwxp 00000000 00:00 0
43a62000-43a65000 ---p 00000000 00:00 0
43a65000-43a83000 rwxp 00000000 00:00 0
43a83000-43a86000 ---p 00000000 00:00 0
43a86000-43aa4000 rwxp 00000000 00:00 0
43aa4000-43aa7000 ---p 00000000 00:00 0
43aa7000-43ac5000 rwxp 00000000 00:00 0
43ac5000-43ac8000 ---p 00000000 00:00 0
43ac8000-43ae6000 rwxp 00000000 00:00 0
43ae6000-43ae9000 ---p 00000000 00:00 0
43ae9000-43b07000 rwxp 00000000 00:00 0
43b07000-43b0a000 ---p 00000000 00:00 0
43b0a000-43b28000 rwxp 00000000 00:00 0
43b28000-43b2b000 ---p 00000000 00:00 0
43b2b000-43b49000 rwxp 00000000 00:00 0
43b6a000-43b6d000 ---p 00000000 00:00 0
43b6d000-43b8b000 rwxp 00000000 00:00 0
43b8b000-43b8e000 ---p 00000000 00:00 0
43b8e000-43bac000 rwxp 00000000 00:00 0
43bac000-43baf000 ---p 00000000 00:00 0
43baf000-43bcd000 rwxp 00000000 00:00 0
43bcd000-43bd0000 ---p 00000000 00:00 0
43bd0000-43bee000 rwxp 00000000 00:00 0
43bee000-43bf1000 ---p 00000000 00:00 0
43bf1000-43c0f000 rwxp 00000000 00:00 0
43c0f000-43c12000 ---p 00000000 00:00 0
43c12000-43c30000 rwxp 00000000 00:00 0
43c30000-43c33000 ---p 00000000 00:00 0
43c33000-43c51000 rwxp 00000000 00:00 0
43c51000-43c54000 ---p 00000000 00:00 0
43c54000-43c72000 rwxp 00000000 00:00 0
43c72000-43c75000 ---p 00000000 00:00 0
43c75000-43c93000 rwxp 00000000 00:00 0
43cb4000-43cb7000 ---p 00000000 00:00 0
43cb7000-43cd5000 rwxp 00000000 00:00 0
43cd5000-43cd8000 ---p 00000000 00:00 0
43cd8000-43cf6000 rwxp 00000000 00:00 0
43cf6000-43cf9000 ---p 00000000 00:00 0
43cf9000-43d17000 rwxp 00000000 00:00 0
43d17000-43d1a000 ---p 00000000 00:00 0
43d1a000-43d38000 rwxp 00000000 00:00 0
43d38000-43d3b000 ---p 00000000 00:00 0
43d3b000-43d59000 rwxp 00000000 00:00 0
43d59000-43d5c000 ---p 00000000 00:00 0
43d5c000-43d7a000 rwxp 00000000 00:00 0
43d7a000-43d7d000 ---p 00000000 00:00 0
43d7d000-43d9b000 rwxp 00000000 00:00 0
43d9b000-43d9e000 ---p 00000000 00:00 0
43d9e000-43dbc000 rwxp 00000000 00:00 0
43dbc000-43dbf000 ---p 00000000 00:00 0
43dbf000-43ddd000 rwxp 00000000 00:00 0
43ddd000-43de0000 ---p 00000000 00:00 0
43de0000-43dfe000 rwxp 00000000 00:00 0
43dfe000-43e01000 ---p 00000000 00:00 0
43e01000-43e1f000 rwxp 00000000 00:00 0
43e1f000-43e22000 ---p 00000000 00:00 0
43e22000-43e40000 rwxp 00000000 00:00 0
43e40000-43e43000 ---p 00000000 00:00 0
43e43000-43e61000 rwxp 00000000 00:00 0
43e61000-43e64000 ---p 00000000 00:00 0
43e64000-43e82000 rwxp 00000000 00:00 0
43ea3000-43ea6000 ---p 00000000 00:00 0
43ea6000-43ec4000 rwxp 00000000 00:00 0
43ec4000-43ec7000 ---p 00000000 00:00 0
43ec7000-43ee5000 rwxp 00000000 00:00 0
43ee5000-43ee8000 ---p 00000000 00:00 0
43ee8000-43f06000 rwxp 00000000 00:00 0
43f06000-43f09000 ---p 00000000 00:00 0
43f09000-43f27000 rwxp 00000000 00:00 0
43f48000-43f4b000 ---p 00000000 00:00 0
43f4b000-43f69000 rwxp 00000000 00:00 0
43f69000-43f6c000 ---p 00000000 00:00 0
43f6c000-43f8a000 rwxp 00000000 00:00 0
43f8a000-43f8d000 ---p 00000000 00:00 0
43f8d000-43fab000 rwxp 00000000 00:00 0
43fab000-43fae000 ---p 00000000 00:00 0
43fae000-43fcc000 rwxp 00000000 00:00 0
43fcc000-43fcf000 ---p 00000000 00:00 0
43fcf000-43fed000 rwxp 00000000 00:00 0
43fed000-43ff0000 ---p 00000000 00:00 0
43ff0000-4400e000 rwxp 00000000 00:00 0
4402f000-44032000 ---p 00000000 00:00 0
44032000-44050000 rwxp 00000000 00:00 0
44050000-44053000 ---p 00000000 00:00 0
44053000-44071000 rwxp 00000000 00:00 0
44071000-44074000 ---p 00000000 00:00 0
44074000-44092000 rwxp 00000000 00:00 0
44092000-44095000 ---p 00000000 00:00 0
44095000-440b3000 rwxp 00000000 00:00 0
440b3000-440b6000 ---p 00000000 00:00 0
440b6000-440d4000 rwxp 00000000 00:00 0
440d4000-440d7000 ---p 00000000 00:00 0
440d7000-440f5000 rwxp 00000000 00:00 0
440f5000-440f8000 ---p 00000000 00:00 0
440f8000-44116000 rwxp 00000000 00:00 0
44116000-44119000 ---p 00000000 00:00 0
44119000-44137000 rwxp 00000000 00:00 0
44137000-4413a000 ---p 00000000 00:00 0
4413a000-44158000 rwxp 00000000 00:00 0
44158000-4415b000 ---p 00000000 00:00 0
4415b000-44179000 rwxp 00000000 00:00 0
44179000-4417c000 ---p 00000000 00:00 0
4417c000-4419a000 rwxp 00000000 00:00 0
4419a000-4419d000 ---p 00000000 00:00 0
4419d000-441bb000 rwxp 00000000 00:00 0
441bb000-441be000 ---p 00000000 00:00 0
441be000-441dc000 rwxp 00000000 00:00 0
441dc000-441df000 ---p 00000000 00:00 0
441df000-441fd000 rwxp 00000000 00:00 0
441fd000-44200000 ---p 00000000 00:00 0
44200000-4421e000 rwxp 00000000 00:00 0
4421e000-44221000 ---p 00000000 00:00 0
44221000-4423f000 rwxp 00000000 00:00 0
4423f000-44242000 ---p 00000000 00:00 0
44242000-44260000 rwxp 00000000 00:00 0
44260000-44263000 ---p 00000000 00:00 0
44263000-44281000 rwxp 00000000 00:00 0
44281000-44284000 ---p 00000000 00:00 0
44284000-442a2000 rwxp 00000000 00:00 0
442a2000-442a5000 ---p 00000000 00:00 0
442a5000-442c3000 rwxp 00000000 00:00 0
442c3000-442c6000 ---p 00000000 00:00 0
442c6000-442e4000 rwxp 00000000 00:00 0
442e4000-442e7000 ---p 00000000 00:00 0
442e7000-44305000 rwxp 00000000 00:00 0
44305000-44308000 ---p 00000000 00:00 0
44308000-44326000 rwxp 00000000 00:00 0
44326000-44329000 ---p 00000000 00:00 0
44329000-44347000 rwxp 00000000 00:00 0
44347000-4434a000 ---p 00000000 00:00 0
4434a000-44368000 rwxp 00000000 00:00 0
44368000-4436b000 ---p 00000000 00:00 0
4436b000-44389000 rwxp 00000000 00:00 0
44389000-4438c000 ---p 00000000 00:00 0
4438c000-443aa000 rwxp 00000000 00:00 0
443aa000-443ad000 ---p 00000000 00:00 0
443ad000-443cb000 rwxp 00000000 00:00 0
443cb000-443ce000 ---p 00000000 00:00 0
443ce000-443ec000 rwxp 00000000 00:00 0
443ec000-443ef000 ---p 00000000 00:00 0
443ef000-4440d000 rwxp 00000000 00:00 0
4444f000-44452000 ---p 00000000 00:00 0
44452000-44470000 rwxp 00000000 00:00 0
44470000-44473000 ---p 00000000 00:00 0
44473000-44491000 rwxp 00000000 00:00 0
444b2000-444b5000 ---p 00000000 00:00 0
444b5000-444d3000 rwxp 00000000 00:00 0
444d3000-444d6000 ---p 00000000 00:00 0
444d6000-444f4000 rwxp 00000000 00:00 0
444f4000-444f7000 ---p 00000000 00:00 0
444f7000-44515000 rwxp 00000000 00:00 0
44515000-44518000 ---p 00000000 00:00 0
44518000-44536000 rwxp 00000000 00:00 0
44536000-44539000 ---p 00000000 00:00 0
44539000-44557000 rwxp 00000000 00:00 0
44557000-4455a000 ---p 00000000 00:00 0
4455a000-44578000 rwxp 00000000 00:00 0
44578000-4457b000 ---p 00000000 00:00 0
4457b000-44599000 rwxp 00000000 00:00 0
44599000-4459c000 ---p 00000000 00:00 0
4459c000-445ba000 rwxp 00000000 00:00 0
445ba000-445bd000 ---p 00000000 00:00 0
445bd000-445db000 rwxp 00000000 00:00 0
445db000-445de000 ---p 00000000 00:00 0
445de000-445fc000 rwxp 00000000 00:00 0
445fc000-445ff000 ---p 00000000 00:00 0
445ff000-4461d000 rwxp 00000000 00:00 0
4461d000-44620000 ---p 00000000 00:00 0
44620000-4463e000 rwxp 00000000 00:00 0
4463e000-44641000 ---p 00000000 00:00 0
44641000-4465f000 rwxp 00000000 00:00 0
4465f000-44662000 ---p 00000000 00:00 0
44662000-44680000 rwxp 00000000 00:00 0
44680000-44683000 ---p 00000000 00:00 0
44683000-446a1000 rwxp 00000000 00:00 0
446a1000-446a4000 ---p 00000000 00:00 0
446a4000-446c2000 rwxp 00000000 00:00 0
446c2000-446c5000 ---p 00000000 00:00 0
446c5000-446e3000 rwxp 00000000 00:00 0
446e3000-446e6000 ---p 00000000 00:00 0
446e6000-44704000 rwxp 00000000 00:00 0
44704000-44707000 ---p 00000000 00:00 0
44707000-44725000 rwxp 00000000 00:00 0
44767000-4476a000 ---p 00000000 00:00 0
4476a000-44788000 rwxp 00000000 00:00 0
44788000-4478b000 ---p 00000000 00:00 0
4478b000-447a9000 rwxp 00000000 00:00 0
447a9000-447ac000 ---p 00000000 00:00 0
447ac000-447ca000 rwxp 00000000 00:00 0
447eb000-447ee000 ---p 00000000 00:00 0
447ee000-4480c000 rwxp 00000000 00:00 0
4480c000-4480f000 ---p 00000000 00:00 0
4480f000-4482d000 rwxp 00000000 00:00 0
4482d000-44830000 ---p 00000000 00:00 0
44830000-4484e000 rwxp 00000000 00:00 0
4486f000-44872000 ---p 00000000 00:00 0
44872000-44890000 rwxp 00000000 00:00 0
44890000-44893000 ---p 00000000 00:00 0
44893000-448b1000 rwxp 00000000 00:00 0
448b1000-448b4000 ---p 00000000 00:00 0
448b4000-448d2000 rwxp 00000000 00:00 0
448d2000-448d5000 ---p 00000000 00:00 0
448d5000-448f3000 rwxp 00000000 00:00 0
44935000-44938000 ---p 00000000 00:00 0
44938000-44956000 rwxp 00000000 00:00 0
44956000-44959000 ---p 00000000 00:00 0
44959000-44977000 rwxp 00000000 00:00 0
44977000-4497a000 ---p 00000000 00:00 0
4497a000-44998000 rwxp 00000000 00:00 0
449da000-449dd000 ---p 00000000 00:00 0
449dd000-449fb000 rwxp 00000000 00:00 0
44a1c000-44a1f000 ---p 00000000 00:00 0
44a1f000-44a3d000 rwxp 00000000 00:00 0
44a3d000-44a40000 ---p 00000000 00:00 0
44a40000-44a5e000 rwxp 00000000 00:00 0
44a5e000-44a61000 ---p 00000000 00:00 0
44a61000-44a7f000 rwxp 00000000 00:00 0
44a7f000-44a82000 ---p 00000000 00:00 0
44a82000-44aa0000 rwxp 00000000 00:00 0
44aa0000-44aa3000 ---p 00000000 00:00 0
44aa3000-44ac1000 rwxp 00000000 00:00 0
44ae2000-44ae5000 ---p 00000000 00:00 0
44ae5000-44b03000 rwxp 00000000 00:00 0
44bea000-44bed000 ---p 00000000 00:00 0
44bed000-44c0b000 rwxp 00000000 00:00 0
44c0b000-44c0e000 ---p 00000000 00:00 0
44c0e000-44c2c000 rwxp 00000000 00:00 0
44c6e000-44c71000 ---p 00000000 00:00 0
44c71000-44c8f000 rwxp 00000000 00:00 0
44cb0000-44cb3000 ---p 00000000 00:00 0
44cb3000-44cd1000 rwxp 00000000 00:00 0
44cf2000-44cf5000 ---p 00000000 00:00 0
44cf5000-44d13000 rwxp 00000000 00:00 0
44d13000-44d16000 ---p 00000000 00:00 0
44d16000-44d34000 rwxp 00000000 00:00 0
44d55000-44d58000 ---p 00000000 00:00 0
44d58000-44d76000 rwxp 00000000 00:00 0
44d97000-44d9a000 ---p 00000000 00:00 0
44d9a000-44db8000 rwxp 00000000 00:00 0
44db8000-44dbb000 ---p 00000000 00:00 0
44dbb000-44dd9000 rwxp 00000000 00:00 0
44dfa000-44dfd000 ---p 00000000 00:00 0
44dfd000-44e1b000 rwxp 00000000 00:00 0
44e1b000-44e1e000 ---p 00000000 00:00 0
44e1e000-44e3c000 rwxp 00000000 00:00 0
44e3c000-44e3f000 ---p 00000000 00:00 0
44e3f000-44e5d000 rwxp 00000000 00:00 0
44e7e000-44e81000 ---p 00000000 00:00 0
44e81000-44e9f000 rwxp 00000000 00:00 0
44ec0000-44ec3000 ---p 00000000 00:00 0
44ec3000-44ee1000 rwxp 00000000 00:00 0
44ee1000-44ee4000 ---p 00000000 00:00 0
44ee4000-44f02000 rwxp 00000000 00:00 0
44f02000-44f05000 ---p 00000000 00:00 0
44f05000-44f23000 rwxp 00000000 00:00 0
44f44000-44f47000 ---p 00000000 00:00 0
44f47000-44f65000 rwxp 00000000 00:00 0
44f86000-44f89000 ---p 00000000 00:00 0
44f89000-44fa7000 rwxp 00000000 00:00 0
44fa7000-44faa000 ---p 00000000 00:00 0
44faa000-44fc8000 rwxp 00000000 00:00 0
44fc8000-44fcb000 ---p 00000000 00:00 0
44fcb000-44fe9000 rwxp 00000000 00:00 0
4502b000-4502e000 ---p 00000000 00:00 0
4502e000-4504c000 rwxp 00000000 00:00 0
4504c000-4504f000 ---p 00000000 00:00 0
4504f000-4506d000 rwxp 00000000 00:00 0
450af000-450b2000 ---p 00000000 00:00 0
450b2000-450d0000 rwxp 00000000 00:00 0
45112000-45115000 ---p 00000000 00:00 0
45115000-45133000 rwxp 00000000 00:00 0
45154000-45157000 ---p 00000000 00:00 0
45157000-45175000 rwxp 00000000 00:00 0
45196000-45199000 ---p 00000000 00:00 0
45199000-451b7000 rwxp 00000000 00:00 0
451b7000-451ba000 ---p 00000000 00:00 0
451ba000-451d8000 rwxp 00000000 00:00 0
451d8000-451db000 ---p 00000000 00:00 0
451db000-451f9000 rwxp 00000000 00:00 0
4521a000-4521d000 ---p 00000000 00:00 0
4521d000-4523b000 rwxp 00000000 00:00 0
4523b000-4523e000 ---p 00000000 00:00 0
4523e000-4525c000 rwxp 00000000 00:00 0
4525c000-4525f000 ---p 00000000 00:00 0
4525f000-4527d000 rwxp 00000000 00:00 0
4527d000-45280000 ---p 00000000 00:00 0
45280000-4529e000 rwxp 00000000 00:00 0
4529e000-452a1000 ---p 00000000 00:00 0
452a1000-452bf000 rwxp 00000000 00:00 0
45301000-45304000 ---p 00000000 00:00 0
45304000-45322000 rwxp 00000000 00:00 0
453a6000-453a9000 ---p 00000000 00:00 0
453a9000-453c7000 rwxp 00000000 00:00 0
453c7000-453ca000 ---p 00000000 00:00 0
453ca000-453e8000 rwxp 00000000 00:00 0
45409000-4540c000 ---p 00000000 00:00 0
4540c000-4542a000 rwxp 00000000 00:00 0
4544b000-4544e000 ---p 00000000 00:00 0
4544e000-4546c000 rwxp 00000000 00:00 0
4546c000-4546f000 ---p 00000000 00:00 0
4546f000-4548d000 rwxp 00000000 00:00 0
454ae000-454b1000 ---p 00000000 00:00 0
454b1000-454cf000 rwxp 00000000 00:00 0
45511000-45514000 ---p 00000000 00:00 0
45514000-45532000 rwxp 00000000 00:00 0
45553000-45556000 ---p 00000000 00:00 0
45556000-45574000 rwxp 00000000 00:00 0
455d7000-455da000 ---p 00000000 00:00 0
455da000-455f8000 rwxp 00000000 00:00 0
456be000-456c1000 ---p 00000000 00:00 0
456c1000-456df000 rwxp 00000000 00:00 0
45742000-45745000 ---p 00000000 00:00 0
45745000-45763000 rwxp 00000000 00:00 0
45763000-45766000 ---p 00000000 00:00 0
45766000-45784000 rwxp 00000000 00:00 0
457c6000-457c9000 ---p 00000000 00:00 0
457c9000-457e7000 rwxp 00000000 00:00 0
4588c000-4588f000 ---p 00000000 00:00 0
4588f000-458ad000 rwxp 00000000 00:00 0
458ad000-458b0000 ---p 00000000 00:00 0
458b0000-458ce000 rwxp 00000000 00:00 0
458ce000-458d1000 ---p 00000000 00:00 0
458d1000-458ef000 rwxp 00000000 00:00 0
458ef000-458f2000 ---p 00000000 00:00 0
458f2000-45910000 rwxp 00000000 00:00 0
45910000-45913000 ---p 00000000 00:00 0
45913000-45931000 rwxp 00000000 00:00 0
45931000-45934000 ---p 00000000 00:00 0
45934000-45952000 rwxp 00000000 00:00 0
459d6000-459d9000 ---p 00000000 00:00 0
459d9000-459f7000 rwxp 00000000 00:00 0
45b83000-45b86000 ---p 00000000 00:00 0
45b86000-45ba4000 rwxp 00000000 00:00 0
45c49000-45c4c000 ---p 00000000 00:00 0
45c4c000-45c6a000 rwxp 00000000 00:00 0
45c8b000-45c8e000 ---p 00000000 00:00 0
45c8e000-45cac000 rwxp 00000000 00:00 0
45cac000-45caf000 ---p 00000000 00:00 0
45caf000-45ccd000 rwxp 00000000 00:00 0
45ccd000-45cd0000 ---p 00000000 00:00 0
45cd0000-45cee000 rwxp 00000000 00:00 0
45cee000-45cf1000 ---p 00000000 00:00 0
45cf1000-45d0f000 rwxp 00000000 00:00 0
45d72000-45d75000 ---p 00000000 00:00 0
45d75000-45d93000 rwxp 00000000 00:00 0
45e59000-45e5c000 ---p 00000000 00:00 0
45e5c000-45e7a000 rwxp 00000000 00:00 0
45e9b000-45e9e000 ---p 00000000 00:00 0
45e9e000-45ebc000 rwxp 00000000 00:00 0
45f61000-45f64000 ---p 00000000 00:00 0
45f64000-45f82000 rwxp 00000000 00:00 0
46027000-4602a000 ---p 00000000 00:00 0
4602a000-46048000 rwxp 00000000 00:00 0
4608a000-4608d000 ---p 00000000 00:00 0
4608d000-460ab000 rwxp 00000000 00:00 0
460ab000-460ae000 ---p 00000000 00:00 0
460ae000-460cc000 rwxp 00000000 00:00 0
460cc000-460cf000 ---p 00000000 00:00 0
460cf000-460ed000 rwxp 00000000 00:00 0
460ed000-460f0000 ---p 00000000 00:00 0
460f0000-4610e000 rwxp 00000000 00:00 0
4610e000-46111000 ---p 00000000 00:00 0
46111000-4612f000 rwxp 00000000 00:00 0
46171000-46174000 ---p 00000000 00:00 0
46174000-46192000 rwxp 00000000 00:00 0
461b3000-461b6000 ---p 00000000 00:00 0
461b6000-461d4000 rwxp 00000000 00:00 0
46216000-46219000 ---p 00000000 00:00 0
46219000-46237000 rwxp 00000000 00:00 0
46279000-4627c000 ---p 00000000 00:00 0
4627c000-4629a000 rwxp 00000000 00:00 0
4629a000-4629d000 ---p 00000000 00:00 0
4629d000-462bb000 rwxp 00000000 00:00 0
462dc000-462df000 ---p 00000000 00:00 0
462df000-462fd000 rwxp 00000000 00:00 0
46468000-4646b000 ---p 00000000 00:00 0
4646b000-46489000 rwxp 00000000 00:00 0
46489000-4648c000 ---p 00000000 00:00 0
4648c000-464aa000 rwxp 00000000 00:00 0
46591000-46594000 ---p 00000000 00:00 0
46594000-465b2000 rwxp 00000000 00:00 0
465b2000-465b5000 ---p 00000000 00:00 0
465b5000-465d3000 rwxp 00000000 00:00 0
46780000-46783000 ---p 00000000 00:00 0
46783000-467a1000 rwxp 00000000 00:00 0
467e3000-467e6000 ---p 00000000 00:00 0
467e6000-46804000 rwxp 00000000 00:00 0
46804000-46807000 ---p 00000000 00:00 0
46807000-46825000 rwxp 00000000 00:00 0
46888000-4688b000 ---p 00000000 00:00 0
4688b000-468a9000 rwxp 00000000 00:00 0
46a77000-46a7a000 ---p 00000000 00:00 0
46a7a000-46a98000 rwxp 00000000 00:00 0
46a98000-46a9b000 ---p 00000000 00:00 0
46a9b000-46ab9000 rwxp 00000000 00:00 0
46ab9000-46abc000 ---p 00000000 00:00 0
46abc000-46ada000 rwxp 00000000 00:00 0
46b3d000-46b40000 ---p 00000000 00:00 0
46b40000-46b5e000 rwxp 00000000 00:00 0
46ba0000-46ba3000 ---p 00000000 00:00 0
46ba3000-46bc1000 rwxp 00000000 00:00 0
46c45000-46c48000 ---p 00000000 00:00 0
46c48000-46c66000 rwxp 00000000 00:00 0
46c66000-46c69000 ---p 00000000 00:00 0
46c69000-46c87000 rwxp 00000000 00:00 0
46d4d000-46d50000 ---p 00000000 00:00 0
46d50000-46d6e000 rwxp 00000000 00:00 0
46d6e000-46d71000 ---p 00000000 00:00 0
46d71000-46d8f000 rwxp 00000000 00:00 0
46e13000-46e16000 ---p 00000000 00:00 0
46e16000-46e34000 rwxp 00000000 00:00 0
46e34000-46e37000 ---p 00000000 00:00 0
46e37000-46e55000 rwxp 00000000 00:00 0
46eb8000-46ebb000 ---p 00000000 00:00 0
46ebb000-46ed9000 rwxp 00000000 00:00 0
46ed9000-46edc000 ---p 00000000 00:00 0
46edc000-46efa000 rwxp 00000000 00:00 0
46fe1000-46fe4000 ---p 00000000 00:00 0
46fe4000-47002000 rwxp 00000000 00:00 0
47086000-47089000 ---p 00000000 00:00 0
47089000-470a7000 rwxp 00000000 00:00 0
471af000-471b2000 ---p 00000000 00:00 0
471b2000-471d0000 rwxp 00000000 00:00 0
471d0000-471d3000 ---p 00000000 00:00 0
471d3000-471f1000 rwxp 00000000 00:00 0
47212000-47215000 ---p 00000000 00:00 0
47215000-47233000 rwxp 00000000 00:00 0
47254000-47257000 ---p 00000000 00:00 0
47257000-47275000 rwxp 00000000 00:00 0
4731a000-4731d000 ---p 00000000 00:00 0
4731d000-4733b000 rwxp 00000000 00:00 0
4735c000-4735f000 ---p 00000000 00:00 0
4735f000-4737d000 rwxp 00000000 00:00 0
4737d000-47380000 ---p 00000000 00:00 0
47380000-4739e000 rwxp 00000000 00:00 0
4739e000-473a1000 ---p 00000000 00:00 0
473a1000-473bf000 rwxp 00000000 00:00 0
47464000-47467000 ---p 00000000 00:00 0
47467000-47485000 rwxp 00000000 00:00 0
47485000-47488000 ---p 00000000 00:00 0
47488000-474a6000 rwxp 00000000 00:00 0
474a6000-474a9000 ---p 00000000 00:00 0
474a9000-474c7000 rwxp 00000000 00:00 0
474e8000-474eb000 ---p 00000000 00:00 0
474eb000-47509000 rwxp 00000000 00:00 0
4752a000-4752d000 ---p 00000000 00:00 0
4752d000-4754b000 rwxp 00000000 00:00 0
475ae000-475b1000 ---p 00000000 00:00 0
475b1000-475cf000 rwxp 00000000 00:00 0
475f0000-475f3000 ---p 00000000 00:00 0
475f3000-47611000 rwxp 00000000 00:00 0
47632000-47635000 ---p 00000000 00:00 0
47635000-47653000 rwxp 00000000 00:00 0
47719000-4771c000 ---p 00000000 00:00 0
4771c000-4773a000 rwxp 00000000 00:00 0
47821000-47824000 ---p 00000000 00:00 0
47824000-47842000 rwxp 00000000 00:00 0
47842000-47845000 ---p 00000000 00:00 0
47845000-47863000 rwxp 00000000 00:00 0
478c6000-478c9000 ---p 00000000 00:00 0
478c9000-478e7000 rwxp 00000000 00:00 0
47908000-4790b000 ---p 00000000 00:00 0
4790b000-47929000 rwxp 00000000 00:00 0
47929000-4792c000 ---p 00000000 00:00 0
4792c000-4794a000 rwxp 00000000 00:00 0
4794a000-4794d000 ---p 00000000 00:00 0
4794d000-4796b000 rwxp 00000000 00:00 0
4796b000-4796e000 ---p 00000000 00:00 0
4796e000-4798c000 rwxp 00000000 00:00 0
479ad000-479b0000 ---p 00000000 00:00 0
479b0000-479ce000 rwxp 00000000 00:00 0
47a10000-47a13000 ---p 00000000 00:00 0
47a13000-47a31000 rwxp 00000000 00:00 0
47a94000-47a97000 ---p 00000000 00:00 0
47a97000-47ab5000 rwxp 00000000 00:00 0
47ad6000-47ad9000 ---p 00000000 00:00 0
47ad9000-47af7000 rwxp 00000000 00:00 0
47b7b000-47b7e000 ---p 00000000 00:00 0
47b7e000-47b9c000 rwxp 00000000 00:00 0
47b9c000-47b9f000 ---p 00000000 00:00 0
47b9f000-47bbd000 rwxp 00000000 00:00 0
47bbd000-47bc0000 ---p 00000000 00:00 0
47bc0000-47bde000 rwxp 00000000 00:00 0
47c62000-47c65000 ---p 00000000 00:00 0
47c65000-47c83000 rwxp 00000000 00:00 0
47d8b000-47d8e000 ---p 00000000 00:00 0
47d8e000-47dac000 rwxp 00000000 00:00 0
47eb4000-47eb7000 ---p 00000000 00:00 0
47eb7000-47ed5000 rwxp 00000000 00:00 0
47ef6000-47ef9000 ---p 00000000 00:00 0
47ef9000-47f17000 rwxp 00000000 00:00 0
47f17000-47f1a000 ---p 00000000 00:00 0
47f1a000-47f38000 rwxp 00000000 00:00 0
480c4000-480c7000 ---p 00000000 00:00 0
480c7000-480e5000 rwxp 00000000 00:00 0
48127000-4812a000 ---p 00000000 00:00 0
4812a000-48148000 rwxp 00000000 00:00 0
48292000-48295000 ---p 00000000 00:00 0
48295000-482b3000 rwxp 00000000 00:00 0
48358000-4835b000 ---p 00000000 00:00 0
4835b000-48379000 rwxp 00000000 00:00 0
48460000-48463000 ---p 00000000 00:00 0
48463000-48481000 rwxp 00000000 00:00 0
484e4000-484e7000 ---p 00000000 00:00 0
484e7000-48505000 rwxp 00000000 00:00 0
48568000-4856b000 ---p 00000000 00:00 0
4856b000-48589000 rwxp 00000000 00:00 0
485cb000-485ce000 ---p 00000000 00:00 0
485ce000-485ec000 rwxp 00000000 00:00 0
485ec000-485ef000 ---p 00000000 00:00 0
485ef000-4860d000 rwxp 00000000 00:00 0
4862e000-48631000 ---p 00000000 00:00 0
48631000-4864f000 rwxp 00000000 00:00 0
4864f000-48652000 ---p 00000000 00:00 0
48652000-48670000 rwxp 00000000 00:00 0
486d3000-486d6000 ---p 00000000 00:00 0
486d6000-486f4000 rwxp 00000000 00:00 0
487ba000-487bd000 ---p 00000000 00:00 0
487bd000-487db000 rwxp 00000000 00:00 0
487db000-487de000 ---p 00000000 00:00 0
487de000-487fc000 rwxp 00000000 00:00 0
4881d000-48820000 ---p 00000000 00:00 0
48820000-4883e000 rwxp 00000000 00:00 0
4883e000-48841000 ---p 00000000 00:00 0
48841000-4885f000 rwxp 00000000 00:00 0
4885f000-48862000 ---p 00000000 00:00 0
48862000-48880000 rwxp 00000000 00:00 0
488e3000-488e6000 ---p 00000000 00:00 0
488e6000-48904000 rwxp 00000000 00:00 0
48904000-48907000 ---p 00000000 00:00 0
48907000-48925000 rwxp 00000000 00:00 0
489eb000-489ee000 ---p 00000000 00:00 0
489ee000-48a0c000 rwxp 00000000 00:00 0
48a0c000-48a0f000 ---p 00000000 00:00 0
48a0f000-48a2d000 rwxp 00000000 00:00 0
48c1c000-48c1f000 ---p 00000000 00:00 0
48c1f000-48c3d000 rwxp 00000000 00:00 0
48da8000-48dab000 ---p 00000000 00:00 0
48dab000-48dc9000 rwxp 00000000 00:00 0
48dc9000-48dcc000 ---p 00000000 00:00 0
48dcc000-48dea000 rwxp 00000000 00:00 0
48ed1000-48ed4000 ---p 00000000 00:00 0
48ed4000-48ef2000 rwxp 00000000 00:00 0
48f13000-48f16000 ---p 00000000 00:00 0
48f16000-48f34000 rwxp 00000000 00:00 0
48fd9000-48fdc000 ---p 00000000 00:00 0
48fdc000-48ffa000 rwxp 00000000 00:00 0
48ffa000-48ffd000 ---p 00000000 00:00 0
48ffd000-4901b000 rwxp 00000000 00:00 0
4901b000-4901e000 ---p 00000000 00:00 0
4901e000-4903c000 rwxp 00000000 00:00 0
4907e000-49081000 ---p 00000000 00:00 0
49081000-4909f000 rwxp 00000000 00:00 0
4909f000-490a2000 ---p 00000000 00:00 0
490a2000-490c0000 rwxp 00000000 00:00 0
49123000-49126000 ---p 00000000 00:00 0
49126000-49144000 rwxp 00000000 00:00 0
49186000-49189000 ---p 00000000 00:00 0
49189000-491a7000 rwxp 00000000 00:00 0
4920a000-4920d000 ---p 00000000 00:00 0
4920d000-4922b000 rwxp 00000000 00:00 0
49312000-49315000 ---p 00000000 00:00 0
49315000-49333000 rwxp 00000000 00:00 0
49333000-49336000 ---p 00000000 00:00 0
49336000-49354000 rwxp 00000000 00:00 0
49396000-49399000 ---p 00000000 00:00 0
49399000-493b7000 rwxp 00000000 00:00 0
493d8000-493db000 ---p 00000000 00:00 0
493db000-493f9000 rwxp 00000000 00:00 0
493f9000-493fc000 ---p 00000000 00:00 0
493fc000-4941a000 rwxp 00000000 00:00 0
4945c000-4945f000 ---p 00000000 00:00 0
4945f000-4947d000 rwxp 00000000 00:00 0
4947d000-49480000 ---p 00000000 00:00 0
49480000-4949e000 rwxp 00000000 00:00 0
4949e000-494a1000 ---p 00000000 00:00 0
494a1000-494bf000 rwxp 00000000 00:00 0
494e0000-494e3000 ---p 00000000 00:00 0
494e3000-49501000 rwxp 00000000 00:00 0
495e8000-495eb000 ---p 00000000 00:00 0
495eb000-49609000 rwxp 00000000 00:00 0
4964b000-4964e000 ---p 00000000 00:00 0
4964e000-4966c000 rwxp 00000000 00:00 0
4968d000-49690000 ---p 00000000 00:00 0
49690000-496ae000 rwxp 00000000 00:00 0
496f0000-496f3000 ---p 00000000 00:00 0
496f3000-49711000 rwxp 00000000 00:00 0
497f8000-497fb000 ---p 00000000 00:00 0
497fb000-49819000 rwxp 00000000 00:00 0
4987c000-4987f000 ---p 00000000 00:00 0
4987f000-4989d000 rwxp 00000000 00:00 0
49942000-49945000 ---p 00000000 00:00 0
49945000-49963000 rwxp 00000000 00:00 0
49963000-49966000 ---p 00000000 00:00 0
49966000-49984000 rwxp 00000000 00:00 0
499e7000-499ea000 ---p 00000000 00:00 0
499ea000-49a08000 rwxp 00000000 00:00 0
49a4a000-49a4d000 ---p 00000000 00:00 0
49a4d000-49a6b000 rwxp 00000000 00:00 0
49a6b000-49a6e000 ---p 00000000 00:00 0
49a6e000-49a8c000 rwxp 00000000 00:00 0
49aef000-49af2000 ---p 00000000 00:00 0
49af2000-49b10000 rwxp 00000000 00:00 0
49b73000-49b76000 ---p 00000000 00:00 0
49b76000-49b94000 rwxp 00000000 00:00 0
49b94000-49b97000 ---p 00000000 00:00 0
49b97000-49bb5000 rwxp 00000000 00:00 0
49bd6000-49bd9000 ---p 00000000 00:00 0
49bd9000-49bf7000 rwxp 00000000 00:00 0
49c18000-49c1b000 ---p 00000000 00:00 0
49c1b000-49c39000 rwxp 00000000 00:00 0
49c5a000-49c5d000 ---p 00000000 00:00 0
49c5d000-49c7b000 rwxp 00000000 00:00 0
49cde000-49ce1000 ---p 00000000 00:00 0
49ce1000-49cff000 rwxp 00000000 00:00 0
49cff000-49d02000 ---p 00000000 00:00 0
49d02000-49d20000 rwxp 00000000 00:00 0
49e28000-49e2b000 ---p 00000000 00:00 0
49e2b000-49e49000 rwxp 00000000 00:00 0
49e6a000-49e6d000 ---p 00000000 00:00 0
49e6d000-49e8b000 rwxp 00000000 00:00 0
49eac000-49eaf000 ---p 00000000 00:00 0
49eaf000-49ecd000 rwxp 00000000 00:00 0
4a0dd000-4a0e0000 ---p 00000000 00:00 0
4a0e0000-4a0fe000 rwxp 00000000 00:00 0
4a30e000-4a311000 ---p 00000000 00:00 0
4a311000-4a32f000 rwxp 00000000 00:00 0
4a560000-4a563000 ---p 00000000 00:00 0
4a563000-4a581000 rwxp 00000000 00:00 0
4a581000-4a584000 ---p 00000000 00:00 0
4a584000-4a5a2000 rwxp 00000000 00:00 0
4a5a2000-4a5a5000 ---p 00000000 00:00 0
4a5a5000-4a5c3000 rwxp 00000000 00:00 0
4a5c3000-4a5c6000 ---p 00000000 00:00 0
4a5c6000-4a5e4000 rwxp 00000000 00:00 0
4a72e000-4a731000 ---p 00000000 00:00 0
4a731000-4a74f000 rwxp 00000000 00:00 0
4a770000-4a773000 ---p 00000000 00:00 0
4a773000-4a791000 rwxp 00000000 00:00 0
4a857000-4a85a000 ---p 00000000 00:00 0
4a85a000-4a878000 rwxp 00000000 00:00 0
4a8fc000-4a8ff000 ---p 00000000 00:00 0
4a8ff000-4a91d000 rwxp 00000000 00:00 0
4a93e000-4a941000 ---p 00000000 00:00 0
4a941000-4a95f000 rwxp 00000000 00:00 0
4aa04000-4aa07000 ---p 00000000 00:00 0
4aa07000-4aa25000 rwxp 00000000 00:00 0
4aa46000-4aa49000 ---p 00000000 00:00 0
4aa49000-4aa67000 rwxp 00000000 00:00 0
4ab2d000-4ab30000 ---p 00000000 00:00 0
4ab30000-4ab4e000 rwxp 00000000 00:00 0
4ab4e000-4ab51000 ---p 00000000 00:00 0
4ab51000-4ab6f000 rwxp 00000000 00:00 0
4abf3000-4abf6000 ---p 00000000 00:00 0
4abf6000-4ac14000 rwxp 00000000 00:00 0
4ac35000-4ac38000 ---p 00000000 00:00 0
4ac38000-4ac56000 rwxp 00000000 00:00 0
4ac98000-4ac9b000 ---p 00000000 00:00 0
4ac9b000-4acb9000 rwxp 00000000 00:00 0
4acb9000-4acbc000 ---p 00000000 00:00 0
4acbc000-4acda000 rwxp 00000000 00:00 0
4acda000-4acdd000 ---p 00000000 00:00 0
4acdd000-4acfb000 rwxp 00000000 00:00 0
4ad1c000-4ad1f000 ---p 00000000 00:00 0
4ad1f000-4ad3d000 rwxp 00000000 00:00 0
4ad3d000-4ad40000 ---p 00000000 00:00 0
4ad40000-4ad5e000 rwxp 00000000 00:00 0
4ad5e000-4ad61000 ---p 00000000 00:00 0
4ad61000-4ad7f000 rwxp 00000000 00:00 0
4ae45000-4ae48000 ---p 00000000 00:00 0
4ae48000-4ae66000 rwxp 00000000 00:00 0
4ae87000-4ae8a000 ---p 00000000 00:00 0
4ae8a000-4aea8000 rwxp 00000000 00:00 0
4af4d000-4af50000 ---p 00000000 00:00 0
4af50000-4af6e000 rwxp 00000000 00:00 0
4af8f000-4af92000 ---p 00000000 00:00 0
4af92000-4afb0000 rwxp 00000000 00:00 0
4aff2000-4aff5000 ---p 00000000 00:00 0
4aff5000-4b013000 rwxp 00000000 00:00 0
4b11b000-4b11e000 ---p 00000000 00:00 0
4b11e000-4b13c000 rwxp 00000000 00:00 0
4b202000-4b205000 ---p 00000000 00:00 0
4b205000-4b223000 rwxp 00000000 00:00 0
4b2a7000-4b2aa000 ---p 00000000 00:00 0
4b2aa000-4b2c8000 rwxp 00000000 00:00 0
4b32b000-4b32e000 ---p 00000000 00:00 0
4b32e000-4b34c000 rwxp 00000000 00:00 0
4b34c000-4b34f000 ---p 00000000 00:00 0
4b34f000-4b36d000 rwxp 00000000 00:00 0
4bbef000-4bbf2000 ---p 00000000 00:00 0
4bbf2000-4bc10000 rwxp 00000000 00:00 0
4bc52000-4bc55000 ---p 00000000 00:00 0
4bc55000-4bc73000 rwxp 00000000 00:00 0
4bcd6000-4bcd9000 ---p 00000000 00:00 0
4bcd9000-4bcf7000 rwxp 00000000 00:00 0
4c17a000-4c17d000 ---p 00000000 00:00 0
4c17d000-4c19b000 rwxp 00000000 00:00 0
4c4d4000-4c4d7000 ---p 00000000 00:00 0
4c4d7000-4c4f5000 rwxp 00000000 00:00 0
4c537000-4c53a000 ---p 00000000 00:00 0
4c53a000-4c558000 rwxp 00000000 00:00 0
4c558000-4c55b000 ---p 00000000 00:00 0
4c55b000-4c579000 rwxp 00000000 00:00 0
4c59a000-4c59d000 ---p 00000000 00:00 0
4c59d000-4c5bb000 rwxp 00000000 00:00 0
4c5bb000-4c5be000 ---p 00000000 00:00 0
4c5be000-4c5dc000 rwxp 00000000 00:00 0
4c5fd000-4c600000 ---p 00000000 00:00 0
4c600000-4c61e000 rwxp 00000000 00:00 0
4c660000-4c663000 ---p 00000000 00:00 0
4c663000-4c681000 rwxp 00000000 00:00 0
4c726000-4c729000 ---p 00000000 00:00 0
4c729000-4c747000 rwxp 00000000 00:00 0
4c747000-4c74a000 ---p 00000000 00:00 0
4c74a000-4c768000 rwxp 00000000 00:00 0
4c768000-4c76b000 ---p 00000000 00:00 0
4c76b000-4c789000 rwxp 00000000 00:00 0
4c789000-4c78c000 ---p 00000000 00:00 0
4c78c000-4c7aa000 rwxp 00000000 00:00 0
4c7cb000-4c7ce000 ---p 00000000 00:00 0
4c7ce000-4c7ec000 rwxp 00000000 00:00 0
4c80d000-4c810000 ---p 00000000 00:00 0
4c810000-4c82e000 rwxp 00000000 00:00 0
4c84f000-4c852000 ---p 00000000 00:00 0
4c852000-4c870000 rwxp 00000000 00:00 0
4c8b2000-4c8b5000 ---p 00000000 00:00 0
4c8b5000-4c8d3000 rwxp 00000000 00:00 0
2aaaaac00000-2aaf32c00000 rwxs 00000000 00:0a
0 /SYSV00000000 (deleted)
7fd468000000-7fd469dc2000 rwxp 00000000 00:00 0
7fd469dc2000-7fd46c000000 ---p 00000000 00:00 0
7fd46c10e000-7fd46c15a000 r-xp 00000000 08:01
6561968 /opt/jdk1.6.0_18/jre/lib/amd64/libcmm.so
7fd46c15a000-7fd46c25a000 ---p 0004c000 08:01
6561968 /opt/jdk1.6.0_18/jre/lib/amd64/libcmm.so
7fd46c25a000-7fd46c268000 rwxp 0004c000 08:01
6561968 /opt/jdk1.6.0_18/jre/lib/amd64/libcmm.so
7fd46c268000-7fd470000000 rwxp 00000000 00:00 0
7fd470000000-7fd471b01000 rwxp 00000000 00:00 0
7fd471b01000-7fd474000000 ---p 00000000 00:00 0
7fd474000000-7fd476d03000 rwxp 00000000 00:00 0
7fd476d03000-7fd478000000 ---p 00000000 00:00 0
7fd4780e8000-7fd47bd5f000 rwxp 00000000 00:00 0
7fd47be00000-7fd47c000000 rwxp 00000000 00:00 0
7fd47c000000-7fd47f238000 rwxp 00000000 00:00 0
7fd47f238000-7fd480000000 ---p 00000000 00:00 0
7fd480000000-7fd483323000 rwxp 00000000 00:00 0
7fd483323000-7fd484000000 ---p 00000000 00:00 0
7fd484000000-7fd485b14000 rwxp 00000000 00:00 0
7fd485b14000-7fd488000000 ---p 00000000 00:00 0
7fd48804d000-7fd4890b4000 rwxp 00000000 00:00 0
7fd489150000-7fd489650000 rwxp 00000000 00:00 0
7fd4896c1000-7fd4896d0000 r-xs 00676000 08:01
6554488 /opt/jdk1.6.0_18/jre/lib/charsets.jar
7fd4896d0000-7fd48abd0000 rwxp 00000000 00:00 0
7fd48abd0000-7fd48abfc000 r-xp 00000000 08:01
6561951 /opt/jdk1.6.0_18/jre/lib/amd64/libjpeg.so
7fd48abfc000-7fd48acfc000 ---p 0002c000 08:01
6561951 /opt/jdk1.6.0_18/jre/lib/amd64/libjpeg.so
7fd48acfc000-7fd48ad02000 rwxp 0002c000 08:01
6561951 /opt/jdk1.6.0_18/jre/lib/amd64/libjpeg.so
7fd48ad02000-7fd48ae07000 rwxp 00000000 00:00 0
7fd48ae07000-7fd48ae0c000 r-xp 00000000 08:01
6569986 /opt/jdk1.6.0_18/jre/lib/amd64/headless/libmawt.so
7fd48ae0c000-7fd48af0b000 ---p 00005000 08:01
6569986 /opt/jdk1.6.0_18/jre/lib/amd64/headless/libmawt.so
7fd48af0b000-7fd48af0d000 rwxp 00004000 08:01
6569986 /opt/jdk1.6.0_18/jre/lib/amd64/headless/libmawt.so
7fd48af0d000-7fd48af9f000 r-xp 00000000 08:01
6561961 /opt/jdk1.6.0_18/jre/lib/amd64/libawt.so
7fd48af9f000-7fd48b09e000 ---p 00092000 08:01
6561961 /opt/jdk1.6.0_18/jre/lib/amd64/libawt.so
7fd48b09e000-7fd48b0b7000 rwxp 00091000 08:01
6561961 /opt/jdk1.6.0_18/jre/lib/amd64/libawt.so
7fd48b0b7000-7fd48bdec000 rwxp 00000000 00:00 0
7fd48bdec000-7fd48bdfc000 r-xp 00000000 08:01
11846841 /lib/libresolv-2.7.so
7fd48bdfc000-7fd48bffc000 ---p 00010000 08:01
11846841 /lib/libresolv-2.7.so
7fd48bffc000-7fd48bffe000 rwxp 00010000 08:01
11846841 /lib/libresolv-2.7.so
7fd48bffe000-7fd48c000000 rwxp 00000000 00:00 0
7fd48c000000-7fd48f5f6000 rwxp 00000000 00:00 0
7fd48f5f6000-7fd490000000 ---p 00000000 00:00 0
7fd490004000-7fd49000b000 r-xp 00000000 08:01
6561972 /opt/jdk1.6.0_18/jre/lib/amd64/libnio.so
7fd49000b000-7fd49010a000 ---p 00007000 08:01
6561972 /opt/jdk1.6.0_18/jre/lib/amd64/libnio.so
7fd49010a000-7fd49010c000 rwxp 00006000 08:01
6561972 /opt/jdk1.6.0_18/jre/lib/amd64/libnio.so
7fd49010c000-7fd490113000 r-xs 00111000 08:01
6554497 /opt/jdk1.6.0_18/jre/lib/resources.jar
7fd490113000-7fd490117000 r-xp 00000000 08:01
11846842 /lib/libnss_dns-2.7.so
7fd490117000-7fd490316000 ---p 00004000 08:01
11846842 /lib/libnss_dns-2.7.so
7fd490316000-7fd490318000 rwxp 00003000 08:01
11846842 /lib/libnss_dns-2.7.so
7fd49031c000-7fd49091d000 rwxp 00000000 00:00 0
7fd49091d000-7fd490930000 r-xp 00000000 08:01
6561960 /opt/jdk1.6.0_18/jre/lib/amd64/libnet.so
7fd490930000-7fd490a31000 ---p 00013000 08:01
6561960 /opt/jdk1.6.0_18/jre/lib/amd64/libnet.so
7fd490a31000-7fd490a34000 rwxp 00014000 08:01
6561960 /opt/jdk1.6.0_18/jre/lib/amd64/libnet.so
7fd490a34000-7fd490bac000 rwxp 00000000 00:00 0
7fd490bac000-7fd490baf000 r-xs 00027000 08:01
6570054 /opt/jdk1.6.0_18/jre/lib/ext/sunjce_provider.jar
7fd490baf000-7fd490bb6000 r-xs 00091000 08:01
6554494 /opt/jdk1.6.0_18/jre/lib/jsse.jar
7fd490c5a000-7fd490c5d000 r-xs 00013000 08:01
6554512 /opt/jdk1.6.0_18/jre/lib/jce.jar
7fd490c81000-7fd490c88000 r-xs 000a5000 08:01
3867323 /home/www/start.e-messenger.net/html/WEB-INF/lib/mysql-connector-java-5.1.6.jar
7fd490d30000-7fd490e30000 rwxp 00000000 00:00 0
7fd490e30000-7fd490e46000 r-xp 00000000 08:01
3377290 /usr/lib/libz.so.1.2.3.3
7fd490e46000-7fd491046000 ---p 00016000 08:01
3377290 /usr/lib/libz.so.1.2.3.3
7fd491046000-7fd491047000 rwxp 00016000 08:01
3377290 /usr/lib/libz.so.1.2.3.3
7fd491047000-7fd49104f000 r-xp 00000000 08:01
11846838 /lib/libcrypt-2.7.so
7fd49104f000-7fd49124f000 ---p 00008000 08:01
11846838 /lib/libcrypt-2.7.so
7fd49124f000-7fd491251000 rwxp 00008000 08:01
11846838 /lib/libcrypt-2.7.so
7fd491251000-7fd49127f000 rwxp 00000000 00:00 0
7fd49127f000-7fd4912a8000 r-xp 00000000 08:01
3383938 /usr/local/lib/libapr-1.so.0.3.9
7fd4912a8000-7fd4914a7000 ---p 00029000 08:01
3383938 /usr/local/lib/libapr-1.so.0.3.9
7fd4914a7000-7fd4914a8000 rwxp 00028000 08:01
3383938 /usr/local/lib/libapr-1.so.0.3.9
7fd4914a8000-7fd4914a9000 rwxp 00000000 00:00 0
7fd4914a9000-7fd49161b000 r-xp 00000000 08:01
3376131 /usr/lib/libcrypto.so.0.9.8
7fd49161b000-7fd49181a000 ---p 00172000 08:01
3376131 /usr/lib/libcrypto.so.0.9.8
7fd49181a000-7fd491840000 rwxp 00171000 08:01
3376131 /usr/lib/libcrypto.so.0.9.8
7fd491840000-7fd491844000 rwxp 00000000 00:00 0
7fd491844000-7fd49188e000 r-xp 00000000 08:01
3376132 /usr/lib/libssl.so.0.9.8
7fd49188e000-7fd491a8e000 ---p 0004a000 08:01
3376132 /usr/lib/libssl.so.0.9.8
7fd491a8e000-7fd491a95000 rwxp 0004a000 08:01
3376132 /usr/lib/libssl.so.0.9.8
7fd491a96000-7fd491a99000 r-xs 000cb000 08:01
6570051 /opt/jdk1.6.0_18/jre/lib/ext/localedata.jar
7fd491a99000-7fd491ab8000 r-xp 00000000 08:01
3383972 /usr/local/lib/libtcnative-1.so.0.1.18
7fd491ab8000-7fd491cb8000 ---p 0001f000 08:01
3383972 /usr/local/lib/libtcnative-1.so.0.1.18
7fd491cb8000-7fd491cba000 rwxp 0001f000 08:01
3383972 /usr/local/lib/libtcnative-1.so.0.1.18
7fd491cba000-7fd4922ba000 rwxp 00000000 00:00 0
7fd4922ba000-7fd4922bc000 r-xs 00011000 08:01
6586767 /opt/apache-tomcat-6.0.24/lib/jsp-api.jar
7fd4922bc000-7fd4922be000 r-xs 00014000 08:01
6586760 /opt/apache-tomcat-6.0.24/lib/servlet-api.jar
7fd4922be000-7fd4922c3000 r-xs 00035000 08:01
6586763 /opt/apache-tomcat-6.0.24/lib/catalina-tribes.jar
7fd4922c3000-7fd4922ca000 r-xs 00079000 08:01
6586771 /opt/apache-tomcat-6.0.24/lib/jasper.jar
7fd4922ca000-7fd4922d6000 r-xs 0014c000 08:01
6586766 /opt/apache-tomcat-6.0.24/lib/jasper-jdt.jar
7fd4922d6000-7fd4922d8000 r-xs 0000c000 08:01
6586759 /opt/apache-tomcat-6.0.24/lib/catalina-ant.jar
7fd4922d8000-7fd4923d8000 rwxp 00000000 00:00 0
7fd4923d8000-7fd4923e7000 r-xs 00112000 08:01
6586770 /opt/apache-tomcat-6.0.24/lib/catalina.jar
7fd4923e7000-7fd4923ed000 r-xp 00000000 08:01
6561930 /opt/jdk1.6.0_18/jre/lib/amd64/libmanagement.so
7fd4923ed000-7fd4924ec000 ---p 00006000 08:01
6561930 /opt/jdk1.6.0_18/jre/lib/amd64/libmanagement.so
7fd4924ec000-7fd4924ee000 rwxp 00005000 08:01
6561930 /opt/jdk1.6.0_18/jre/lib/amd64/libmanagement.so
7fd4924ee000-7fd4925ee000 rwxp 00000000 00:00 0
7fd4925ee000-7fd492728000 r-xp 00000000 08:01
3392349 /usr/lib/locale/locale-archive
7fd492728000-7fd49275b000 rwxp 00000000 00:00 0
7fd49275b000-7fd4928f1000 r-xs 02fc6000 08:01
6554484 /opt/jdk1.6.0_18/jre/lib/rt.jar
7fd4928f1000-7fd4ab7e4000 rwxp 00000000 00:00 0
7fd4ab7e4000-7fd4aca00000 rwxp 00000000 00:00 0
7fd4aca00000-7fd4ae8e5000 rwxp 00000000 00:00 0
7fd4ae8e5000-7fd4ae8f3000 r-xp 00000000 08:01
6561963 /opt/jdk1.6.0_18/jre/lib/amd64/libzip.so
7fd4ae8f3000-7fd4ae9f5000 ---p 0000e000 08:01
6561963 /opt/jdk1.6.0_18/jre/lib/amd64/libzip.so
7fd4ae9f5000-7fd4ae9f8000 rwxp 00010000 08:01
6561963 /opt/jdk1.6.0_18/jre/lib/amd64/libzip.so
7fd4ae9f8000-7fd4ae9f9000 rwxp 00000000 00:00 0
7fd4ae9f9000-7fd4aea03000 r-xp 00000000 08:01
11846827 /lib/libnss_files-2.7.so
7fd4aea03000-7fd4aec03000 ---p 0000a000 08:01
11846827 /lib/libnss_files-2.7.so
7fd4aec03000-7fd4aec05000 rwxp 0000a000 08:01
11846827 /lib/libnss_files-2.7.so
7fd4aec05000-7fd4aec0e000 r-xp 00000000 08:01
11846824 /lib/libnss_nis-2.7.so
7fd4aec0e000-7fd4aee0e000 ---p 00009000 08:01
11846824 /lib/libnss_nis-2.7.so
7fd4aee0e000-7fd4aee10000 rwxp 00009000 08:01
11846824 /lib/libnss_nis-2.7.so
7fd4aee10000-7fd4aee17000 r-xp 00000000 08:01
11846829 /lib/libnss_compat-2.7.so
7fd4aee17000-7fd4af016000 ---p 00007000 08:01
11846829 /lib/libnss_compat-2.7.so
7fd4af016000-7fd4af018000 rwxp 00006000 08:01
11846829 /lib/libnss_compat-2.7.so
7fd4af018000-7fd4af01f000 r-xp 00000000 08:01
6569994 /opt/jdk1.6.0_18/jre/lib/amd64/native_threads/libhpi.so
7fd4af01f000-7fd4af120000 ---p 00007000 08:01
6569994 /opt/jdk1.6.0_18/jre/lib/amd64/native_threads/libhpi.so
7fd4af120000-7fd4af122000 rwxp 00008000 08:01
6569994 /opt/jdk1.6.0_18/jre/lib/amd64/native_threads/libhpi.so
7fd4af122000-7fd4af123000 rwxp 00000000 00:00 0
7fd4af123000-7fd4af12a000 r-xp 00000000 08:01
3379537 /usr/lib/libnuma.so.1
7fd4af12a000-7fd4af32a000 ---p 00007000 08:01
3379537 /usr/lib/libnuma.so.1
7fd4af32a000-7fd4af32b000 rwxp 00007000 08:01
3379537 /usr/lib/libnuma.so.1
7fd4af32b000-7fd4af340000 r-xp 00000000 08:01
11846839 /lib/libnsl-2.7.so
7fd4af340000-7fd4af53f000 ---p 00015000 08:01
11846839 /lib/libnsl-2.7.so
7fd4af53f000-7fd4af541000 rwxp 00014000 08:01
11846839 /lib/libnsl-2.7.so
7fd4af541000-7fd4af543000 rwxp 00000000 00:00 0
7fd4af543000-7fd4af56c000 r-xp 00000000 08:01
6561945 /opt/jdk1.6.0_18/jre/lib/amd64/libjava.so
7fd4af56c000-7fd4af66b000 ---p 00029000 08:01
6561945 /opt/jdk1.6.0_18/jre/lib/amd64/libjava.so
7fd4af66b000-7fd4af672000 rwxp 00028000 08:01
6561945 /opt/jdk1.6.0_18/jre/lib/amd64/libjava.so
7fd4af672000-7fd4af67f000 r-xp 00000000 08:01
6561948 /opt/jdk1.6.0_18/jre/lib/amd64/libverify.so
7fd4af67f000-7fd4af77e000 ---p 0000d000 08:01
6561948 /opt/jdk1.6.0_18/jre/lib/amd64/libverify.so
7fd4af77e000-7fd4af781000 rwxp 0000c000 08:01
6561948 /opt/jdk1.6.0_18/jre/lib/amd64/libverify.so
7fd4af781000-7fd4af789000 r-xp 00000000 08:01
11846831 /lib/librt-2.7.so
7fd4af789000-7fd4af988000 ---p 00008000 08:01
11846831 /lib/librt-2.7.so
7fd4af988000-7fd4af98a000 rwxp 00007000 08:01
11846831 /lib/librt-2.7.so
7fd4af98a000-7fd4afa0c000 r-xp 00000000 08:01
11846845 /lib/libm-2.7.so
7fd4afa0c000-7fd4afc0b000 ---p 00082000 08:01
11846845 /lib/libm-2.7.so
7fd4afc0b000-7fd4afc0d000 rwxp 00081000 08:01
11846845 /lib/libm-2.7.so
7fd4afc0d000-7fd4b03c1000 r-xp 00000000 08:01
6561941 /opt/jdk1.6.0_18/jre/lib/amd64/server/libjvm.so
7fd4b03c1000-7fd4b04c1000 ---p 007b4000 08:01
6561941 /opt/jdk1.6.0_18/jre/lib/amd64/server/libjvm.so
7fd4b04c1000-7fd4b064b000 rwxp 007b4000 08:01
6561941 /opt/jdk1.6.0_18/jre/lib/amd64/server/libjvm.so
7fd4b064b000-7fd4b0684000 rwxp 00000000 00:00 0
7fd4b0684000-7fd4b07ce000 r-xp 00000000 08:01
11846840 /lib/libc-2.7.so
7fd4b07ce000-7fd4b09cd000 ---p 0014a000 08:01
11846840 /lib/libc-2.7.so
7fd4b09cd000-7fd4b09d0000 r-xp 00149000 08:01
11846840 /lib/libc-2.7.so
7fd4b09d0000-7fd4b09d2000 rwxp 0014c000 08:01
11846840 /lib/libc-2.7.so
7fd4b09d2000-7fd4b09d7000 rwxp 00000000 00:00 0
7fd4b09d7000-7fd4b09d9000 r-xp 00000000 08:01
11846832 /lib/libdl-2.7.so
7fd4b09d9000-7fd4b0bd9000 ---p 00002000 08:01
11846832 /lib/libdl-2.7.so
7fd4b0bd9000-7fd4b0bdb000 rwxp 00002000 08:01
11846832 /lib/libdl-2.7.so
7fd4b0bdb000-7fd4b0bf1000 r-xp 00000000 08:01
11846843 /lib/libpthread-2.7.so
7fd4b0bf1000-7fd4b0df1000 ---p 00016000 08:01
11846843 /lib/libpthread-2.7.so
7fd4b0df1000-7fd4b0df3000 rwxp 00016000 08:01
11846843 /lib/libpthread-2.7.so
7fd4b0df3000-7fd4b0df7000 rwxp 00000000 00:00 0
7fd4b0df7000-7fd4b0e13000 r-xp 00000000 08:01
11846834 /lib/ld-2.7.so
7fd4b0e13000-7fd4b0e14000 rwxp 00000000 00:00 0
7fd4b0e14000-7fd4b0e16000 r-xs 0000c000 08:01
6586762 /opt/apache-tomcat-6.0.24/lib/tomcat-i18n-ja.jar
7fd4b0e16000-7fd4b0e17000 r-xs 00003000 08:01
6586761 /opt/apache-tomcat-6.0.24/lib/annotations-api.jar
7fd4b0e17000-7fd4b0e1a000 r-xs 00018000 08:01
6586769 /opt/apache-tomcat-6.0.24/lib/jasper-el.jar
7fd4b0e1a000-7fd4b0e1d000 r-xs 0001d000 08:01
6586768 /opt/apache-tomcat-6.0.24/lib/catalina-ha.jar
7fd4b0e1d000-7fd4b0e1e000 r-xs 00007000 08:01
6586764 /opt/apache-tomcat-6.0.24/lib/el-api.jar
7fd4b0e1e000-7fd4b0e20000 r-xs 0000b000 08:01
6586765 /opt/apache-tomcat-6.0.24/lib/tomcat-i18n-fr.jar
7fd4b0e20000-7fd4b0e23000 r-xs 0000f000 08:01
6586772 /opt/apache-tomcat-6.0.24/lib/tomcat-i18n-es.jar
7fd4b0e23000-7fd4b0e27000 r-xs 00035000 08:01
6586774 /opt/apache-tomcat-6.0.24/lib/tomcat-dbcp.jar
7fd4b0e27000-7fd4b0e32000 r-xs 000af000 08:01
6586773 /opt/apache-tomcat-6.0.24/lib/tomcat-coyote.jar
7fd4b0e32000-7fd4b0e34000 r-xs 00005000 08:01
6586742 /opt/apache-tomcat-6.0.24/bin/tomcat-juli.jar
7fd4b0e34000-7fd4b0e36000 r-xs 00001000 08:01
6586743 /opt/apache-tomcat-6.0.24/bin/commons-daemon.jar
7fd4b0e36000-7fd4b0e76000 rwxp 00000000 00:00 0
7fd4b0e76000-7fd4b0ef6000 rwxp 00000000 00:00 0
7fd4b0ef6000-7fd4b0efe000 rwxs 00000000 08:01
4726790 /tmp/hsperfdata_root/16402
7fd4b0efe000-7fd4b0f00000 rwxp 00000000 00:00 0
7fd4b0f00000-7fd4b0f07000 r-xp 00000000 08:01
6569992 /opt/jdk1.6.0_18/jre/lib/amd64/jli/libjli.so
7fd4b0f07000-7fd4b1008000 ---p 00007000 08:01
6569992 /opt/jdk1.6.0_18/jre/lib/amd64/jli/libjli.so
7fd4b1008000-7fd4b100a000 rwxp 00008000 08:01
6569992 /opt/jdk1.6.0_18/jre/lib/amd64/jli/libjli.so
7fd4b100a000-7fd4b100b000 rwxp 00000000 00:00 0
7fd4b100b000-7fd4b100d000 r-xs 00004000 08:01
6586740 /opt/apache-tomcat-6.0.24/bin/bootstrap.jar
7fd4b100d000-7fd4b100e000 rwxp 00000000 00:00 0
7fd4b100e000-7fd4b100f000 r-xp 00000000 00:00 0
7fd4b100f000-7fd4b1012000 rwxp 00000000 00:00 0
7fd4b1012000-7fd4b1014000 rwxp 0001b000 08:01
11846834 /lib/ld-2.7.so
7fffaea6a000-7fffaea7f000 rwxp 00000000 00:00 0
[stack]
7fffaebc2000-7fffaebc3000 r-xp 00000000 00:00 0
[vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
[vsyscall]
VM Arguments:
jvm_args: -verbose:jni -Djava.awt.headless=true
-Dsun.net.inetaddr.ttl=60 -Dfile.encoding=UTF-8
-Djava.io.tmpdir=/opt/apache-tomcat/temp
-Djava.library.path=/usr/local/lib
-Djava.endorsed.dirs=/opt/apache-tomcat/endorsed
-Dcatalina.base=/opt/apache-tomcat -Dcatalina.home=/opt/apache-tomcat
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=/opt/apache-tomcat/conf/logging.properties -Xloggc:/opt/apache-tomcat/logs/gc.log -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=60 -XX:+PrintGCDetails -Xms18432M -Xmx18432M -XX:NewSize=3072M -XX:MaxNewSize=3072M -XX:PermSize=128M -XX:MaxPermSize=128M -Xss128K -XX:+UseLargePages -XX:+UseNUMA
java_command: org.apache.catalina.startup.Bootstrap start
Launcher Type: SUN_STANDARD
Environment Variables:
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
USERNAME=root
LD_LIBRARY_PATH=/opt/jdk1.6.0_18/jre/lib/amd64/server:/opt/jdk1.6.0_18/jre/lib/amd64:/opt/jdk1.6.0_18/jre/../lib/amd64
SHELL=/bin/bash
Signal Handlers:
SIGSEGV: [libjvm.so+0x70f1a0], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGBUS: [libjvm.so+0x70f1a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGFPE: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGPIPE: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGXFSZ: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGILL: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x5da790], sa_mask[0]=0x00000000,
sa_flags=0x10000004
SIGHUP: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGTERM: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGQUIT: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
--------------- S Y S T E M ---------------
OS:5.0.4
uname:Linux 2.6.31.12 #1 SMP Fri Feb 5 12:51:59 CET 2010 x86_64
libc:glibc 2.7 NPTL 2.7
rlimit: STACK 8192k, CORE 0k, NPROC infinity, NOFILE 131072, AS infinity
load average:0.00 0.00 0.00
CPU:total 16 (8 cores per cpu, 2 threads per core) family 6 model 26
stepping 5, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1,
sse4.2, popcnt, ht
Memory: 4k page, physical 24740684k(3235016k free), swap
9936160k(9936160k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (16.0-b13) for linux-amd64
JRE (1.6.0_18-b07), built on Dec 17 2009 13:42:22 by "java_re" with gcc
3.2.2 (SuSE Linux)
time: Sat Mar 27 19:58:20 2010
elapsed time: 204807 seconds
On Tue, 2010-03-23 at 02:04 +0100, Carl wrote:
> George,
>
> I tried OpenSuSE with 6u17 and the results were about the same as Slackware
> 64 so the implication is that there is something in my app that is
> triggering the seg fault. My app is mostly jsp's running against MySQL with
> some AJAX and Flash (communicating through a servlet.) I do not use any
> native code nor do I use AJP. I do use SSL for everything. It has also
> failed on different hardware although the OS was the same.
>
> The argument against the problem being in my app is that the app runs fine
> (has for several years) on 32 bit Slackware and it now seems to be running
> fine on 6u7 (on Slackware 64.)
>
> Now that I appear to have a stable system that I can always go back to, I
> would like to get to the root cause. My thought was that I could get the
> source code, compile it on the server and then wait for it to fail with a
> core file that could give me the answer (maybe.) However, I can only find
> source code for the 'open' fork which may or may not be the same so I am
> stymied again.
>
> I guess I just have to keep stabbing in the dark with the new JVM's until
> one happens to work... not very scientific.
>
> Thanks,
>
> Carl
>
>
> ----- Original Message -----
> From: "George Sexton" <ge...@mhsoftware.com>
> To: "'Tomcat Users List'" <us...@tomcat.apache.org>
> Sent: Monday, March 22, 2010 2:48 PM
> Subject: RE: [OT] Re: jvm exits without trace
>
>
> > -----Original Message-----
> > From: Dan Armbrust [mailto:daniel.armbrust.list@gmail.com]
> > Sent: Monday, March 22, 2010 12:17 PM
> > To: Tomcat Users List
> > Subject: Re: [OT] Re: jvm exits without trace
> >
> > On Tue, Mar 16, 2010 at 4:46 PM, Carl <ca...@etrak-plus.com> wrote:
> > > My approach is to get something (a JVM) that works and then gradually
> > change
> > > until it breaks. Then, I know what is causing the problem. To date,
> > I
> > > haven't been able to get a JVM that works.
> > >
> >
> > I have had a lot of issues finding stable JVMs since I moved our
> > software from 1.5 to 1.6... 1.6 has been a mess for ages under our
> > workload on CentOS. Code that ran fine under 1.5 would segfault in
> > all sorts of random places on 1.6. I even tried the 1.7 openJDK early
> > builds... they were even worse.
> >
> > I was pleased to see that the most recent release
> > http://java.sun.com/javase/6/webnotes/6u18.html contains _tons_ of bug
> > fixes, including lots of crash fixes. Seriously... the last few
> > releases have contained only a handful of fixes... this release has
> > hundreds.
>
> I'm running 1.6.0_18 under OpenSuSE 11.0-11.2 and I've only had one problem.
> It looks like a GLIBC error related to IPV6. I disabled IPV6 on the machine
> and it's been rock solid since.
>
> I don't use native connectors, or AJP. I do about 900,000 hits with 4GB/Day
> spread across 3 servers and it's just rock steady. I run the tomcat
> instances for 2-3 weeks each before re-starting. For each machine, that's
> about 6 million hits with about 40 GB of transfer.
>
> George Sexton
> MH Software, Inc.
> 303 438-9585
> www.mhsoftware.com
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by Carl <ca...@etrak-plus.com>.
George,
I tried OpenSuSE with 6u17 and the results were about the same as Slackware
64 so the implication is that there is something in my app that is
triggering the seg fault. My app is mostly jsp's running against MySQL with
some AJAX and Flash (communicating through a servlet.) I do not use any
native code nor do I use AJP. I do use SSL for everything. It has also
failed on different hardware although the OS was the same.
The argument against the problem being in my app is that the app runs fine
(has for several years) on 32 bit Slackware and it now seems to be running
fine on 6u7 (on Slackware 64.)
Now that I appear to have a stable system that I can always go back to, I
would like to get to the root cause. My thought was that I could get the
source code, compile it on the server and then wait for it to fail with a
core file that could give me the answer (maybe.) However, I can only find
source code for the 'open' fork which may or may not be the same so I am
stymied again.
I guess I just have to keep stabbing in the dark with the new JVM's until
one happens to work... not very scientific.
Thanks,
Carl
----- Original Message -----
From: "George Sexton" <ge...@mhsoftware.com>
To: "'Tomcat Users List'" <us...@tomcat.apache.org>
Sent: Monday, March 22, 2010 2:48 PM
Subject: RE: [OT] Re: jvm exits without trace
> -----Original Message-----
> From: Dan Armbrust [mailto:daniel.armbrust.list@gmail.com]
> Sent: Monday, March 22, 2010 12:17 PM
> To: Tomcat Users List
> Subject: Re: [OT] Re: jvm exits without trace
>
> On Tue, Mar 16, 2010 at 4:46 PM, Carl <ca...@etrak-plus.com> wrote:
> > My approach is to get something (a JVM) that works and then gradually
> change
> > until it breaks. Then, I know what is causing the problem. To date,
> I
> > haven't been able to get a JVM that works.
> >
>
> I have had a lot of issues finding stable JVMs since I moved our
> software from 1.5 to 1.6... 1.6 has been a mess for ages under our
> workload on CentOS. Code that ran fine under 1.5 would segfault in
> all sorts of random places on 1.6. I even tried the 1.7 openJDK early
> builds... they were even worse.
>
> I was pleased to see that the most recent release
> http://java.sun.com/javase/6/webnotes/6u18.html contains _tons_ of bug
> fixes, including lots of crash fixes. Seriously... the last few
> releases have contained only a handful of fixes... this release has
> hundreds.
I'm running 1.6.0_18 under OpenSuSE 11.0-11.2 and I've only had one problem.
It looks like a GLIBC error related to IPV6. I disabled IPV6 on the machine
and it's been rock solid since.
I don't use native connectors, or AJP. I do about 900,000 hits with 4GB/Day
spread across 3 servers and it's just rock steady. I run the tomcat
instances for 2-3 weeks each before re-starting. For each machine, that's
about 6 million hits with about 40 GB of transfer.
George Sexton
MH Software, Inc.
303 438-9585
www.mhsoftware.com
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: [OT] Re: jvm exits without trace
Posted by George Sexton <ge...@mhsoftware.com>.
> -----Original Message-----
> From: Dan Armbrust [mailto:daniel.armbrust.list@gmail.com]
> Sent: Monday, March 22, 2010 12:17 PM
> To: Tomcat Users List
> Subject: Re: [OT] Re: jvm exits without trace
>
> On Tue, Mar 16, 2010 at 4:46 PM, Carl <ca...@etrak-plus.com> wrote:
> > My approach is to get something (a JVM) that works and then gradually
> change
> > until it breaks. Then, I know what is causing the problem. To date,
> I
> > haven't been able to get a JVM that works.
> >
>
> I have had a lot of issues finding stable JVMs since I moved our
> software from 1.5 to 1.6... 1.6 has been a mess for ages under our
> workload on CentOS. Code that ran fine under 1.5 would segfault in
> all sorts of random places on 1.6. I even tried the 1.7 openJDK early
> builds... they were even worse.
>
> I was pleased to see that the most recent release
> http://java.sun.com/javase/6/webnotes/6u18.html contains _tons_ of bug
> fixes, including lots of crash fixes. Seriously... the last few
> releases have contained only a handful of fixes... this release has
> hundreds.
I'm running 1.6.0_18 under OpenSuSE 11.0-11.2 and I've only had one problem.
It looks like a GLIBC error related to IPV6. I disabled IPV6 on the machine
and it's been rock solid since.
I don't use native connectors, or AJP. I do about 900,000 hits with 4GB/Day
spread across 3 servers and it's just rock steady. I run the tomcat
instances for 2-3 weeks each before re-starting. For each machine, that's
about 6 million hits with about 40 GB of transfer.
George Sexton
MH Software, Inc.
303 438-9585
www.mhsoftware.com
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by David Kerber <dc...@verizon.net>.
Peter Crowther wrote:
> On 27 March 2010 00:22, David Kerber <dc...@verizon.net> wrote:
>
>
>> BTW, after looking back at my development notes, the jdbc-odbc bridges,
>> while a pain to set up, have better performance than the type 4 drivers that
>> Sybase also offers.
>>
>> That's frightening, given the extra layers of code for the ODBC bridge. If
>>
> I were Sybase, I'd be ashamed of my code quality - or trying to implement
> the missing features that cause your application to behave better with the
> ODBC bridge.
>
Except that with the bridge, much of the work can be done in highly
optimized C code (there's a separate driver for each platform), rather
than in java, which probably makes up for the extra layer. In addtion,
they say that ODBC is a native interface for SQLAnywhere, so there are
fewer layers than most ODBC implementations would have.
D
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Peter Crowther <pe...@melandra.com>.
On 27 March 2010 00:22, David Kerber <dc...@verizon.net> wrote:
> BTW, after looking back at my development notes, the jdbc-odbc bridges,
> while a pain to set up, have better performance than the type 4 drivers that
> Sybase also offers.
>
> That's frightening, given the extra layers of code for the ODBC bridge. If
I were Sybase, I'd be ashamed of my code quality - or trying to implement
the missing features that cause your application to behave better with the
ODBC bridge.
- Peter
Re: [OT] Re: jvm exits without trace
Posted by Mark Thomas <ma...@apache.org>.
On 22/03/2010 22:12, Martin Gainty wrote:
>
> Carl-
>
> enable logging FileHandler and set level to finest e.g.
> org.apache.catalina.level=FINEST
Not recommended unless you actually want Tomcat to take over 20 minutes
to start up.
Added to which, that isn't going to help track down this JVM bug.
Carl, I think you are safe to ignore this suggestion.
Mark
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: [OT] Re: jvm exits without trace
Posted by Martin Gainty <mg...@hotmail.com>.
Carl-
enable logging FileHandler and set level to finest e.g.
org.apache.catalina.level=FINEST
http://tomcat.apache.org/tomcat-6.0-doc/logging.html
hth
Martin Gainty
______________________________________________
Verzicht und Vertraulichkeitanmerkung/Note de déni et de confidentialité
Diese Nachricht ist vertraulich. Sollten Sie nicht der vorgesehene Empfaenger sein, so bitten wir hoeflich um eine Mitteilung. Jede unbefugte Weiterleitung oder Fertigung einer Kopie ist unzulaessig. Diese Nachricht dient lediglich dem Austausch von Informationen und entfaltet keine rechtliche Bindungswirkung. Aufgrund der leichten Manipulierbarkeit von E-Mails koennen wir keine Haftung fuer den Inhalt uebernehmen.
Ce message est confidentiel et peut être privilégié. Si vous n'êtes pas le destinataire prévu, nous te demandons avec bonté que pour satisfaire informez l'expéditeur. N'importe quelle diffusion non autorisée ou la copie de ceci est interdite. Ce message sert à l'information seulement et n'aura pas n'importe quel effet légalement obligatoire. Étant donné que les email peuvent facilement être sujets à la manipulation, nous ne pouvons accepter aucune responsabilité pour le contenu fourni.
> From: carl@etrak-plus.com
> To: users@tomcat.apache.org
> Subject: Re: [OT] Re: jvm exits without trace
> Date: Mon, 22 Mar 2010 14:33:54 -0500
>
> Dan,
>
> 6u18 did not work for us, crashed with the same regularity as 6u17.
> However, 6u7 has been running for two weeks without a failure (the others
> would fail between 15 minutes and 10 days runtime.)
>
> Thanks,
>
> Carl
> ----- Original Message -----
> From: "Dan Armbrust" <da...@gmail.com>
> To: "Tomcat Users List" <us...@tomcat.apache.org>
> Sent: Monday, March 22, 2010 1:17 PM
> Subject: Re: [OT] Re: jvm exits without trace
>
>
> On Tue, Mar 16, 2010 at 4:46 PM, Carl <ca...@etrak-plus.com> wrote:
> > My approach is to get something (a JVM) that works and then gradually
> > change
> > until it breaks. Then, I know what is causing the problem. To date, I
> > haven't been able to get a JVM that works.
> >
>
> I have had a lot of issues finding stable JVMs since I moved our
> software from 1.5 to 1.6... 1.6 has been a mess for ages under our
> workload on CentOS. Code that ran fine under 1.5 would segfault in
> all sorts of random places on 1.6. I even tried the 1.7 openJDK early
> builds... they were even worse.
>
> I was pleased to see that the most recent release
> http://java.sun.com/javase/6/webnotes/6u18.html contains _tons_ of bug
> fixes, including lots of crash fixes. Seriously... the last few
> releases have contained only a handful of fixes... this release has
> hundreds.
>
> I'm testing it now, and so far, it looks promising. This may be the
> first 1.6 release that I've found that doesn't crash with my workload.
> Unfortunately, I've never been able to pin down a sequence of events
> that would cause the crash on demand, so its hard for me to verify
> that things are finally fixed, other than doing long term load testing
> and waiting for the crashes to (hopefully) not happen.
>
> Dan
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
_________________________________________________________________
The New Busy is not the old busy. Search, chat and e-mail from your inbox.
http://www.windowslive.com/campaign/thenewbusy?ocid=PID27925::T:WLMTAGL:ON:WL:en-US:WM_HMP:032010_3
Re: jvm exits without trace
Posted by David Kerber <dc...@verizon.net>.
David kerber wrote:
> It looks like we may have had one of these this AM, but under somewhat
> different conditions: Windows server 2008, JVM 1.6.0_17 64-bit Server
> VM, TC 5.5.28. No tracks in any of the TC logs, and the Windows event
> viewer had the singularly un-useful "The Tomcat5 service terminated
> unexpectedly. It has done this 1 time(s)."
After working with Sybase, it appears that the most likely cause was a
mismatch between the jodbc.jar file shown in the log below, and the .dll
it talks to outside. I had updated the database drivers a couple of
weeks ago, and apparently forgot to update the .jar file in TCs shared
library folder. It worked for a while, but apparently something special
happened today that tripped it up.
D
BTW, after looking back at my development notes, the jdbc-odbc bridges,
while a pain to set up, have better performance than the type 4 drivers
that Sybase also offers.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by David kerber <dc...@verizon.net>.
On 3/26/2010 3:27 PM, Caldarale, Charles R wrote:
>> From: Christopher Schultz [mailto:chris@christopherschultz.net]
>> Subject: Re: jvm exits without trace
>>
>> Yikes: whenever I see jdbcodbc I cringe!
>
> As everyone should.
>
>> Looks like whatever ntdll.dll is. That doesn't sound like a
>> JDBC driver cause to me.
>
> It's not the JDBC driver per se, but the JDBC driver called it. You pretty much have to go through ntldll.dll on all calls into the Windows kernel.
>
>> The stack trace shows all Java code except the call into ntdll.dll.
>
> Java code can't call ntldll.dll directly - that has to be done from some other native code.
>
>> Looks like you've broken a kernel call, though :)
>
> Just gave it a VA that's not valid for the process to access, so the Windows kernel blew up the thread with an access violation - as it should.
>
> This appears to be completely unrelated to the previously discussed JVM terminations.
Ok, I'll accept that. I really didn't know, but wanted a second pair of
eyes to look at it. I thought there was a chance it might be related
because the failure was nearly (though not completely) silent.
Thanks for the comments!
D
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Christopher Schultz [mailto:chris@christopherschultz.net]
> Subject: Re: jvm exits without trace
>
> Yikes: whenever I see jdbcodbc I cringe!
As everyone should.
> Looks like whatever ntdll.dll is. That doesn't sound like a
> JDBC driver cause to me.
It's not the JDBC driver per se, but the JDBC driver called it. You pretty much have to go through ntldll.dll on all calls into the Windows kernel.
> The stack trace shows all Java code except the call into ntdll.dll.
Java code can't call ntldll.dll directly - that has to be done from some other native code.
> Looks like you've broken a kernel call, though :)
Just gave it a VA that's not valid for the process to access, so the Windows kernel blew up the thread with an access violation - as it should.
This appears to be completely unrelated to the previously discussed JVM terminations.
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
Re: jvm exits without trace
Posted by David kerber <dc...@verizon.net>.
On 3/26/2010 3:39 PM, Caldarale, Charles R wrote:
>> From: David kerber [mailto:dckerber@verizon.net]
>> Subject: Re: jvm exits without trace
>>
>> What alternative is there, without going to a java database?
>
> *Every* real database that I'm aware of supplies type 4 JDBC drivers; none use the mind-bogglingly bad JDBC-ODBC bridge. Choose your poison: Oracle, SQL Server, MySQL, PostgreSQL, ...
Oh, yeah. Brain fart on my part...
D
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: David kerber [mailto:dckerber@verizon.net]
> Subject: Re: jvm exits without trace
>
> What alternative is there, without going to a java database?
*Every* real database that I'm aware of supplies type 4 JDBC drivers; none use the mind-bogglingly bad JDBC-ODBC bridge. Choose your poison: Oracle, SQL Server, MySQL, PostgreSQL, ...
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by David kerber <dc...@verizon.net>.
On 3/26/2010 3:19 PM, Christopher Schultz wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> David,
>
> On 3/26/2010 1:40 PM, David kerber wrote:
>> It looks like we may have had one of these this AM, but under somewhat
>> different conditions: Windows server 2008, JVM 1.6.0_17 64-bit Server
>> VM, TC 5.5.28. No tracks in any of the TC logs, and the Windows event
>> viewer had the singularly un-useful "The Tomcat5 service terminated
>> unexpectedly. It has done this 1 time(s)."
>>
>> I did find this jvm error log, though, which appears to point to my jdbc
>> driver:
>
> Yikes: whenever I see jdbcodbc I cringe!
What alternative is there, without going to a java database? This is
making calls to a database server elsewhere on the network, not
something embedded in the app.
>
>> # EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000775c8926,
>> pid=4860, tid=4272
>
> [snip]
>
>> #
>> # JRE version: 6.0_17-b04
>> # Java VM: Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode
>> windows-amd64 )
>> # Problematic frame:
>> # C [ntdll.dll+0x48926]
>
> Looks like whatever ntdll.dll is. That doesn't sound like a JDBC driver
> cause to me.
Other than the fact that it's part of the windows kernel/core, I don't
know either. My guess was that the jodbc driver was making a bad call
to the kernel.
>
> The stack trace shows all Java code except the call into ntdll.dll.
> Without knowing what function was being called, you can't really even
> speculate what the problem might be.
>
> Looks like you've broken a kernel call, though :)
Yep
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
David,
On 3/26/2010 1:40 PM, David kerber wrote:
> It looks like we may have had one of these this AM, but under somewhat
> different conditions: Windows server 2008, JVM 1.6.0_17 64-bit Server
> VM, TC 5.5.28. No tracks in any of the TC logs, and the Windows event
> viewer had the singularly un-useful "The Tomcat5 service terminated
> unexpectedly. It has done this 1 time(s)."
>
> I did find this jvm error log, though, which appears to point to my jdbc
> driver:
Yikes: whenever I see jdbcodbc I cringe!
> # EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000775c8926,
> pid=4860, tid=4272
[snip]
> #
> # JRE version: 6.0_17-b04
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode
> windows-amd64 )
> # Problematic frame:
> # C [ntdll.dll+0x48926]
Looks like whatever ntdll.dll is. That doesn't sound like a JDBC driver
cause to me.
The stack trace shows all Java code except the call into ntdll.dll.
Without knowing what function was being called, you can't really even
speculate what the problem might be.
Looks like you've broken a kernel call, though :)
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkutCL0ACgkQ9CaO5/Lv0PCUIQCfeHc5KbIL7YH45mSF0x6IsUSk
vhQAnjNa9cYKr2q0bc9MgBFBkuExNN4Y
=hlui
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: Re: jvm exits without trace
Posted by David kerber <dc...@verizon.net>.
It looks like we may have had one of these this AM, but under somewhat
different conditions: Windows server 2008, JVM 1.6.0_17 64-bit Server
VM, TC 5.5.28. No tracks in any of the TC logs, and the Windows event
viewer had the singularly un-useful "The Tomcat5 service terminated
unexpectedly. It has done this 1 time(s)."
I did find this jvm error log, though, which appears to point to my jdbc
driver:
#
# A fatal error has been detected by the Java Runtime Environment:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000775c8926,
pid=4860, tid=4272
#
# JRE version: 6.0_17-b04
# Java VM: Java HotSpot(TM) 64-Bit Server VM (14.3-b01 mixed mode
windows-amd64 )
# Problematic frame:
# C [ntdll.dll+0x48926]
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
--------------- T H R E A D ---------------
Current thread (0x000000001a5a8000): JavaThread "http-81-Processor22"
daemon [_thread_in_native, id=4272,
stack(0x000000001bdc0000,0x000000001be00000)]
siginfo: ExceptionCode=0xc0000005, writing address 0x0000000000000010
Registers:
EAX=0x0000000000000000, EBX=0x0000000000000000, ECX=0x0000000000000008,
EDX=0x0000000000000000
ESP=0x000000001bdfc660, EBP=0x0000000000000003, ESI=0x000000001a2572f0,
EDI=0x000000001a2572f0
EIP=0x00000000775c8926, EFLAGS=0x0000000000010206
Top of Stack: (sp=0x000000001bdfc660)
0x000000001bdfc660: 0000000000000000 000000001bdfc7f8
0x000000001bdfc670: 000000001bdfd080 000000001c317568
0x000000001bdfc680: 0000000000000000 000007fef97b191c
0x000000001bdfc690: 0000000000000003 000000001a2572f0
0x000000001bdfc6a0: 000000001a2572f0 0000000000000001
0x000000001bdfc6b0: 000000001a2572f0 000007fef97d63e8
0x000000001bdfc6c0: 0000000000000001 000000001a2572f0
0x000000001bdfc6d0: 000000001c6038f0 000000001c371ce7
0x000000001bdfc6e0: 0000000000000400 000007fef97d7af7
0x000000001bdfc6f0: 0000000000000001 0000000000000001
0x000000001bdfc700: 0000000000000001 000000001cd98a50
0x000000001bdfc710: 0000000019d454a0 000000001c37200c
0x000000001bdfc720: 000000001c6038f0 0000000000000001
0x000000001bdfc730: 00000000000002a4 0000000000000001
0x000000001bdfc740: 000000001c600000 000000001c37207d
0x000000001bdfc750: 000000001c6038f0 ffffffffffffffff
Instructions: (pc=0x00000000775c8926)
0x00000000775c8916: ff ff 90 90 90 90 90 90 90 90 ff f3 48 83 ec 20
0x00000000775c8926: f0 0f ba 71 08 00 48 8b d1 0f 83 65 cb fd ff 65
Stack: [0x000000001bdc0000,0x000000001be00000], sp=0x000000001bdfc660,
free space=241k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
C=native code)
C [ntdll.dll+0x48926]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j
ianywhere.ml.jdbcodbc.IIStatement.executeQuery(Ljava/lang/String;)Ljava/sql/ResultSet;+0
j
ianywhere.ml.jdbcodbc.IStatement.executeQuery(Ljava/lang/String;)Ljava/sql/ResultSet;+7
j
com.wra.websira.WraJdbc.query(Ljava/sql/Statement;Ljava/lang/String;)Ljava/sql/ResultSet;+2
j
com.wra.websira.WraTable.rawQuery(Lcom/wra/websira/WraDatabase;Ljava/sql/Statement;Ljava/lang/String;Ljava/lang/String;)Ljava/sql/ResultSet;+82
j com.wra.reports.GenericReportByFuel.loadTankHeights()I+165
j
com.wra.reports.GenericReconByFuel.runReport(Lcom/wra/reports/AdminReport;Lcom/wra/reports/ReconciliationDetail;)Ljava/lang/String;+1137
j
com.wra.reports.ReconWRA_html.runReport(Lcom/wra/reports/AdminReport;Lcom/wra/reports/ReconciliationDetail;)Ljava/lang/String;+3
v ~StubRoutines::call_stub
j
sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0
j
sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87
j
sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6
j
java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+161
j
SiteData.ReconReports.reportOneSite(Ljavax/servlet/http/HttpSession;)Ljava/lang/String;+547
j
org.apache.jsp.ListInventory_jsp._jspService(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+215
j
org.apache.jasper.runtime.HttpJspBase.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+3
j
javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+30
j
org.apache.jasper.servlet.JspServletWrapper.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Z)V+203
j
org.apache.jasper.servlet.JspServlet.serviceJspFile(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljava/lang/String;Ljava/lang/Throwable;Z)V+186
j
org.apache.jasper.servlet.JspServlet.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+435
j
javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+30
j
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+362
j
org.apache.catalina.core.ApplicationFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+101
j
org.apache.catalina.core.ApplicationDispatcher.invoke(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Lorg/apache/catalina/core/ApplicationDispatcher$State;)V+393
j
org.apache.catalina.core.ApplicationDispatcher.processRequest(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Lorg/apache/catalina/core/ApplicationDispatcher$State;)V+68
j
org.apache.catalina.core.ApplicationDispatcher.doForward(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+507
j
org.apache.catalina.core.ApplicationDispatcher.forward(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+55
j
org.apache.jasper.runtime.PageContextImpl.doForward(Ljava/lang/String;)V+113
j org.apache.jasper.runtime.PageContextImpl.forward(Ljava/lang/String;)V+47
j
org.apache.jsp.GetParameters_jsp._jspService(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+248
j
org.apache.jasper.runtime.HttpJspBase.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+3
j
javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+30
j
org.apache.jasper.servlet.JspServletWrapper.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Z)V+203
j
org.apache.jasper.servlet.JspServlet.serviceJspFile(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;Ljava/lang/String;Ljava/lang/Throwable;Z)V+186
j
org.apache.jasper.servlet.JspServlet.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V+435
j
javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+30
j
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+362
j
org.apache.catalina.core.ApplicationFilterChain.doFilter(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V+101
j
org.apache.catalina.core.StandardWrapperValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V+699
j
org.apache.catalina.core.StandardContextValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V+269
j
org.apache.catalina.core.StandardHostValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V+64
j
org.apache.catalina.valves.ErrorReportValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V+6
j
org.apache.catalina.core.StandardEngineValve.invoke(Lorg/apache/catalina/connector/Request;Lorg/apache/catalina/connector/Response;)V+42
j
org.apache.catalina.connector.CoyoteAdapter.service(Lorg/apache/coyote/Request;Lorg/apache/coyote/Response;)V+154
j
org.apache.coyote.http11.Http11Processor.process(Ljava/io/InputStream;Ljava/io/OutputStream;)V+573
j
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V+113
j
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(Ljava/net/Socket;Lorg/apache/tomcat/util/net/TcpConnection;[Ljava/lang/Object;)V+45
j
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt([Ljava/lang/Object;)V+102
j org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run()V+167
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x000000001a5ae800 JavaThread "TP-Monitor" daemon [_thread_blocked,
id=4624, stack(0x000000001c000000,0x000000001c040000)]
0x000000001a5ad800 JavaThread "TP-Processor4" daemon
[_thread_in_native, id=4840, stack(0x000000001bfc0000,0x000000001c000000)]
0x000000001a5ad000 JavaThread "TP-Processor3" daemon
[_thread_blocked, id=4472, stack(0x000000001bf80000,0x000000001bfc0000)]
0x000000001a5ac800 JavaThread "TP-Processor2" daemon
[_thread_blocked, id=3908, stack(0x000000001bf40000,0x000000001bf80000)]
0x000000001a5ab800 JavaThread "TP-Processor1" daemon
[_thread_blocked, id=4148, stack(0x000000001bf00000,0x000000001bf40000)]
0x000000001a5ab000 JavaThread "http-81-Monitor" [_thread_blocked,
id=4224, stack(0x000000001bec0000,0x000000001bf00000)]
0x000000001a5aa000 JavaThread "http-81-Processor25" daemon
[_thread_blocked, id=4400, stack(0x000000001be80000,0x000000001bec0000)]
0x000000001a5a9800 JavaThread "http-81-Processor24" daemon
[_thread_in_native, id=4452, stack(0x000000001be40000,0x000000001be80000)]
0x000000001a5a8800 JavaThread "http-81-Processor23" daemon
[_thread_in_native, id=4800, stack(0x000000001be00000,0x000000001be40000)]
=>0x000000001a5a8000 JavaThread "http-81-Processor22" daemon
[_thread_in_native, id=4272, stack(0x000000001bdc0000,0x000000001be00000)]
0x000000001a5a7000 JavaThread "http-81-Processor21" daemon
[_thread_blocked, id=540, stack(0x000000001bd80000,0x000000001bdc0000)]
0x000000001a5a6800 JavaThread "http-81-Processor20" daemon
[_thread_blocked, id=5008, stack(0x000000001bd40000,0x000000001bd80000)]
0x000000001a5a6000 JavaThread "http-81-Processor19" daemon
[_thread_blocked, id=3452, stack(0x000000001bd00000,0x000000001bd40000)]
0x000000001a5a5000 JavaThread "http-81-Processor18" daemon
[_thread_blocked, id=2924, stack(0x000000001bcc0000,0x000000001bd00000)]
0x000000001a5a4800 JavaThread "http-81-Processor17" daemon
[_thread_blocked, id=4192, stack(0x000000001bc80000,0x000000001bcc0000)]
0x000000001a5a3800 JavaThread "http-81-Processor16" daemon
[_thread_blocked, id=924, stack(0x000000001bc40000,0x000000001bc80000)]
0x000000001a5a3000 JavaThread "http-81-Processor15" daemon
[_thread_blocked, id=4316, stack(0x000000001bc00000,0x000000001bc40000)]
0x000000001a5a2000 JavaThread "http-81-Processor14" daemon
[_thread_blocked, id=552, stack(0x000000001bbc0000,0x000000001bc00000)]
0x000000001a5a1800 JavaThread "http-81-Processor13" daemon
[_thread_blocked, id=4636, stack(0x000000001bb80000,0x000000001bbc0000)]
0x000000001a5a0800 JavaThread "http-81-Processor12" daemon
[_thread_blocked, id=4468, stack(0x000000001bb40000,0x000000001bb80000)]
0x000000001a5a0000 JavaThread "http-81-Processor11" daemon
[_thread_blocked, id=1268, stack(0x000000001bb00000,0x000000001bb40000)]
0x000000001a59f800 JavaThread "http-81-Processor10" daemon
[_thread_blocked, id=4508, stack(0x000000001bac0000,0x000000001bb00000)]
0x0000000019eb3800 JavaThread "http-81-Processor9" daemon
[_thread_blocked, id=4496, stack(0x000000001ba80000,0x000000001bac0000)]
0x000000001a2fa800 JavaThread "http-81-Processor8" daemon
[_thread_blocked, id=4336, stack(0x000000001ba40000,0x000000001ba80000)]
0x000000001a5bf000 JavaThread "http-81-Processor7" daemon
[_thread_blocked, id=4928, stack(0x000000001ba00000,0x000000001ba40000)]
0x000000001a5be000 JavaThread "http-81-Processor6" daemon
[_thread_blocked, id=3580, stack(0x000000001b9c0000,0x000000001ba00000)]
0x000000001a5bd800 JavaThread "http-81-Processor5" daemon
[_thread_blocked, id=280, stack(0x000000001b980000,0x000000001b9c0000)]
0x0000000019f2e000 JavaThread "http-81-Processor4" daemon
[_thread_blocked, id=4736, stack(0x000000001b940000,0x000000001b980000)]
0x0000000019f2d000 JavaThread "http-81-Processor3" daemon
[_thread_blocked, id=4260, stack(0x000000001b860000,0x000000001b8a0000)]
0x000000001a22f800 JavaThread "http-81-Processor2" daemon
[_thread_blocked, id=4996, stack(0x000000001b820000,0x000000001b860000)]
0x0000000019ec6000 JavaThread "http-81-Processor1" daemon
[_thread_blocked, id=4016, stack(0x000000001b7e0000,0x000000001b820000)]
0x000000001a6a0800 JavaThread
"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon
[_thread_blocked, id=4936, stack(0x000000001b7a0000,0x000000001b7e0000)]
0x0000000019a4f800 JavaThread "Thread-1" [_thread_in_native, id=564,
stack(0x0000000019e30000,0x0000000019e70000)]
0x00000000196fa000 JavaThread "Low Memory Detector" daemon
[_thread_blocked, id=4728, stack(0x00000000199b0000,0x00000000199f0000)]
0x00000000196eb000 JavaThread "CompilerThread1" daemon
[_thread_blocked, id=3780, stack(0x0000000019970000,0x00000000199b0000)]
0x00000000196e2000 JavaThread "CompilerThread0" daemon
[_thread_blocked, id=4124, stack(0x0000000019930000,0x0000000019970000)]
0x00000000196e0800 JavaThread "Attach Listener" daemon
[_thread_blocked, id=4988, stack(0x00000000198f0000,0x0000000019930000)]
0x000000000017f000 JavaThread "Signal Dispatcher" daemon
[_thread_blocked, id=4844, stack(0x00000000198b0000,0x00000000198f0000)]
0x0000000019695000 JavaThread "Finalizer" daemon [_thread_blocked,
id=4340, stack(0x0000000019870000,0x00000000198b0000)]
0x0000000000170000 JavaThread "Reference Handler" daemon
[_thread_blocked, id=3432, stack(0x0000000019830000,0x0000000019870000)]
0x00000000003ac000 JavaThread "main" [_thread_in_native, id=4384,
stack(0x00000000003b0000,0x00000000003f0000)]
Other Threads:
0x0000000019690800 VMThread [stack:
0x00000000197f0000,0x0000000019830000] [id=3976]
0x00000000196fb000 WatcherThread [stack:
0x00000000199f0000,0x0000000019a30000] [id=4212]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
PSYoungGen total 75200K, used 31747K [0x0000000013ef0000,
0x0000000019440000, 0x0000000019440000)
eden space 63552K, 46% used
[0x0000000013ef0000,0x0000000015c10fd0,0x0000000017d00000)
from space 11648K, 16% used
[0x0000000017d00000,0x0000000017ee0000,0x0000000018860000)
to space 11648K, 0% used
[0x00000000188e0000,0x00000000188e0000,0x0000000019440000)
PSOldGen total 174784K, used 75153K [0x0000000009440000,
0x0000000013ef0000, 0x0000000013ef0000)
object space 174784K, 42% used
[0x0000000009440000,0x000000000dda46e8,0x0000000013ef0000)
PSPermGen total 21248K, used 20419K [0x0000000004040000,
0x0000000005500000, 0x0000000009440000)
object space 21248K, 96% used
[0x0000000004040000,0x0000000005430f88,0x0000000005500000)
Dynamic libraries:
0x0000000000400000 - 0x0000000000416000 C:\Program Files\Apache
Software Foundation\Tomcat 5.5\bin\procrun\amd64\tomcat5.exe
0x0000000077580000 - 0x0000000077706000 C:\Windows\system32\ntdll.dll
0x0000000077380000 - 0x00000000774ad000 C:\Windows\system32\kernel32.dll
0x00000000774b0000 - 0x000000007757d000 C:\Windows\system32\USER32.dll
0x000007fefddf0000 - 0x000007fefde54000 C:\Windows\system32\GDI32.dll
0x000007fefe7a0000 - 0x000007fefe8a8000 C:\Windows\system32\ADVAPI32.dll
0x000007fefe620000 - 0x000007fefe763000 C:\Windows\system32\RPCRT4.dll
0x000007fefe8b0000 - 0x000007fefe94c000 C:\Windows\system32\msvcrt.dll
0x000007fefec40000 - 0x000007feff893000 C:\Windows\system32\SHELL32.dll
0x000007fefe060000 - 0x000007fefe0d3000 C:\Windows\system32\SHLWAPI.dll
0x000007fefe770000 - 0x000007fefe79d000 C:\Windows\system32\IMM32.DLL
0x000007fefeb30000 - 0x000007fefec32000 C:\Windows\system32\MSCTF.dll
0x000007fefdbd0000 - 0x000007fefdbdd000 C:\Windows\system32\LPK.DLL
0x000007fefe580000 - 0x000007fefe61a000 C:\Windows\system32\USP10.dll
0x000007fefc1b0000 - 0x000007fefc3a9000
C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.6002.18005_none_1509f8bef40ee4da\comctl32.dll
0x000000006d890000 - 0x000000006deed000 C:\Program
Files\Java\jdk1.6.0_17\jre\bin\server\jvm.dll
0x000007fefb840000 - 0x000007fefb879000 C:\Windows\system32\WINMM.dll
0x000007fefde80000 - 0x000007fefe058000 C:\Windows\system32\ole32.dll
0x000007fefe4a0000 - 0x000007fefe573000 C:\Windows\system32\OLEAUT32.dll
0x00000000756a0000 - 0x00000000756f2000 C:\Windows\system32\OLEACC.dll
0x000000006d800000 - 0x000000006d80e000 C:\Program
Files\Java\jdk1.6.0_17\jre\bin\verify.dll
0x000000006d450000 - 0x000000006d477000 C:\Program
Files\Java\jdk1.6.0_17\jre\bin\java.dll
0x000000006d3b0000 - 0x000000006d3ba000 C:\Program
Files\Java\jdk1.6.0_17\jre\bin\hpi.dll
0x0000000077720000 - 0x0000000077729000 C:\Windows\system32\PSAPI.DLL
0x000000006d850000 - 0x000000006d862000 C:\Program
Files\Java\jdk1.6.0_17\jre\bin\zip.dll
0x000000006d6a0000 - 0x000000006d6b7000 C:\Program
Files\Java\jdk1.6.0_17\jre\bin\net.dll
0x000007fefe450000 - 0x000007fefe494000 C:\Windows\system32\WS2_32.dll
0x000007fefe200000 - 0x000007fefe207000 C:\Windows\system32\NSI.dll
0x000007fefceb0000 - 0x000007fefceff000 C:\Windows\system32\mswsock.dll
0x000007fefce30000 - 0x000007fefce37000 C:\Windows\System32\wship6.dll
0x000007fefc9a0000 - 0x000007fefc9a7000 C:\Windows\System32\wshtcpip.dll
0x0000000066700000 - 0x000000006675c000 C:\Program Files\Sybase\SQL
Anywhere 9\x64\dbjodbc9.dll
0x000007fef97b0000 - 0x000007fef9821000 C:\Windows\system32\ODBC32.dll
0x000007fefae40000 - 0x000007fefaee0000
C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_5.82.6001.18000_none_40ba501d3c2b20ff\COMCTL32.dll
0x000007fefdd60000 - 0x000007fefddec000 C:\Windows\system32\COMDLG32.dll
0x0000000074130000 - 0x0000000074168000 C:\Windows\system32\odbcint.dll
0x000000006d4a0000 - 0x000000006d4b2000 C:\Program
Files\Java\jdk1.6.0_17\jre\bin\JdbcOdbc.dll
0x000000001c350000 - 0x000000001c430000 C:\Program Files\Sybase\SQL
Anywhere 9\x64\dbodbc9.dll
0x000007fefbe70000 - 0x000007fefbe79000 C:\Windows\system32\WSOCK32.dll
0x000007fefb4a0000 - 0x000007fefb4bf000 C:\Windows\system32\odbccp32.dll
0x000007fefcac0000 - 0x000007fefcacb000 C:\Windows\system32\VERSION.dll
0x0000000065000000 - 0x00000000650a6000 C:\Program Files\Sybase\SQL
Anywhere 9\x64\dblgen9.dll
0x000007fefd940000 - 0x000007fefd966000 C:\Windows\system32\USERENV.dll
0x000007fefd920000 - 0x000007fefd93c000 C:\Windows\system32\Secur32.dll
0x000007fefd0f0000 - 0x000007fefd113000 C:\Windows\system32\IpHlpApi.dll
0x000007fefd0a0000 - 0x000007fefd0e5000 C:\Windows\system32\dhcpcsvc.DLL
0x000007fefd3b0000 - 0x000007fefd3ea000 C:\Windows\system32\DNSAPI.dll
0x000007fefd7d0000 - 0x000007fefd7da000 C:\Windows\system32\WINNSI.DLL
0x000007fefd070000 - 0x000007fefd09b000 C:\Windows\system32\dhcpcsvc6.DLL
0x000007fefc8b0000 - 0x000007fefc8c3000 C:\Windows\system32\NLAapi.dll
0x000007fefb040000 - 0x000007fefb053000 C:\Windows\system32\napinsp.dll
0x000007fefb070000 - 0x000007fefb07b000 C:\Windows\System32\winrnr.dll
0x000007fefdb70000 - 0x000007fefdbc5000 C:\Windows\system32\WLDAP32.dll
0x000007fefb090000 - 0x000007fefb098000 C:\Windows\system32\rasadhlp.dll
VM Arguments:
jvm_args: -Dcatalina.base=E:\TomcatClients\Pelican
-Dcatalina.home=C:\Program Files\Apache Software Foundation\Tomcat 5.5
-Djava.endorsed.dirs=C:\Program Files\Apache Software Foundation\Tomcat
5.5\common\endorsed -Djava.io.tmpdir=E:\TomcatClients\Pelican\temp
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=C:\Program Files\Apache Software
Foundation\Tomcat 5.5\conf\logging.properties
-DWebSira.configFileName=E:\TomcatClients\Pelican\PelicanWebSIRA.properties
vfprintf -Xms256m -Xmx256m
java_command: <unknown>
Launcher Type: generic
Environment Variables:
PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Program
Files\Intel\DMIX;C:\Program Files\SAS\SharedFiles(32)\Formats;C:\Program
Files\Sybase\SQL Anywhere 9\x64;C:\Program Files\Sybase\SQL Anywhere
9\win32;C:\Program Files\Sybase\Shared\win32
USERNAME=SAS2$
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 23 Stepping 10, GenuineIntel
--------------- S Y S T E M ---------------
OS: Windows Server 2008 Build 6002 Service Pack 2
CPU:total 4 (4 cores per cpu, 1 threads per core) family 6 model 23
stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1
Memory: 4k page, physical 8381784k(4859168k free), swap
16815840k(13318972k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (14.3-b01) for windows-amd64
JRE (1.6.0_17-b04), built on Oct 11 2009 00:46:08 by "java_re" with MS
VC++ 8.0
time: Fri Mar 26 10:21:01 2010
elapsed time: 80912 seconds
On 3/22/2010 3:33 PM, Carl wrote:
> Dan,
>
> 6u18 did not work for us, crashed with the same regularity as 6u17.
> However, 6u7 has been running for two weeks without a failure (the
> others would fail between 15 minutes and 10 days runtime.)
>
> Thanks,
>
> Carl
> ----- Original Message ----- From: "Dan Armbrust"
> <da...@gmail.com>
> To: "Tomcat Users List" <us...@tomcat.apache.org>
> Sent: Monday, March 22, 2010 1:17 PM
> Subject: Re: [OT] Re: jvm exits without trace
>
>
> On Tue, Mar 16, 2010 at 4:46 PM, Carl <ca...@etrak-plus.com> wrote:
>> My approach is to get something (a JVM) that works and then gradually
>> change
>> until it breaks. Then, I know what is causing the problem. To date, I
>> haven't been able to get a JVM that works.
>>
>
> I have had a lot of issues finding stable JVMs since I moved our
> software from 1.5 to 1.6... 1.6 has been a mess for ages under our
> workload on CentOS. Code that ran fine under 1.5 would segfault in
> all sorts of random places on 1.6. I even tried the 1.7 openJDK early
> builds... they were even worse.
>
> I was pleased to see that the most recent release
> http://java.sun.com/javase/6/webnotes/6u18.html contains _tons_ of bug
> fixes, including lots of crash fixes. Seriously... the last few
> releases have contained only a handful of fixes... this release has
> hundreds.
>
> I'm testing it now, and so far, it looks promising. This may be the
> first 1.6 release that I've found that doesn't crash with my workload.
> Unfortunately, I've never been able to pin down a sequence of events
> that would cause the crash on demand, so its hard for me to verify
> that things are finally fixed, other than doing long term load testing
> and waiting for the crashes to (hopefully) not happen.
>
> Dan
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by Carl <ca...@etrak-plus.com>.
Dan,
6u18 did not work for us, crashed with the same regularity as 6u17.
However, 6u7 has been running for two weeks without a failure (the others
would fail between 15 minutes and 10 days runtime.)
Thanks,
Carl
----- Original Message -----
From: "Dan Armbrust" <da...@gmail.com>
To: "Tomcat Users List" <us...@tomcat.apache.org>
Sent: Monday, March 22, 2010 1:17 PM
Subject: Re: [OT] Re: jvm exits without trace
On Tue, Mar 16, 2010 at 4:46 PM, Carl <ca...@etrak-plus.com> wrote:
> My approach is to get something (a JVM) that works and then gradually
> change
> until it breaks. Then, I know what is causing the problem. To date, I
> haven't been able to get a JVM that works.
>
I have had a lot of issues finding stable JVMs since I moved our
software from 1.5 to 1.6... 1.6 has been a mess for ages under our
workload on CentOS. Code that ran fine under 1.5 would segfault in
all sorts of random places on 1.6. I even tried the 1.7 openJDK early
builds... they were even worse.
I was pleased to see that the most recent release
http://java.sun.com/javase/6/webnotes/6u18.html contains _tons_ of bug
fixes, including lots of crash fixes. Seriously... the last few
releases have contained only a handful of fixes... this release has
hundreds.
I'm testing it now, and so far, it looks promising. This may be the
first 1.6 release that I've found that doesn't crash with my workload.
Unfortunately, I've never been able to pin down a sequence of events
that would cause the crash on demand, so its hard for me to verify
that things are finally fixed, other than doing long term load testing
and waiting for the crashes to (hopefully) not happen.
Dan
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by Dan Armbrust <da...@gmail.com>.
On Tue, Mar 16, 2010 at 4:46 PM, Carl <ca...@etrak-plus.com> wrote:
> My approach is to get something (a JVM) that works and then gradually change
> until it breaks. Then, I know what is causing the problem. To date, I
> haven't been able to get a JVM that works.
>
I have had a lot of issues finding stable JVMs since I moved our
software from 1.5 to 1.6... 1.6 has been a mess for ages under our
workload on CentOS. Code that ran fine under 1.5 would segfault in
all sorts of random places on 1.6. I even tried the 1.7 openJDK early
builds... they were even worse.
I was pleased to see that the most recent release
http://java.sun.com/javase/6/webnotes/6u18.html contains _tons_ of bug
fixes, including lots of crash fixes. Seriously... the last few
releases have contained only a handful of fixes... this release has
hundreds.
I'm testing it now, and so far, it looks promising. This may be the
first 1.6 release that I've found that doesn't crash with my workload.
Unfortunately, I've never been able to pin down a sequence of events
that would cause the crash on demand, so its hard for me to verify
that things are finally fixed, other than doing long term load testing
and waiting for the crashes to (hopefully) not happen.
Dan
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Chuck,
On 3/15/2010 11:24 AM, Caldarale, Charles R wrote:
>> From: Christopher Schultz [mailto:chris@christopherschultz.net]
>> Subject: Re: jvm exits without trace
>>
>> On 3/15/2010 10:22 AM, Caldarale, Charles R wrote:
>>>> From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
>>>> Subject: Re: jvm exits without trace
>>>>
>>>> The cause for the crashes was in our own application code
>>>
>>> Java or native code?
>>
>> Woah, where did Taylan's initial claim come from? Was that posted
>> to the list?
>
> Not sure what you mean by "initial claim"; today's message is here:
>
> http://marc.info/?l=tomcat-user&m=126866276827939&w=2
Hmm... that particular message was flagged as spam, so it didn't appear
in the thread. :(
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkueWy4ACgkQ9CaO5/Lv0PDPsQCgqA2eI8I+vaM99b48wMIeuTIk
HxIAoLcagBb/WmBmgBtipsn+ka/48IX1
=Z//K
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Christopher Schultz [mailto:chris@christopherschultz.net]
> Subject: Re: jvm exits without trace
>
> On 3/15/2010 10:22 AM, Caldarale, Charles R wrote:
> >> From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
> >> Subject: Re: jvm exits without trace
> >>
> >> The cause for the crashes was in our own application code
> >
> > Java or native code?
>
> Woah, where did Taylan's initial claim come from? Was that posted
> to the list?
Not sure what you mean by "initial claim"; today's message is here:
http://marc.info/?l=tomcat-user&m=126866276827939&w=2
The start of the thread was on 24 Feb:
http://marc.info/?l=tomcat-user&m=126700346225034&w=2
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
Re: jvm exits without trace
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Chuck,
On 3/15/2010 10:22 AM, Caldarale, Charles R wrote:
>> From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
>> Subject: Re: jvm exits without trace
>>
>> The cause for the crashes was in our own application code
>
> Java or native code?
Woah, where did Taylan's initial claim come from? Was that posted to the
list?
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkueUDsACgkQ9CaO5/Lv0PAfgwCcCpNJf13L5+IqlQQnh7v1Qktz
x8gAmgLl64TZatGslp6S0RZ5n/boFRwj
=kq5l
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
RE: jvm exits without trace
Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Taylan Develioglu [mailto:tdevelioglu@ebuddy.com]
> Subject: Re: jvm exits without trace
>
> The cause for the crashes was in our own application code
Java or native code?
- Chuck
THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY MATERIAL and is thus for use only by the intended recipient. If you received this in error, please contact the sender and delete the e-mail and its attachments from all computers.
Re: [OT] Re: jvm exits without trace
Posted by Peter Crowther <pe...@melandra.com>.
On 17 March 2010 10:22, Taylan Develioglu <td...@ebuddy.com> wrote:
> Ofcourse this works better if I really attach the file.
>
> [...]
> Java Threads: ( => current thread )
> 0x00007f3d3c174000 JavaThread "MSN-6488" daemon [_thread_in_native,
> id=28966, stack(0x0000000042a4f000,0x0000000042a70000)]
>
[...]
Are you *absolutely sure* you pin down or copy *everything* you access from
all of your native code so that the Java garbage collector cannot move it?
- Peter
Re: [OT] Re: jvm exits without trace
Posted by Peter Crowther <pe...@melandra.com>.
On 17 March 2010 10:16, Taylan Develioglu <td...@ebuddy.com> wrote:
> Here's a hs_err file after a crash I had yesterday.
The list usually strips attachments; could you paste it?
> It's a sigsegv in GCTaskThread. From the occupation in eden it looks
> like it happened during a scavenge (ParNew).
>
> Ick. To roughly quote Dan Ingalls (who wrote several of the Smalltalk VMs,
including their garbage collectors): "studying the behaviour of objects in
the garbage collector is like studying frogs using a blender". I've tried
modifying Squeak's GC algorithm, and that pretty much sums up my
experiences!
I'd expect seg faults in a GC thread to occur if, for some reason, pointers
were getting corrupted on the stack or in the heap, or if a concurrency
issue caused a read or write to the "old" location of an object after it had
been moved. The GC is very sensitive to such things as it traces large
portions of object memory, so may well stumble across corruption before any
other thread does so.
- Peter
Re: [OT] Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
Ofcourse this works better if I really attach the file.
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x00007f3d7a350dc9, pid=27023, tid=1082939728
#
# JRE version: 6.0_18-b07
# Java VM: Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode
linux-amd64 )
# Problematic frame:
# V [libjvm.so+0x3b1dc9]
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#
--------------- T H R E A D ---------------
Current thread (0x000000004164f000): GCTaskThread [stack:
0x0000000000000000,0x0000000000000000] [id=27025]
siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR),
si_addr=0x0000000000000021
Registers:
RAX=0x00002aab1f18fc68, RBX=0x00002aab1f18fc68, RCX=0x0000000000000000,
RDX=0x0000000000000009
RSP=0x00000000408c4670, RBP=0x00000000408c46a0, RSI=0x00002aacb9f258e8,
RDI=0x0000000000000019
R8 =0x00007f3d7a8b0530, R9 =0x0000000000000012, R10=0x00002aacb9f25940,
R11=0x0000000000000002
R12=0x00002aacb9f258e8, R13=0x00007f3d5aaf1480, R14=0x00002aaac4090020,
R15=0x0000000000000001
RIP=0x00007f3d7a350dc9, EFL=0x0000000000010293,
CSGSFS=0x0000000000000033, ERR=0x0000000000000004
TRAPNO=0x000000000000000e
Top of Stack: (sp=0x00000000408c4670)
0x00000000408c4670: 01002aac9713c7c0 00002aacb9f258e8
0x00000000408c4680: 00002aacb9f258f8 00002aadaacc9b60
0x00000000408c4690: 00000000408c47d0 00000000408c4740
0x00000000408c46a0: 00000000408c46b0 00007f3d7a586f03
0x00000000408c46b0: 00000000408c4720 00007f3d7a34a18c
0x00000000408c46c0: 00000000408c4720 00002aadaacc9b68
0x00000000408c46d0: 00002aacb9f258b8 00002aadaacc9788
0x00000000408c46e0: 00002aac9713c600 0000000000000040
0x00000000408c46f0: 00000000413a5ba0 00002aacb9f258b8
0x00000000408c4700: 00007f3d7a8b0530 00007f3d522c62d0
0x00000000408c4710: 00000000408c47a0 00002aacb9f25940
0x00000000408c4720: 00000000408c4790 00007f3d7a236aff
0x00000000408c4730: 00002aadab6c1600 00000000408c47d0
0x00000000408c4740: 00002aacb9f25800 0000000000000028
0x00000000408c4750: 00002aacb9f25800 0000000000000028
0x00000000408c4760: 00002aadab6c1200 00002aacb9f259f8
0x00000000408c4770: 00002aacb9f25940 00002aacb9f25800
0x00000000408c4780: 00007f3d522c62d0 00000000408c4890
0x00000000408c4790: 00000000408c47b0 00007f3d7a236995
0x00000000408c47a0: 00002aacb9f25800 0000000000000028
0x00000000408c47b0: 00000000408c4800 00007f3d7a5ff14f
0x00000000408c47c0: 00002aacb9f25800 0000000000000028
0x00000000408c47d0: 00007f3d7a8ac0d0 00007f3d7a5feb00
0x00000000408c47e0: 00007f3d729cc320 00002aab2ac00000
0x00000000408c47f0: 00007f3d5aaf1480 00002aacb9f25800
0x00000000408c4800: 00000000408c4860 00007f3d7a5feee9
0x00000000408c4810: 00000000408c4820 00002aacb9f257f8
0x00000000408c4820: 00002aacb9f25800 0000000000000028
0x00000000408c4830: 00000000408c4860 0000000000000040
0x00000000408c4840: 00007f3d7a8a8230 00002aacb9f25800
0x00000000408c4850: 00002aacb9f25a00 00000000408c4b60
0x00000000408c4860: 00000000408c48d0 00007f3d7a1e053d
Instructions: (pc=0x00007f3d7a350dc9)
0x00007f3d7a350db9: e1 03 48 83 f9 03 0f 84 ed 00 00 00 48 8d 7a 10
0x00007f3d7a350dc9: 8b 77 08 89 f0 c1 f8 03 85 f6 0f 8e 8b 00 00 00
Stack: [0x0000000000000000,0x0000000000000000], sp=0x00000000408c4670,
free space=1023110000000000000018k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
C=native code)
V [libjvm.so+0x3b1dc9]
V [libjvm.so+0x5e7f03]
V [libjvm.so+0x3ab18c]
V [libjvm.so+0x297aff]
V [libjvm.so+0x297995]
V [libjvm.so+0x66014f]
V [libjvm.so+0x65fee9]
V [libjvm.so+0x24153d]
V [libjvm.so+0x23ffea]
V [libjvm.so+0x5e504b]
V [libjvm.so+0x5e4e98]
V [libjvm.so+0x23fdfb]
V [libjvm.so+0x240b9a]
V [libjvm.so+0x379378]
V [libjvm.so+0x2c5c5f]
V [libjvm.so+0x240a8a]
V [libjvm.so+0x36bfcd]
V [libjvm.so+0x5e82c9]
V [libjvm.so+0x722e0d]
V [libjvm.so+0x722d24]
V [libjvm.so+0x5da2af]
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x00007f3d3c174000 JavaThread "MSN-6488" daemon [_thread_in_native,
id=28966, stack(0x0000000042a4f000,0x0000000042a70000)]
0x00007f3d6146f000 JavaThread "MSN-6487" daemon [_thread_in_native,
id=28965, stack(0x00000000489d4000,0x00000000489f5000)]
0x00007f3d3cd93000 JavaThread "MSN-6486" daemon [_thread_in_native,
id=28964, stack(0x000000004725e000,0x000000004727f000)]
0x00007f3d3cf93000 JavaThread "MSN-6485" daemon [_thread_blocked,
id=28963, stack(0x000000004407b000,0x000000004409c000)]
0x00007f3d3c976000 JavaThread "MSN-6484" daemon [_thread_in_native,
id=28962, stack(0x000000004e4b5000,0x000000004e4d6000)]
0x00007f3d61f57800 JavaThread "MSN-6483" daemon [_thread_blocked,
id=28961, stack(0x000000004e011000,0x000000004e032000)]
0x00007f3d62696000 JavaThread "MSN-6482" daemon [_thread_in_native,
id=28960, stack(0x00000000465dd000,0x00000000465fe000)]
0x00007f3d5c821800 JavaThread "Queue Runner@1867613895 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28959,
stack(0x000000004dbd0000,0x000000004dbf1000)]
0x00007f3d4e68c800 JavaThread "Queue Runner@992789476 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28958,
stack(0x0000000048341000,0x0000000048362000)]
0x00007f3d3ce11800 JavaThread "LITE-13977" daemon [_thread_blocked,
id=28957, stack(0x000000004e9fe000,0x000000004ea1f000)]
0x00007f3d3cf92000 JavaThread "LITE-13976" daemon [_thread_blocked,
id=28956, stack(0x000000004700c000,0x000000004702d000)]
0x00007f3d3d8a2800 JavaThread "LITE-13975" daemon [_thread_blocked,
id=28955, stack(0x000000004d8fa000,0x000000004d91b000)]
0x00007f3d3ce34000 JavaThread "LITE-13974" daemon [_thread_blocked,
id=28954, stack(0x0000000044b4f000,0x0000000044b70000)]
0x00007f3d620d0000 JavaThread "SOCKETS-2651" daemon [_thread_blocked,
id=28953, stack(0x000000004eb06000,0x000000004eb27000)]
0x00007f3d4c05f800 JavaThread "Queue Runner@1756645158 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28952,
stack(0x0000000047090000,0x00000000470b1000)]
0x00007f3d3cb08800 JavaThread "LITE-13973" daemon [_thread_blocked,
id=28951, stack(0x000000004e032000,0x000000004e053000)]
0x00007f3d3da76800 JavaThread "MSN-6481" daemon [_thread_in_native,
id=28950, stack(0x000000004d3d2000,0x000000004d3f3000)]
0x00007f3d3c9cc000 JavaThread "SocketConnector-5" daemon
[_thread_blocked, id=28949,
stack(0x000000004517f000,0x00000000451a0000)]
0x00007f3d4d6a6800 JavaThread "Queue Runner@426498777 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28947,
stack(0x0000000045cf8000,0x0000000045d19000)]
0x00007f3d51210000 JavaThread "Queue Runner@1614696295 currentWait:
179922 shouldStop:false running:true" daemon [_thread_blocked, id=28946,
stack(0x0000000045b09000,0x0000000045b2a000)]
0x00007f3d5c777800 JavaThread "Queue Runner@737059563 currentWait:
161846 shouldStop:false running:true" daemon [_thread_blocked, id=28945,
stack(0x00000000497c0000,0x00000000497e1000)]
0x00007f3d55b2c800 JavaThread "Queue Runner@959686791 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28937,
stack(0x000000004dee8000,0x000000004df09000)]
0x00007f3d55d31800 JavaThread "Queue Runner@1407580013 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28934,
stack(0x00000000429ec000,0x0000000042a0d000)]
0x00007f3d5c760000 JavaThread "Queue Runner@52096995 currentWait:
179999 shouldStop:false running:true" daemon [_thread_blocked, id=28933,
stack(0x0000000046d15000,0x0000000046d36000)]
0x00007f3d3c1ca800 JavaThread "LITE-13972" daemon [_thread_blocked,
id=28932, stack(0x000000004449b000,0x00000000444bc000)]
0x00007f3d3ce28800 JavaThread "LITE-13971" daemon [_thread_blocked,
id=28931, stack(0x00000000452ea000,0x000000004530b000)]
0x00007f3d3cf74800 JavaThread "LITE-13970" daemon [_thread_blocked,
id=28930, stack(0x000000004e38c000,0x000000004e3ad000)]
0x00007f3d3c00b800 JavaThread "LITE-13969" daemon [_thread_blocked,
id=28929, stack(0x000000004451f000,0x0000000044540000)]
0x00007f3d3ca93800 JavaThread "LITE-13968" daemon [_thread_blocked,
id=28928, stack(0x0000000048d4f000,0x0000000048d70000)]
0x00007f3d3d8ea000 JavaThread "LITE-13967" daemon [_thread_blocked,
id=28927, stack(0x000000004e938000,0x000000004e959000)]
0x00007f3d3c5fb800 JavaThread "LITE-13966" daemon [_thread_blocked,
id=28926, stack(0x000000004ea1f000,0x000000004ea40000)]
0x00007f3d3c435000 JavaThread "LITE-13965" daemon [_thread_blocked,
id=28925, stack(0x000000004343c000,0x000000004345d000)]
0x00007f3d3c603000 JavaThread "LITE-13964" daemon [_thread_blocked,
id=28924, stack(0x0000000042d25000,0x0000000042d46000)]
0x00007f3d3c828800 JavaThread "LITE-13963" daemon [_thread_blocked,
id=28923, stack(0x0000000045a01000,0x0000000045a22000)]
0x00007f3d3cd9d800 JavaThread "LITE-13962" daemon [_thread_blocked,
id=28922, stack(0x0000000044372000,0x0000000044393000)]
0x00007f3d51d5b000 JavaThread "SOCKETS-2650" daemon [_thread_blocked,
id=28921, stack(0x0000000044627000,0x0000000044648000)]
0x00007f3d51402800 JavaThread "SOCKETS-2649" daemon [_thread_blocked,
id=28920, stack(0x0000000042d04000,0x0000000042d25000)]
0x00007f3d5a3e3800 JavaThread "MSN-6480" daemon [_thread_blocked,
id=28919, stack(0x0000000042968000,0x0000000042989000)]
0x00007f3d60b60000 JavaThread "MSN-6479" daemon [_thread_in_native,
id=28918, stack(0x00000000497e1000,0x0000000049802000)]
0x00007f3d60306800 JavaThread "MSN-6478" daemon [_thread_in_native,
id=28917, stack(0x0000000048362000,0x0000000048383000)]
0x00007f3d58a2c000 JavaThread "MSN-6477" daemon [_thread_in_native,
id=28916, stack(0x000000004dc12000,0x000000004dc33000)]
0x00007f3d6256f800 JavaThread "Queue Runner@1562959161 currentWait:
179999 shouldStop:false running:true" daemon [_thread_blocked, id=28915,
stack(0x000000004e9dd000,0x000000004e9fe000)]
0x00007f3d588f6800 JavaThread "MSN-6476" daemon [_thread_in_native,
id=28914, stack(0x00000000427fd000,0x000000004281e000)]
0x00007f3d4c2df800 JavaThread "MultiBackend-Executor-Thread-2390"
daemon [_thread_blocked, id=28913,
stack(0x000000004e17c000,0x000000004e19d000)]
0x00007f3d4d7e3800 JavaThread "MultiBackend-Executor-Thread-2389"
daemon [_thread_blocked, id=28912,
stack(0x0000000042af4000,0x0000000042b15000)]
0x00007f3d4ceca000 JavaThread "MultiBackend-Executor-Thread-2388"
daemon [_thread_blocked, id=28911,
stack(0x0000000042bfc000,0x0000000042c1d000)]
0x00007f3d4c59f800 JavaThread "MultiBackend-Executor-Thread-2387"
daemon [_thread_blocked, id=28910,
stack(0x000000004eaa3000,0x000000004eac4000)]
0x00007f3d4c4ab000 JavaThread "MultiBackend-Executor-Thread-2386"
daemon [_thread_blocked, id=28909,
stack(0x0000000043d21000,0x0000000043d42000)]
0x00007f3d4c4cd000 JavaThread "MultiBackend-Executor-Thread-2385"
daemon [_thread_blocked, id=28908,
stack(0x00000000440bd000,0x00000000440de000)]
0x00007f3d4c07c000 JavaThread "MultiBackend-Executor-Thread-2384"
daemon [_thread_blocked, id=28907,
stack(0x0000000045c95000,0x0000000045cb6000)]
0x00007f3d54562800 JavaThread "MultiBackend-Executor-Thread-2383"
daemon [_thread_blocked, id=28906,
stack(0x0000000044183000,0x00000000441a4000)]
0x00007f3d4c1d4800 JavaThread "MultiBackend-Executor-Thread-2382"
daemon [_thread_blocked, id=28905,
stack(0x000000004e6c5000,0x000000004e6e6000)]
0x00007f3d4c135800 JavaThread "MultiBackend-Executor-Thread-2381"
daemon [_thread_blocked, id=28904,
stack(0x0000000046430000,0x0000000046451000)]
0x00007f3d616fc000 JavaThread "MSN-6475" daemon [_thread_in_native,
id=28903, stack(0x0000000044606000,0x0000000044627000)]
0x00007f3d5c679800 JavaThread "Queue Runner@90149187 currentWait:
112489 shouldStop:false running:true" daemon [_thread_blocked, id=28902,
stack(0x0000000044b91000,0x0000000044bb2000)]
0x00007f3d61e2b000 JavaThread "Queue Runner@1218091229 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28900,
stack(0x000000004d2a9000,0x000000004d2ca000)]
0x00007f3d60747800 JavaThread "Queue Runner@929982501 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28899,
stack(0x000000004d4fb000,0x000000004d51c000)]
0x00007f3d3c088800 JavaThread "Queue Runner@449612109 currentWait:
179829 shouldStop:false running:true" daemon [_thread_blocked, id=28898,
stack(0x000000004640f000,0x0000000046430000)]
0x00007f3d61f1d800 JavaThread "Queue Runner@62004862 currentWait:
154375 shouldStop:false running:true" daemon [_thread_blocked, id=28755,
stack(0x000000004e959000,0x000000004e97a000)]
0x00007f3d64330000 JavaThread "Queue Runner@1614742579 currentWait:
100063 shouldStop:false running:true" daemon [_thread_blocked, id=28676,
stack(0x000000004617b000,0x000000004619c000)]
0x00007f3d590b0800 JavaThread "Queue Runner@2104928982 currentWait:
179999 shouldStop:false running:true" daemon [_thread_blocked, id=28675,
stack(0x0000000048e99000,0x0000000048eba000)]
0x00007f3d6164d000 JavaThread "Queue Runner@1921212964 currentWait:
161517 shouldStop:false running:true" daemon [_thread_blocked, id=28673,
stack(0x00000000464f6000,0x0000000046517000)]
0x00007f3d5845c800 JavaThread "Queue Runner@1722976475 currentWait:
136498 shouldStop:false running:true" daemon [_thread_blocked, id=28670,
stack(0x0000000044228000,0x0000000044249000)]
0x00007f3d61868800 JavaThread "MSN-6474" daemon [_thread_in_native,
id=28669, stack(0x000000004e683000,0x000000004e6a4000)]
0x00007f3d51160800 JavaThread "Queue Runner@1563764150 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28662,
stack(0x0000000044bd3000,0x0000000044bf4000)]
0x00007f3d503b7800 JavaThread "Queue Runner@1302795200 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28661,
stack(0x00000000462a4000,0x00000000462c5000)]
0x00007f3d4dfff800 JavaThread "Queue Runner@601980600 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28659,
stack(0x000000004daa7000,0x000000004dac8000)]
0x00007f3d620d3000 JavaThread "MSN-6473" daemon [_thread_in_native,
id=28658, stack(0x00000000471fb000,0x000000004721c000)]
0x00007f3d58dcd800 JavaThread "MSN-6472" daemon [_thread_in_native,
id=28657, stack(0x000000004d93c000,0x000000004d95d000)]
0x00007f3d61fa2000 JavaThread "MSN-6471" daemon [_thread_blocked,
id=28656, stack(0x0000000042ab2000,0x0000000042ad3000)]
0x00007f3d5931d000 JavaThread "MSN-6470" daemon [_thread_in_native,
id=28655, stack(0x00000000465fe000,0x000000004661f000)]
0x00007f3d50aab800 JavaThread "Queue Runner@1096723523 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28654,
stack(0x000000004532c000,0x000000004534d000)]
0x00007f3d3c262800 JavaThread "Queue Runner@1325372870 currentWait:
141240 shouldStop:false running:true" daemon [_thread_blocked, id=28652,
stack(0x000000004e707000,0x000000004e728000)]
0x00007f3d4ae28800 JavaThread "SOCKETS-2648" daemon
[_thread_in_native, id=28651,
stack(0x0000000046682000,0x00000000466a3000)]
0x00007f3d6041f800 JavaThread "SOCKETS-2647" daemon [_thread_blocked,
id=28650, stack(0x000000004e80f000,0x000000004e830000)]
0x00007f3d594fd800 JavaThread "MSN-6469" daemon [_thread_in_native,
id=28649, stack(0x0000000044648000,0x0000000044669000)]
0x00007f3d50a3f000 JavaThread "MSN-6468" daemon [_thread_in_native,
id=28648, stack(0x00000000468b3000,0x00000000468d4000)]
0x00007f3d3c66a000 JavaThread "LITE-13961" daemon [_thread_blocked,
id=28647, stack(0x000000004da02000,0x000000004da23000)]
0x00007f3d3ce71800 JavaThread "LITE-13960" daemon [_thread_blocked,
id=28646, stack(0x0000000044438000,0x0000000044459000)]
0x00007f3d3c7e8000 JavaThread "LITE-13958" daemon [_thread_blocked,
id=28644, stack(0x000000004e15b000,0x000000004e17c000)]
0x00007f3d3c3de000 JavaThread "LITE-13956" daemon [_thread_blocked,
id=28642, stack(0x0000000046b05000,0x0000000046b26000)]
0x00007f3d3ccf6000 JavaThread "LITE-13951" daemon [_thread_blocked,
id=28637, stack(0x000000004e2a5000,0x000000004e2c6000)]
0x00007f3d3ccc9800 JavaThread "LITE-13950" daemon [_thread_blocked,
id=28636, stack(0x00000000486bc000,0x00000000486dd000)]
0x00007f3d3cb24000 JavaThread "LITE-13949" daemon [_thread_blocked,
id=28635, stack(0x000000004d78f000,0x000000004d7b0000)]
0x00007f3d5007e000 JavaThread "Queue Runner@1841888091 currentWait:
1490 shouldStop:false running:true" daemon [_thread_blocked, id=28634,
stack(0x0000000048abb000,0x0000000048adc000)]
0x00007f3d3c91e000 JavaThread "Queue Runner@520222908 currentWait:
156396 shouldStop:false running:true" daemon [_thread_blocked, id=28628,
stack(0x000000004d435000,0x000000004d456000)]
0x00007f3d3c926000 JavaThread "Queue Runner@1437904240 currentWait:
180000 shouldStop:false running:true" daemon [_thread_blocked, id=28627,
stack(0x0000000044018000,0x0000000044039000)]
0x00007f3d3cfd4800 JavaThread "Queue Runner@1295691515 currentWait:
74357 shouldStop:false running:true" daemon [_thread_blocked, id=28626,
stack(0x0000000042d67000,0x0000000042d88000)]
0x00007f3d4c6bb800 JavaThread "MSN-6467" daemon [_thread_in_native,
id=28625, stack(0x000000004d6ea000,0x000000004d70b000)]
0x00007f3d5a430800 JavaThread "MSN-6466" daemon [_thread_in_native,
id=28624, stack(0x0000000043166000,0x0000000043187000)]
0x00007f3d3d876800 JavaThread "Queue Runner@722424347 currentWait:
144771 shouldStop:false running:true" daemon [_thread_blocked, id=28623,
stack(0x000000004e200000,0x000000004e221000)]
0x00007f3d59d76800 JavaThread "MSN-6465" daemon [_thread_in_native,
id=28621, stack(0x000000004659b000,0x00000000465bc000)]
0x00007f3d4c64c800 JavaThread "MSN-6464" daemon [_thread_in_native,
id=28620, stack(0x00000000441a4000,0x00000000441c5000)]
0x00007f3d58fee000 JavaThread "MSN-6463" daemon [_thread_in_native,
id=28619, stack(0x0000000046c2e000,0x0000000046c4f000)]
0x00007f3d3c3ce800 JavaThread "LITE-13948" daemon [_thread_blocked,
id=28618, stack(0x000000004e662000,0x000000004e683000)]
0x00007f3d3c140000 JavaThread "Queue Runner@263954072 currentWait:
179904 shouldStop:false running:true" daemon [_thread_blocked, id=28617,
stack(0x000000004e99b000,0x000000004e9bc000)]
0x00007f3d3c0bf800 JavaThread "LITE-13946" daemon [_thread_blocked,
id=28610, stack(0x0000000045cb6000,0x0000000045cd7000)]
0x00007f3d5d119800 JavaThread "SOCKETS-2646" daemon [_thread_blocked,
id=28609, stack(0x000000004dfcf000,0x000000004dff0000)]
0x00007f3d5148b000 JavaThread "SOCKETS-2645" daemon [_thread_blocked,
id=28608, stack(0x000000004d855000,0x000000004d876000)]
0x00007f3d50939000 JavaThread "SOCKETS-2640" daemon [_thread_blocked,
id=28603, stack(0x0000000046c70000,0x0000000046c91000)]
0x00007f3d516ca000 JavaThread "SOCKETS-2639" daemon [_thread_blocked,
id=28602, stack(0x000000004db6d000,0x000000004db8e000)]
0x00007f3d3c5df800 JavaThread "MultiBackend-Executor-Thread-2379"
daemon [_thread_blocked, id=28579,
stack(0x000000004347e000,0x000000004349f000)]
0x00007f3d6436e800 JavaThread "MultiBackend-Executor-Thread-2378"
daemon [_thread_blocked, id=28578,
stack(0x000000004de64000,0x000000004de85000)]
0x00007f3d3c42f800 JavaThread "MultiBackend-Executor-Thread-2376"
daemon [_thread_blocked, id=28576,
stack(0x00000000462e6000,0x0000000046307000)]
0x00007f3d62b9a000 JavaThread "MSN-6462" daemon [_thread_in_native,
id=28563, stack(0x000000004d834000,0x000000004d855000)]
0x00007f3d61d2d000 JavaThread "MSN-6461" daemon [_thread_in_native,
id=28562, stack(0x0000000048551000,0x0000000048572000)]
0x00007f3d5d542000 JavaThread "MSN-6460" daemon [_thread_in_native,
id=28561, stack(0x000000004e3ce000,0x000000004e3ef000)]
0x00007f3d3c5fe800 JavaThread "LITE-13945" daemon [_thread_blocked,
id=28559, stack(0x00000000428a2000,0x00000000428c3000)]
0x00007f3d55229800 JavaThread "MSN-6459" daemon [_thread_in_native,
id=28558, stack(0x0000000046c91000,0x0000000046cb2000)]
0x00007f3d3cd2d000 JavaThread "LITE-13944" daemon [_thread_blocked,
id=28543, stack(0x00000000451c1000,0x00000000451e2000)]
0x00007f3d3c909800 JavaThread "LITE-13943" daemon [_thread_blocked,
id=28532, stack(0x0000000048a16000,0x0000000048a37000)]
0x00007f3d3c0ec000 JavaThread "LITE-13942" daemon [_thread_blocked,
id=28531, stack(0x0000000047114000,0x0000000047135000)]
0x00007f3d3cdf6000 JavaThread "LITE-13941" daemon [_thread_blocked,
id=28530, stack(0x000000004db4c000,0x000000004db6d000)]
0x00007f3d3c4c3800 JavaThread "LITE-13940" daemon [_thread_blocked,
id=28529, stack(0x000000004428b000,0x00000000442ac000)]
0x00007f3d61885000 JavaThread "MSN-6453" daemon [_thread_in_native,
id=28525, stack(0x000000004e641000,0x000000004e662000)]
0x00007f3d61c8c000 JavaThread "MSN-6452" daemon [_thread_blocked,
id=28524, stack(0x000000004e4f7000,0x000000004e518000)]
0x00007f3d5c74c800 JavaThread "MSN-6451" daemon [_thread_in_native,
id=28522, stack(0x0000000046538000,0x0000000046559000)]
0x00007f3d57efb800 JavaThread "MSN-6450" daemon [_thread_in_native,
id=28521, stack(0x000000004dd3b000,0x000000004dd5c000)]
0x00007f3d60874800 JavaThread "MSN-6449" daemon [_thread_in_native,
id=28519, stack(0x0000000044b2e000,0x0000000044b4f000)]
0x00007f3d61c31800 JavaThread "MSN-6448" daemon [_thread_in_native,
id=28518, stack(0x000000004dc75000,0x000000004dc96000)]
0x00007f3d6167e000 JavaThread "MSN-6447" daemon [_thread_in_native,
id=28516, stack(0x000000004ea40000,0x000000004ea61000)]
0x00007f3d55cc7800 JavaThread "MSN-6445" daemon [_thread_in_native,
id=28514, stack(0x000000004e8d5000,0x000000004e8f6000)]
0x00007f3d605ed800 JavaThread "MSN-6444" daemon [_thread_in_native,
id=28455, stack(0x0000000042a91000,0x0000000042ab2000)]
0x00007f3d624a6000 JavaThread "MSN-6443" daemon [_thread_in_native,
id=28376, stack(0x0000000043397000,0x00000000433b8000)]
0x00007f3d56bcd800 JavaThread "MSN-6442" daemon [_thread_in_native,
id=28375, stack(0x00000000484ac000,0x00000000484cd000)]
0x00007f3d5c77e000 JavaThread "MSN-6441" daemon [_thread_in_native,
id=28325, stack(0x000000004d603000,0x000000004d624000)]
0x00007f3d615cb800 JavaThread "MSN-6440" daemon [_thread_in_native,
id=28268, stack(0x0000000046559000,0x000000004657a000)]
0x00007f3d51088800 JavaThread "SOCKETS-2638" daemon [_thread_blocked,
id=28265, stack(0x000000004e13a000,0x000000004e15b000)]
0x00007f3d3c0f5800 JavaThread "LITE-13936" daemon [_thread_blocked,
id=28260, stack(0x000000004595c000,0x000000004597d000)]
0x00007f3d3ccfb800 JavaThread "LITE-13935" daemon [_thread_blocked,
id=28259, stack(0x000000004871f000,0x0000000048740000)]
0x00007f3d3c434800 JavaThread "LITE-13934" daemon [_thread_blocked,
id=28258, stack(0x0000000042dca000,0x0000000042deb000)]
0x00007f3d3c301000 JavaThread "LITE-13933" daemon [_thread_blocked,
id=28257, stack(0x000000004dc33000,0x000000004dc54000)]
0x00007f3d3d06a000 JavaThread "LITE-13932" daemon [_thread_blocked,
id=28256, stack(0x000000004349f000,0x00000000434c0000)]
0x00007f3d52538800 JavaThread "SOCKETS-2637" daemon [_thread_blocked,
id=28245, stack(0x0000000048caa000,0x0000000048ccb000)]
0x00007f3d50f01000 JavaThread "SOCKETS-2636" daemon [_thread_blocked,
id=28193, stack(0x000000004e242000,0x000000004e263000)]
0x00007f3d590b6800 JavaThread "MSN-6438" daemon [_thread_in_native,
id=28191, stack(0x0000000046328000,0x0000000046349000)]
0x00007f3d62853800 JavaThread "MSN-6437" daemon [_thread_in_native,
id=28190, stack(0x0000000044669000,0x000000004468a000)]
0x00007f3d5eeda000 JavaThread "MultiBackend-Executor-Thread-2372"
daemon [_thread_blocked, id=28178,
stack(0x0000000044fd2000,0x0000000044ff3000)]
0x00007f3d5864a800 JavaThread "MSN-6433" daemon [_thread_in_native,
id=28174, stack(0x00000000485d5000,0x00000000485f6000)]
0x00007f3d52533000 JavaThread "MSN-6432" daemon [_thread_in_native,
id=28167, stack(0x0000000044459000,0x000000004447a000)]
0x00007f3d59441800 JavaThread "MSN-6431" daemon [_thread_in_native,
id=28166, stack(0x0000000048b3f000,0x0000000048b60000)]
0x00007f3d3c029800 JavaThread "LITE-13925" daemon [_thread_blocked,
id=28157, stack(0x000000004de22000,0x000000004de43000)]
0x00007f3d3cb09800 JavaThread "SOCKETS-2629" daemon [_thread_blocked,
id=28123, stack(0x000000004d8b8000,0x000000004d8d9000)]
0x00007f3d3cf2e000 JavaThread "Queue Runner@186852184 currentWait:
160941 shouldStop:false running:true" daemon [_thread_blocked, id=27875,
stack(0x000000004721c000,0x000000004723d000)]
0x00007f3d58c52800 JavaThread "MSN-6423" daemon [_thread_blocked,
id=27863, stack(0x000000004c793000,0x000000004c7b4000)]
0x00007f3d5ea1a800 JavaThread "LITE-13907" daemon [_thread_blocked,
id=27857, stack(0x00000000447d4000,0x00000000447f5000)]
0x00007f3d55716000 JavaThread "LITE-13906" daemon [_thread_blocked,
id=27856, stack(0x00000000464d5000,0x00000000464f6000)]
0x00007f3d56663800 JavaThread "LITE-13905" daemon [_thread_blocked,
id=27855, stack(0x0000000042e6f000,0x0000000042e90000)]
0x00007f3d5d2c8000 JavaThread "LITE-13904" daemon [_thread_blocked,
id=27854, stack(0x000000004d897000,0x000000004d8b8000)]
0x00007f3d4a47f800 JavaThread "LITE-13903" daemon [_thread_blocked,
id=27853, stack(0x000000004d3b1000,0x000000004d3d2000)]
0x00007f3d5cb81800 JavaThread "LITE-13902" daemon [_thread_blocked,
id=27852, stack(0x000000004df4b000,0x000000004df6c000)]
0x00007f3d5eaab800 JavaThread "LITE-13898" daemon [_thread_blocked,
id=27848, stack(0x000000004d72c000,0x000000004d74d000)]
0x00007f3d5cace000 JavaThread "LITE-13896" daemon [_thread_blocked,
id=27846, stack(0x0000000043586000,0x00000000435a7000)]
0x00007f3d6435b000 JavaThread "LITE-13895" daemon [_thread_blocked,
id=27845, stack(0x000000004da86000,0x000000004daa7000)]
0x00007f3d5c873000 JavaThread "LITE-13894" daemon [_thread_blocked,
id=27844, stack(0x0000000045d9d000,0x0000000045dbe000)]
0x00007f3d5e842800 JavaThread "LITE-13893" daemon [_thread_blocked,
id=27843, stack(0x000000004975d000,0x000000004977e000)]
0x00007f3d5eaad800 JavaThread "LITE-13892" daemon [_thread_blocked,
id=27842, stack(0x00000000446ab000,0x00000000446cc000)]
0x00007f3d5d14d800 JavaThread "LITE-13890" daemon [_thread_blocked,
id=27840, stack(0x000000004e263000,0x000000004e284000)]
0x00007f3d5c74d800 JavaThread "LITE-13889" daemon [_thread_blocked,
id=27839, stack(0x0000000048ccb000,0x0000000048cec000)]
0x00007f3d5e3cd000 JavaThread "LITE-13886" daemon [_thread_blocked,
id=27836, stack(0x0000000048428000,0x0000000048449000)]
0x00007f3d5d48c000 JavaThread "LITE-13885" daemon [_thread_blocked,
id=27835, stack(0x000000004c6ee000,0x000000004c70f000)]
0x00007f3d57579800 JavaThread "LITE-13884" daemon [_thread_blocked,
id=27834, stack(0x0000000049cc7000,0x0000000049ce8000)]
0x00007f3d5e4d4000 JavaThread "LITE-13882" daemon [_thread_blocked,
id=27832, stack(0x0000000045896000,0x00000000458b7000)]
0x00007f3d5ef33800 JavaThread "LITE-13881" daemon [_thread_blocked,
id=27831, stack(0x0000000043d00000,0x0000000043d21000)]
0x00007f3d4a35f800 JavaThread "LITE-13877" daemon [_thread_blocked,
id=27827, stack(0x000000004da65000,0x000000004da86000)]
0x00007f3d55ada000 JavaThread "LITE-13876" daemon [_thread_blocked,
id=27826, stack(0x00000000472a0000,0x00000000472c1000)]
0x00007f3d59d4e000 JavaThread "MSN-6420" daemon [_thread_in_native,
id=27820, stack(0x0000000046283000,0x00000000462a4000)]
0x00007f3d5888b800 JavaThread "MSN-6414" daemon [_thread_in_native,
id=27793, stack(0x00000000487a3000,0x00000000487c4000)]
0x00007f3d591a4800 JavaThread "MSN-6411" daemon [_thread_in_native,
id=27784, stack(0x00000000452c9000,0x00000000452ea000)]
0x00007f3d3c66a800 JavaThread "MultiBackend-Executor-Thread-2370"
daemon [_thread_blocked, id=27759,
stack(0x0000000045bae000,0x0000000045bcf000)]
0x00007f3d5eead800 JavaThread "MultiBackend-Executor-Thread-2368"
daemon [_thread_blocked, id=27756,
stack(0x0000000048449000,0x000000004846a000)]
0x00007f3d50fe7000 JavaThread "MSN-6406" daemon [_thread_in_native,
id=27754, stack(0x000000004d7b0000,0x000000004d7d1000)]
0x00007f3d50d59000 JavaThread "MSN-6404" daemon [_thread_in_native,
id=27751, stack(0x000000004d7d1000,0x000000004d7f2000)]
0x00007f3d5c1b5000 JavaThread "LITE-13868" daemon [_thread_blocked,
id=27749, stack(0x000000004dea6000,0x000000004dec7000)]
0x00007f3d5c128800 JavaThread "LITE-13861" daemon [_thread_blocked,
id=27742, stack(0x000000004c8dd000,0x000000004c8fe000)]
0x00007f3d52157000 JavaThread "MSN-6402" daemon [_thread_in_native,
id=27736, stack(0x000000004e284000,0x000000004e2a5000)]
0x00007f3d520d6000 JavaThread "MSN-6401" daemon [_thread_in_native,
id=27735, stack(0x0000000048b60000,0x0000000048b81000)]
0x00007f3d5e525000 JavaThread "LITE-13854" daemon [_thread_blocked,
id=27732, stack(0x000000004eae5000,0x000000004eb06000)]
0x00007f3d50812000 JavaThread "MSN-6397" daemon [_thread_in_native,
id=27727, stack(0x00000000445c4000,0x00000000445e5000)]
0x00007f3d524f0000 JavaThread "MSN-6391" daemon [_thread_blocked,
id=27713, stack(0x000000004de43000,0x000000004de64000)]
0x00007f3d62119800 JavaThread "LITE-13850" daemon [_thread_blocked,
id=27703, stack(0x00000000466c4000,0x00000000466e5000)]
0x00007f3d6169c000 JavaThread "LITE-13847" daemon [_thread_blocked,
id=27700, stack(0x00000000458b7000,0x00000000458d8000)]
0x00007f3d60cc4800 JavaThread "LITE-13846" daemon [_thread_blocked,
id=27699, stack(0x000000004e3ef000,0x000000004e410000)]
0x00007f3d60181800 JavaThread "LITE-13845" daemon [_thread_blocked,
id=27698, stack(0x0000000043544000,0x0000000043565000)]
0x00007f3d62b90000 JavaThread "LITE-13843" daemon [_thread_blocked,
id=27696, stack(0x0000000046706000,0x0000000046727000)]
0x00007f3d602e7000 JavaThread "LITE-13842" daemon [_thread_blocked,
id=27695, stack(0x000000004dbaf000,0x000000004dbd0000)]
0x00007f3d60bc7000 JavaThread "LITE-13840" daemon [_thread_blocked,
id=27693, stack(0x0000000043d63000,0x0000000043d84000)]
0x00007f3d60b07000 JavaThread "LITE-13839" daemon [_thread_blocked,
id=27692, stack(0x0000000046517000,0x0000000046538000)]
0x00007f3d61e38000 JavaThread "LITE-13838" daemon [_thread_blocked,
id=27691, stack(0x0000000047198000,0x00000000471b9000)]
0x00007f3d61782800 JavaThread "LITE-13836" daemon [_thread_blocked,
id=27689, stack(0x0000000048d2e000,0x0000000048d4f000)]
0x00007f3d61441800 JavaThread "LITE-13835" daemon [_thread_blocked,
id=27688, stack(0x000000004e221000,0x000000004e242000)]
0x00007f3d51652800 JavaThread "MSN-6387" daemon [_thread_blocked,
id=27684, stack(0x000000004d51c000,0x000000004d53d000)]
0x00007f3d626ea800 JavaThread "LITE-13833" daemon [_thread_blocked,
id=27683, stack(0x000000004da44000,0x000000004da65000)]
0x00007f3d60541800 JavaThread "LITE-13832" daemon [_thread_blocked,
id=27682, stack(0x0000000048afd000,0x0000000048b1e000)]
0x00007f3d4cd3c000 JavaThread "MSN-6385" daemon [_thread_in_native,
id=27680, stack(0x000000004dff0000,0x000000004e011000)]
0x00007f3d50f00800 JavaThread "Queue Runner@991748209 currentWait:
25391 shouldStop:false running:true" daemon [_thread_blocked, id=27677,
stack(0x000000004d2eb000,0x000000004d30c000)]
0x00007f3d4e670000 JavaThread "MSN-6377" daemon [_thread_blocked,
id=27664, stack(0x000000004744d000,0x000000004746e000)]
0x00007f3d4c235000 JavaThread "MSN-6376" daemon [_thread_in_native,
id=27663, stack(0x0000000042a70000,0x0000000042a91000)]
0x00007f3d4d433000 JavaThread "MSN-6375" daemon [_thread_in_native,
id=27662, stack(0x00000000459bf000,0x00000000459e0000)]
0x00007f3d4dc14800 JavaThread "MSN-6374" daemon [_thread_in_native,
id=27661, stack(0x000000004dde0000,0x000000004de01000)]
0x00007f3d4dfb7000 JavaThread "MSN-6369" daemon [_thread_in_native,
id=27656, stack(0x00000000460f7000,0x0000000046118000)]
0x00007f3d3ce6c800 JavaThread "MultiBackend-Executor-Thread-2366"
daemon [_thread_blocked, id=27651,
stack(0x0000000042860000,0x0000000042881000)]
0x00007f3d4c0b1800 JavaThread "MSN-6364" daemon [_thread_blocked,
id=27648, stack(0x000000004d204000,0x000000004d225000)]
0x00007f3d4c06f000 JavaThread "MSN-6363" daemon [_thread_in_native,
id=27647, stack(0x000000004d5a0000,0x000000004d5c1000)]
0x00007f3d61dc4000 JavaThread "LITE-13831" daemon [_thread_blocked,
id=27642, stack(0x0000000044207000,0x0000000044228000)]
0x00007f3d61a2f800 JavaThread "LITE-13829" daemon [_thread_blocked,
id=27640, stack(0x000000004d456000,0x000000004d477000)]
0x00007f3d62a8a800 JavaThread "LITE-13824" daemon [_thread_blocked,
id=27217, stack(0x000000004e2e7000,0x000000004e308000)]
0x00007f3d595d2800 JavaThread "MSN-6360" daemon [_thread_in_native,
id=26984, stack(0x00000000482de000,0x00000000482ff000)]
0x00007f3d6084c800 JavaThread "LITE-13812" daemon [_thread_blocked,
id=26965, stack(0x000000004e329000,0x000000004e34a000)]
0x00007f3d62680800 JavaThread "LITE-13810" daemon [_thread_blocked,
id=26963, stack(0x000000004eb27000,0x000000004eb48000)]
0x00007f3d58f7a000 JavaThread "LITE-13803" daemon [_thread_blocked,
id=26956, stack(0x000000004e55a000,0x000000004e57b000)]
0x00007f3d61541000 JavaThread "MSN-6353" daemon [_thread_in_native,
id=26954, stack(0x000000004dec7000,0x000000004dee8000)]
0x00007f3d5840e800 JavaThread "MSN-6349" daemon [_thread_in_native,
id=26945, stack(0x0000000046262000,0x0000000046283000)]
0x00007f3d50595800 JavaThread "LITE-13796" daemon [_thread_blocked,
id=26935, stack(0x000000004ea82000,0x000000004eaa3000)]
0x00007f3d628b1800 JavaThread "MSN-6345" daemon [_thread_in_native,
id=26925, stack(0x0000000042c80000,0x0000000042ca1000)]
0x00007f3d616fc800 JavaThread "MSN-6338" daemon [_thread_blocked,
id=26918, stack(0x000000004eac4000,0x000000004eae5000)]
0x00007f3d5a275000 JavaThread "MSN-6337" daemon [_thread_in_native,
id=26917, stack(0x0000000044a89000,0x0000000044aaa000)]
0x00007f3d511ab000 JavaThread "MSN-6332" daemon [_thread_blocked,
id=26910, stack(0x000000004da23000,0x000000004da44000)]
0x00007f3d4c63e000 JavaThread "MSN-6329" daemon [_thread_in_native,
id=26899, stack(0x000000004dae9000,0x000000004db0a000)]
0x00007f3d4c401800 JavaThread "MSN-6324" daemon [_thread_in_native,
id=26892, stack(0x000000004d645000,0x000000004d666000)]
0x00007f3d521c8800 JavaThread "MSN-6322" daemon [_thread_in_native,
id=26890, stack(0x000000004e518000,0x000000004e539000)]
0x00007f3d50231000 JavaThread "MSN-6320" daemon [_thread_in_native,
id=26888, stack(0x0000000048638000,0x0000000048659000)]
0x00007f3d4d550000 JavaThread "MSN-6319" daemon [_thread_in_native,
id=26887, stack(0x000000004dcb7000,0x000000004dcd8000)]
0x00007f3d5145f000 JavaThread "LITE-13792" daemon [_thread_blocked,
id=26879, stack(0x000000004e749000,0x000000004e76a000)]
0x00007f3d50f74800 JavaThread "LITE-13791" daemon [_thread_blocked,
id=26877, stack(0x0000000044c15000,0x0000000044c36000)]
0x00007f3d61481800 JavaThread "MSN-6313" daemon [_thread_in_native,
id=26853, stack(0x000000004615a000,0x000000004617b000)]
0x00007f3d3d5de000 JavaThread "MultiBackend-Executor-Thread-2363"
daemon [_thread_blocked, id=26848,
stack(0x00000000443f6000,0x0000000044417000)]
0x00007f3d60753800 JavaThread "MSN-6312" daemon [_thread_in_native,
id=26569, stack(0x000000004d36f000,0x000000004d390000)]
0x00007f3d4cf42000 JavaThread "LITE-13769" daemon [_thread_blocked,
id=26557, stack(0x0000000045ddf000,0x0000000045e00000)]
0x00007f3d3d7e7000 JavaThread "MultiBackend-Executor-Thread-2361"
daemon [_thread_blocked, id=26540,
stack(0x000000004973c000,0x000000004975d000)]
0x00007f3d4e32a000 JavaThread "LITE-13763" daemon [_thread_blocked,
id=26486, stack(0x0000000046118000,0x0000000046139000)]
0x00007f3d5e884800 JavaThread "SocketConnector-4" daemon
[_thread_in_native, id=26326,
stack(0x0000000048593000,0x00000000485b4000)]
0x00007f3d5e35a800 JavaThread "MultiBackend-Executor-Thread-2355"
daemon [_thread_blocked, id=26233,
stack(0x0000000046bcb000,0x0000000046bec000)]
0x00007f3d4cd15000 JavaThread "MSN-6276" daemon [_thread_in_native,
id=26199, stack(0x000000004d97e000,0x000000004d99f000)]
0x00007f3d599af000 JavaThread "MSN-6266" daemon [_thread_in_native,
id=26117, stack(0x0000000042c5f000,0x0000000042c80000)]
0x00007f3d3cb31000 JavaThread "LITE-13677" daemon [_thread_blocked,
id=26027, stack(0x000000004740b000,0x000000004742c000)]
0x00007f3d3c2b6800 JavaThread "LITE-13670" daemon [_thread_blocked,
id=26008, stack(0x0000000048a37000,0x0000000048a58000)]
0x00007f3d523e1800 JavaThread "MSN-6246" daemon [_thread_in_native,
id=25762, stack(0x000000004b9c8000,0x000000004b9e9000)]
0x00007f3d3d8a8800 JavaThread "LITE-13660" daemon [_thread_blocked,
id=25759, stack(0x0000000043fd6000,0x0000000043ff7000)]
0x00007f3d3d0c8000 JavaThread "LITE-13657" daemon [_thread_blocked,
id=25756, stack(0x0000000047177000,0x0000000047198000)]
0x00007f3d5040d800 JavaThread "MSN-6244" daemon [_thread_in_native,
id=25744, stack(0x0000000046b68000,0x0000000046b89000)]
0x00007f3d3c060000 JavaThread "LITE-13643" daemon [_thread_blocked,
id=25730, stack(0x00000000471da000,0x00000000471fb000)]
0x00007f3d3c1e0000 JavaThread "LITE-13641" daemon [_thread_blocked,
id=25728, stack(0x0000000048c89000,0x0000000048caa000)]
0x00007f3d56cb5800 JavaThread "SocketConnectorIoProcessor-7.1" daemon
[_thread_blocked, id=25684,
stack(0x000000004e893000,0x000000004e8b4000)]
0x00007f3d56256800 JavaThread "LITE-13630" daemon [_thread_blocked,
id=25655, stack(0x0000000045cd7000,0x0000000045cf8000)]
0x00007f3d3c2f3800 JavaThread "Keep-Alive-Timer" daemon
[_thread_blocked, id=25627,
stack(0x0000000047156000,0x0000000047177000)]
0x00007f3d5e403800 JavaThread "MultiBackend-Executor-Thread-2353"
daemon [_thread_blocked, id=25588,
stack(0x000000004305e000,0x000000004307f000)]
0x00007f3d3c90c800 JavaThread "MSN-6217" daemon [_thread_in_native,
id=25329, stack(0x0000000044c36000,0x0000000044c57000)]
0x00007f3d6336f800 JavaThread "LITE-13584" daemon [_thread_blocked,
id=25306, stack(0x000000004d34e000,0x000000004d36f000)]
0x00007f3d52481000 JavaThread "MSN-6213" daemon [_thread_in_native,
id=25261, stack(0x0000000042a0d000,0x0000000042a2e000)]
0x00007f3d51740000 JavaThread "MSN-6212" daemon [_thread_in_native,
id=25260, stack(0x000000004850f000,0x0000000048530000)]
0x00007f3d503a4000 JavaThread "MSN-6207" daemon [_thread_in_native,
id=25255, stack(0x000000004e410000,0x000000004e431000)]
0x00007f3d58647800 JavaThread "LITE-13535" daemon [_thread_blocked,
id=25150, stack(0x0000000043f52000,0x0000000043f73000)]
0x00007f3d3c072800 JavaThread "MSN-6195" daemon [_thread_in_native,
id=24906, stack(0x000000004e872000,0x000000004e893000)]
0x00007f3d4c197800 JavaThread "MSN-6176" daemon [_thread_in_native,
id=24858, stack(0x00000000463ac000,0x00000000463cd000)]
0x00007f3d4c119800 JavaThread "MSN-6165" daemon [_thread_in_native,
id=24842, stack(0x0000000042926000,0x0000000042947000)]
0x00007f3d59df5800 JavaThread "LITE-13524" daemon [_thread_blocked,
id=24831, stack(0x00000000429aa000,0x00000000429cb000)]
0x00007f3d5ab08800 JavaThread "LITE-13521" daemon [_thread_blocked,
id=24828, stack(0x0000000046220000,0x0000000046241000)]
0x00007f3d5628d800 JavaThread "SocketConnector-1" daemon
[_thread_blocked, id=24804,
stack(0x0000000044141000,0x0000000044162000)]
0x00007f3d50ee3000 JavaThread "MSN-6150" daemon [_thread_in_native,
id=24447, stack(0x000000004d9c0000,0x000000004d9e1000)]
0x00007f3d50596000 JavaThread "LITE-13448" daemon [_thread_blocked,
id=23705, stack(0x00000000442cd000,0x00000000442ee000)]
0x00007f3d50067000 JavaThread "MSN-6003" daemon [_thread_in_native,
id=22521, stack(0x0000000045224000,0x0000000045245000)]
0x00007f3d62d42800 JavaThread "FACEBOOK-487" daemon [_thread_blocked,
id=21688, stack(0x000000004e7ac000,0x000000004e7cd000)]
0x00007f3d61c3c000 JavaThread "FACEBOOK-486" daemon [_thread_blocked,
id=21687, stack(0x0000000048c26000,0x0000000048c47000)]
0x00007f3d61447800 JavaThread "LITE-13261" daemon [_thread_blocked,
id=21534, stack(0x0000000044561000,0x0000000044582000)]
0x00007f3d60d3f800 JavaThread "FACEBOOK-485" daemon [_thread_blocked,
id=21449, stack(0x000000004df2a000,0x000000004df4b000)]
0x00007f3d604a7000 JavaThread "FACEBOOK-484" daemon [_thread_blocked,
id=21448, stack(0x000000004e5bd000,0x000000004e5de000)]
0x00007f3d503ce000 JavaThread "LITE-12964" daemon [_thread_blocked,
id=18370, stack(0x000000004e119000,0x000000004e13a000)]
0x00007f3d4b507800 JavaThread "SocketConnectorIoProcessor-6.1" daemon
[_thread_blocked, id=17345,
stack(0x000000004e78b000,0x000000004e7ac000)]
0x00007f3d54a74800 JavaThread "SocketConnectorIoProcessor-6.0" daemon
[_thread_blocked, id=3941, stack(0x00000000466a3000,0x00000000466c4000)]
0x00007f3d5cca9000 JavaThread "FACEBOOK-482" daemon [_thread_blocked,
id=30883, stack(0x000000004e4d6000,0x000000004e4f7000)]
0x00007f3d3c270800 JavaThread "FACEBOOK-480" daemon [_thread_blocked,
id=30771, stack(0x000000004869b000,0x00000000486bc000)]
0x00007f3d4aa29800 JavaThread "FACEBOOK-479" daemon [_thread_blocked,
id=30718, stack(0x00000000473a8000,0x00000000473c9000)]
0x00007f3d3c584800 JavaThread "FACEBOOK-476" daemon [_thread_blocked,
id=30715, stack(0x000000004301c000,0x000000004303d000)]
0x00007f3d57d4b800 JavaThread "FACEBOOK-474" daemon [_thread_blocked,
id=30713, stack(0x0000000048b1e000,0x0000000048b3f000)]
0x00007f3d5ee08000 JavaThread "FACEBOOK-473" daemon [_thread_blocked,
id=30712, stack(0x0000000046748000,0x0000000046769000)]
0x00007f3d506b7800 JavaThread "YAHOO-246" daemon [_thread_blocked,
id=21864, stack(0x000000004d57f000,0x000000004d5a0000)]
0x00007f3d4cd8e000 JavaThread "File Reaper" daemon [_thread_blocked,
id=12594, stack(0x00000000452a8000,0x00000000452c9000)]
0x00007f3d4c61c000 JavaThread "AIM-25" daemon [_thread_blocked,
id=7600, stack(0x000000004591a000,0x000000004593b000)]
0x00007f3d58a75800 JavaThread "AIM-24" daemon [_thread_blocked,
id=7597, stack(0x000000004597d000,0x000000004599e000)]
0x00007f3d58df6000 JavaThread "AIM-23" daemon [_thread_blocked,
id=7590, stack(0x0000000046307000,0x0000000046328000)]
0x00007f3d591d0000 JavaThread "AIM-22" daemon [_thread_blocked,
id=7589, stack(0x000000004e074000,0x000000004e095000)]
0x00007f3d5a99f000 JavaThread "AIM-21" daemon [_thread_blocked,
id=7588, stack(0x000000004599e000,0x00000000459bf000)]
0x00007f3d58649800 JavaThread "AIM-20" daemon [_thread_blocked,
id=7587, stack(0x000000004593b000,0x000000004595c000)]
0x00007f3d599e9800 JavaThread "AIM-19" daemon [_thread_blocked,
id=7586, stack(0x000000004e452000,0x000000004e473000)]
0x00007f3d59553000 JavaThread "AIM-18" daemon [_thread_blocked,
id=7581, stack(0x0000000048320000,0x0000000048341000)]
0x00007f3d4c06d000 JavaThread "AIM-17" daemon [_thread_blocked,
id=7580, stack(0x0000000044750000,0x0000000044771000)]
0x00007f3d5005d000 JavaThread "YAHOO-245" daemon [_thread_blocked,
id=28497, stack(0x0000000046cd3000,0x0000000046cf4000)]
0x00007f3d55892800 JavaThread "YAHOO-244" daemon [_thread_blocked,
id=28480, stack(0x0000000044ea9000,0x0000000044eca000)]
0x00007f3d50e25000 JavaThread "YAHOO-242" daemon [_thread_blocked,
id=28478, stack(0x000000004e473000,0x000000004e494000)]
0x00007f3d5070c000 JavaThread "YAHOO-241" daemon [_thread_blocked,
id=28403, stack(0x0000000046727000,0x0000000046748000)]
0x00007f3d61f7f000 JavaThread "YAHOO-231" daemon [_thread_blocked,
id=26878, stack(0x000000004d8d9000,0x000000004d8fa000)]
0x00007f3d5009a800 JavaThread "YAHOO-230" daemon [_thread_blocked,
id=26813, stack(0x00000000460d6000,0x00000000460f7000)]
0x00007f3d6091f000 JavaThread "YAHOO-227" daemon [_thread_blocked,
id=25523, stack(0x00000000451a0000,0x00000000451c1000)]
0x00007f3d599fb000 JavaThread "YAHOO-220" daemon [_thread_blocked,
id=24950, stack(0x0000000046349000,0x000000004636a000)]
0x00007f3d50834000 JavaThread "YAHOO-209" daemon [_thread_blocked,
id=24474, stack(0x0000000044b70000,0x0000000044b91000)]
0x00007f3d62260000 JavaThread "http-443-10" daemon [_thread_blocked,
id=2504, stack(0x0000000048530000,0x0000000048551000)]
0x00007f3d603a6000 JavaThread "http-443-9" daemon [_thread_blocked,
id=1143, stack(0x0000000046b89000,0x0000000046baa000)]
0x00007f3d60d4e800 JavaThread "http-443-8" daemon [_thread_blocked,
id=1120, stack(0x000000004be6c000,0x000000004be8d000)]
0x00007f3d6212b000 JavaThread "http-80-800" daemon [_thread_blocked,
id=1111, stack(0x000000004d1e3000,0x000000004d204000)]
0x00007f3d60591000 JavaThread "http-80-799" daemon [_thread_blocked,
id=1110, stack(0x000000004d1c2000,0x000000004d1e3000)]
0x00007f3d5886d800 JavaThread "http-80-798" daemon [_thread_blocked,
id=1109, stack(0x000000004d1a1000,0x000000004d1c2000)]
0x00007f3d58037800 JavaThread "http-80-797" daemon [_thread_blocked,
id=1108, stack(0x000000004d180000,0x000000004d1a1000)]
0x00007f3d58035800 JavaThread "http-80-796" daemon [_thread_blocked,
id=1107, stack(0x000000004d15f000,0x000000004d180000)]
0x00007f3d61bb3800 JavaThread "http-80-795" daemon [_thread_blocked,
id=1106, stack(0x000000004d13e000,0x000000004d15f000)]
0x00007f3d58033800 JavaThread "http-80-794" daemon [_thread_blocked,
id=1105, stack(0x000000004d11d000,0x000000004d13e000)]
0x00007f3d58031800 JavaThread "http-80-793" daemon [_thread_blocked,
id=1104, stack(0x000000004d0fc000,0x000000004d11d000)]
0x00007f3d59972000 JavaThread "http-80-792" daemon [_thread_blocked,
id=1103, stack(0x000000004d0db000,0x000000004d0fc000)]
0x00007f3d61f45800 JavaThread "http-80-791" daemon [_thread_blocked,
id=1102, stack(0x000000004d0ba000,0x000000004d0db000)]
0x00007f3d59970000 JavaThread "http-80-790" daemon [_thread_blocked,
id=1101, stack(0x000000004d099000,0x000000004d0ba000)]
0x00007f3d5996e000 JavaThread "http-80-789" daemon [_thread_blocked,
id=1100, stack(0x000000004d078000,0x000000004d099000)]
0x00007f3d5996c800 JavaThread "http-80-788" daemon [_thread_blocked,
id=1099, stack(0x000000004d057000,0x000000004d078000)]
0x00007f3d588b4800 JavaThread "http-80-787" daemon [_thread_blocked,
id=1098, stack(0x000000004d036000,0x000000004d057000)]
0x00007f3d588b2800 JavaThread "http-80-786" daemon [_thread_blocked,
id=1097, stack(0x000000004d015000,0x000000004d036000)]
0x00007f3d588b0800 JavaThread "http-80-785" daemon [_thread_blocked,
id=1096, stack(0x000000004cff4000,0x000000004d015000)]
0x00007f3d5954d800 JavaThread "http-80-784" daemon [_thread_blocked,
id=1095, stack(0x000000004cfd3000,0x000000004cff4000)]
0x00007f3d5954b800 JavaThread "http-80-783" daemon [_thread_blocked,
id=1094, stack(0x000000004cfb2000,0x000000004cfd3000)]
0x00007f3d59549800 JavaThread "http-80-782" daemon [_thread_blocked,
id=1093, stack(0x000000004cf91000,0x000000004cfb2000)]
0x00007f3d59547800 JavaThread "http-80-781" daemon [_thread_blocked,
id=1092, stack(0x000000004cf70000,0x000000004cf91000)]
0x00007f3d59a14000 JavaThread "http-80-780" daemon [_thread_blocked,
id=1091, stack(0x000000004cf4f000,0x000000004cf70000)]
0x00007f3d59a12000 JavaThread "http-80-779" daemon [_thread_blocked,
id=1090, stack(0x000000004cf2e000,0x000000004cf4f000)]
0x00007f3d59a10000 JavaThread "http-80-778" daemon [_thread_blocked,
id=1089, stack(0x000000004cf0d000,0x000000004cf2e000)]
0x00007f3d591da000 JavaThread "http-80-777" daemon [_thread_blocked,
id=1088, stack(0x000000004ceec000,0x000000004cf0d000)]
0x00007f3d591d8000 JavaThread "http-80-776" daemon [_thread_in_native,
id=1087, stack(0x000000004cecb000,0x000000004ceec000)]
0x00007f3d58b4f800 JavaThread "http-80-775" daemon [_thread_blocked,
id=1086, stack(0x000000004ceaa000,0x000000004cecb000)]
0x00007f3d58b4d800 JavaThread "http-80-774" daemon [_thread_blocked,
id=1085, stack(0x000000004ce89000,0x000000004ceaa000)]
0x00007f3d5942c000 JavaThread "http-80-773" daemon [_thread_blocked,
id=1084, stack(0x000000004ce68000,0x000000004ce89000)]
0x00007f3d6212e000 JavaThread "http-80-772" daemon [_thread_blocked,
id=1083, stack(0x000000004ce47000,0x000000004ce68000)]
0x00007f3d6206f000 JavaThread "http-80-771" daemon [_thread_blocked,
id=1082, stack(0x000000004ce26000,0x000000004ce47000)]
0x00007f3d5942a000 JavaThread "http-80-770" daemon [_thread_blocked,
id=1081, stack(0x000000004ce05000,0x000000004ce26000)]
0x00007f3d588f5800 JavaThread "http-80-769" daemon [_thread_blocked,
id=1080, stack(0x000000004cde4000,0x000000004ce05000)]
0x00007f3d58daa000 JavaThread "http-80-768" daemon [_thread_blocked,
id=1078, stack(0x000000004cdc3000,0x000000004cde4000)]
0x00007f3d584e5800 JavaThread "http-80-767" daemon [_thread_blocked,
id=1077, stack(0x000000004cda2000,0x000000004cdc3000)]
0x00007f3d61fd7800 JavaThread "http-80-766" daemon [_thread_blocked,
id=1076, stack(0x000000004cd81000,0x000000004cda2000)]
0x00007f3d61fe0000 JavaThread "http-80-765" daemon [_thread_blocked,
id=1075, stack(0x000000004cd60000,0x000000004cd81000)]
0x00007f3d61c3a800 JavaThread "http-80-764" daemon [_thread_blocked,
id=1074, stack(0x000000004cd3f000,0x000000004cd60000)]
0x00007f3d61703800 JavaThread "http-80-763" daemon [_thread_blocked,
id=1073, stack(0x000000004cd1e000,0x000000004cd3f000)]
0x00007f3d61719000 JavaThread "http-80-762" daemon [_thread_blocked,
id=1072, stack(0x000000004ccfd000,0x000000004cd1e000)]
0x00007f3d625a5800 JavaThread "http-80-761" daemon [_thread_blocked,
id=1071, stack(0x000000004ccdc000,0x000000004ccfd000)]
0x00007f3d584e2800 JavaThread "http-80-760" daemon [_thread_blocked,
id=1070, stack(0x000000004ccbb000,0x000000004ccdc000)]
0x00007f3d62afe800 JavaThread "http-80-759" daemon [_thread_blocked,
id=1069, stack(0x000000004cc9a000,0x000000004ccbb000)]
0x00007f3d60746800 JavaThread "http-80-758" daemon [_thread_blocked,
id=1068, stack(0x000000004cc79000,0x000000004cc9a000)]
0x00007f3d6227b800 JavaThread "http-80-757" daemon [_thread_blocked,
id=1067, stack(0x000000004cc58000,0x000000004cc79000)]
0x00007f3d615e5000 JavaThread "http-80-756" daemon [_thread_blocked,
id=1066, stack(0x000000004cc37000,0x000000004cc58000)]
0x00007f3d62b30000 JavaThread "http-80-755" daemon [_thread_blocked,
id=1065, stack(0x000000004cc16000,0x000000004cc37000)]
0x00007f3d6005e800 JavaThread "http-80-754" daemon [_thread_blocked,
id=1064, stack(0x000000004cbf5000,0x000000004cc16000)]
0x00007f3d61804000 JavaThread "http-80-753" daemon [_thread_blocked,
id=1063, stack(0x000000004cbd4000,0x000000004cbf5000)]
0x00007f3d62a68800 JavaThread "http-80-752" daemon [_thread_blocked,
id=1062, stack(0x000000004cbb3000,0x000000004cbd4000)]
0x00007f3d620de000 JavaThread "http-80-751" daemon [_thread_blocked,
id=1061, stack(0x000000004cb92000,0x000000004cbb3000)]
0x00007f3d60998800 JavaThread "http-80-750" daemon [_thread_blocked,
id=1060, stack(0x000000004cb71000,0x000000004cb92000)]
0x00007f3d60b90000 JavaThread "http-80-749" daemon [_thread_blocked,
id=1059, stack(0x000000004cb50000,0x000000004cb71000)]
0x00007f3d62288800 JavaThread "http-80-748" daemon [_thread_blocked,
id=1058, stack(0x000000004cb2f000,0x000000004cb50000)]
0x00007f3d609c7000 JavaThread "http-80-747" daemon [_thread_blocked,
id=1057, stack(0x000000004cb0e000,0x000000004cb2f000)]
0x00007f3d60805800 JavaThread "http-80-746" daemon [_thread_blocked,
id=1056, stack(0x000000004caed000,0x000000004cb0e000)]
0x00007f3d62574800 JavaThread "http-80-745" daemon [_thread_blocked,
id=1055, stack(0x000000004cacc000,0x000000004caed000)]
0x00007f3d61ed3000 JavaThread "http-80-744" daemon [_thread_blocked,
id=1054, stack(0x000000004caab000,0x000000004cacc000)]
0x00007f3d60ba6800 JavaThread "http-80-743" daemon [_thread_blocked,
id=1053, stack(0x000000004ca8a000,0x000000004caab000)]
0x00007f3d61715000 JavaThread "http-80-742" daemon [_thread_blocked,
id=1052, stack(0x000000004ca69000,0x000000004ca8a000)]
0x00007f3d622a0000 JavaThread "http-80-741" daemon [_thread_blocked,
id=1051, stack(0x000000004ca48000,0x000000004ca69000)]
0x00007f3d6083c000 JavaThread "http-80-740" daemon [_thread_blocked,
id=1050, stack(0x000000004ca27000,0x000000004ca48000)]
0x00007f3d603e0000 JavaThread "http-80-739" daemon [_thread_blocked,
id=1049, stack(0x000000004ca06000,0x000000004ca27000)]
0x00007f3d625e6000 JavaThread "http-80-738" daemon [_thread_blocked,
id=1048, stack(0x000000004c9e5000,0x000000004ca06000)]
0x00007f3d6151b000 JavaThread "http-80-737" daemon [_thread_blocked,
id=1047, stack(0x000000004c9c4000,0x000000004c9e5000)]
0x00007f3d62032000 JavaThread "http-80-736" daemon [_thread_blocked,
id=1046, stack(0x000000004c9a3000,0x000000004c9c4000)]
0x00007f3d60cd8000 JavaThread "http-80-735" daemon [_thread_blocked,
id=1045, stack(0x000000004c982000,0x000000004c9a3000)]
0x00007f3d61856000 JavaThread "http-80-734" daemon [_thread_blocked,
id=1044, stack(0x000000004c961000,0x000000004c982000)]
0x00007f3d62555000 JavaThread "http-80-733" daemon [_thread_blocked,
id=1043, stack(0x000000004c940000,0x000000004c961000)]
0x00007f3d624a3000 JavaThread "http-80-732" daemon [_thread_blocked,
id=1042, stack(0x000000004c91f000,0x000000004c940000)]
0x00007f3d62a16800 JavaThread "http-80-731" daemon [_thread_blocked,
id=1041, stack(0x000000004c8fe000,0x000000004c91f000)]
0x00007f3d5943b000 JavaThread "http-80-730" daemon [_thread_blocked,
id=1038, stack(0x000000004c8bc000,0x000000004c8dd000)]
0x00007f3d59439000 JavaThread "http-80-729" daemon [_thread_blocked,
id=1037, stack(0x000000004c89b000,0x000000004c8bc000)]
0x00007f3d59437000 JavaThread "http-80-728" daemon [_thread_blocked,
id=1036, stack(0x000000004c87a000,0x000000004c89b000)]
0x00007f3d58487000 JavaThread "http-80-727" daemon [_thread_blocked,
id=1035, stack(0x000000004c859000,0x000000004c87a000)]
0x00007f3d58485000 JavaThread "http-80-726" daemon [_thread_blocked,
id=1034, stack(0x000000004c838000,0x000000004c859000)]
0x00007f3d58483000 JavaThread "http-80-725" daemon [_thread_blocked,
id=1033, stack(0x000000004c817000,0x000000004c838000)]
0x00007f3d58481800 JavaThread "http-80-724" daemon [_thread_blocked,
id=1032, stack(0x000000004c7f6000,0x000000004c817000)]
0x00007f3d59a15800 JavaThread "http-80-723" daemon [_thread_blocked,
id=1031, stack(0x000000004c7d5000,0x000000004c7f6000)]
0x00007f3d59579800 JavaThread "http-80-722" daemon [_thread_blocked,
id=1030, stack(0x000000004c7b4000,0x000000004c7d5000)]
0x00007f3d584e7000 JavaThread "http-80-721" daemon [_thread_blocked,
id=1021, stack(0x000000004c772000,0x000000004c793000)]
0x00007f3d6069c000 JavaThread "http-80-720" daemon [_thread_blocked,
id=1020, stack(0x000000004c751000,0x000000004c772000)]
0x00007f3d584e3800 JavaThread "http-80-719" daemon [_thread_blocked,
id=1019, stack(0x000000004c730000,0x000000004c751000)]
0x00007f3d60c96800 JavaThread "http-80-718" daemon [_thread_blocked,
id=1018, stack(0x000000004c70f000,0x000000004c730000)]
0x00007f3d59576000 JavaThread "http-80-717" daemon [_thread_blocked,
id=1016, stack(0x000000004c6cd000,0x000000004c6ee000)]
0x00007f3d604ca000 JavaThread "http-80-716" daemon [_thread_blocked,
id=1015, stack(0x000000004c6ac000,0x000000004c6cd000)]
0x00007f3d629a1800 JavaThread "http-80-715" daemon [_thread_blocked,
id=1014, stack(0x000000004c68b000,0x000000004c6ac000)]
0x00007f3d618ae800 JavaThread "http-80-714" daemon [_thread_blocked,
id=1013, stack(0x000000004c66a000,0x000000004c68b000)]
0x00007f3d59914800 JavaThread "http-80-713" daemon [_thread_blocked,
id=1012, stack(0x000000004c649000,0x000000004c66a000)]
0x00007f3d59912800 JavaThread "http-80-712" daemon [_thread_blocked,
id=1011, stack(0x000000004c628000,0x000000004c649000)]
0x00007f3d5841e800 JavaThread "http-80-711" daemon [_thread_blocked,
id=1010, stack(0x000000004c607000,0x000000004c628000)]
0x00007f3d5841c800 JavaThread "http-80-710" daemon [_thread_blocked,
id=1009, stack(0x000000004c5e6000,0x000000004c607000)]
0x00007f3d59219000 JavaThread "http-80-709" daemon [_thread_blocked,
id=1008, stack(0x000000004c5c5000,0x000000004c5e6000)]
0x00007f3d59217000 JavaThread "http-80-708" daemon [_thread_blocked,
id=1007, stack(0x000000004c5a4000,0x000000004c5c5000)]
0x00007f3d6229d000 JavaThread "http-80-707" daemon [_thread_blocked,
id=1006, stack(0x000000004c583000,0x000000004c5a4000)]
0x00007f3d58f91800 JavaThread "http-80-706" daemon [_thread_blocked,
id=1005, stack(0x000000004c562000,0x000000004c583000)]
0x00007f3d58f8f800 JavaThread "http-80-705" daemon [_thread_blocked,
id=1004, stack(0x000000004c541000,0x000000004c562000)]
0x00007f3d5856b800 JavaThread "http-80-704" daemon [_thread_blocked,
id=1003, stack(0x000000004c520000,0x000000004c541000)]
0x00007f3d5856b000 JavaThread "http-80-703" daemon [_thread_blocked,
id=997, stack(0x00000000461de000,0x00000000461ff000)]
0x00007f3d59562800 JavaThread "http-80-702" daemon [_thread_blocked,
id=996, stack(0x000000004c4ff000,0x000000004c520000)]
0x00007f3d591ca000 JavaThread "http-80-701" daemon [_thread_blocked,
id=995, stack(0x000000004c4de000,0x000000004c4ff000)]
0x00007f3d61942000 JavaThread "http-80-700" daemon [_thread_blocked,
id=994, stack(0x000000004c4bd000,0x000000004c4de000)]
0x00007f3d626b3800 JavaThread "http-80-699" daemon [_thread_blocked,
id=993, stack(0x000000004c49c000,0x000000004c4bd000)]
0x00007f3d58f94000 JavaThread "http-80-698" daemon [_thread_blocked,
id=992, stack(0x000000004c47b000,0x000000004c49c000)]
0x00007f3d61eec800 JavaThread "http-80-697" daemon [_thread_blocked,
id=991, stack(0x000000004c45a000,0x000000004c47b000)]
0x00007f3d6186c000 JavaThread "http-80-696" daemon [_thread_blocked,
id=990, stack(0x000000004c439000,0x000000004c45a000)]
0x00007f3d629c5800 JavaThread "http-80-695" daemon [_thread_blocked,
id=989, stack(0x000000004c418000,0x000000004c439000)]
0x00007f3d620a0000 JavaThread "http-80-694" daemon [_thread_blocked,
id=988, stack(0x000000004c3f7000,0x000000004c418000)]
0x00007f3d60b1c000 JavaThread "http-80-693" daemon [_thread_blocked,
id=987, stack(0x000000004c3d6000,0x000000004c3f7000)]
0x00007f3d61c9a800 JavaThread "http-80-692" daemon [_thread_blocked,
id=986, stack(0x000000004c3b5000,0x000000004c3d6000)]
0x00007f3d616ad000 JavaThread "http-80-691" daemon [_thread_blocked,
id=985, stack(0x000000004c394000,0x000000004c3b5000)]
0x00007f3d62669000 JavaThread "http-80-690" daemon [_thread_blocked,
id=984, stack(0x000000004c373000,0x000000004c394000)]
0x00007f3d606cc000 JavaThread "http-80-689" daemon [_thread_blocked,
id=983, stack(0x000000004c352000,0x000000004c373000)]
0x00007f3d62771800 JavaThread "http-80-688" daemon [_thread_blocked,
id=982, stack(0x000000004c331000,0x000000004c352000)]
0x00007f3d60a63000 JavaThread "http-80-687" daemon [_thread_in_native,
id=981, stack(0x000000004c310000,0x000000004c331000)]
0x00007f3d6204c000 JavaThread "http-80-686" daemon [_thread_blocked,
id=980, stack(0x000000004c2ef000,0x000000004c310000)]
0x00007f3d608e4000 JavaThread "http-80-685" daemon [_thread_blocked,
id=979, stack(0x000000004c2ce000,0x000000004c2ef000)]
0x00007f3d61c16800 JavaThread "http-80-684" daemon [_thread_blocked,
id=978, stack(0x000000004c2ad000,0x000000004c2ce000)]
0x00007f3d61836000 JavaThread "http-80-683" daemon [_thread_blocked,
id=977, stack(0x000000004c28c000,0x000000004c2ad000)]
0x00007f3d61bd9800 JavaThread "http-80-682" daemon [_thread_blocked,
id=976, stack(0x000000004c26b000,0x000000004c28c000)]
0x00007f3d58aa3800 JavaThread "http-80-681" daemon [_thread_blocked,
id=975, stack(0x000000004c24a000,0x000000004c26b000)]
0x00007f3d61c77800 JavaThread "http-80-680" daemon [_thread_blocked,
id=974, stack(0x000000004c229000,0x000000004c24a000)]
0x00007f3d604c0000 JavaThread "http-80-679" daemon [_thread_blocked,
id=973, stack(0x000000004c208000,0x000000004c229000)]
0x00007f3d58433800 JavaThread "http-80-678" daemon [_thread_blocked,
id=972, stack(0x000000004c1e7000,0x000000004c208000)]
0x00007f3d6252e000 JavaThread "http-80-677" daemon [_thread_blocked,
id=971, stack(0x000000004c1c6000,0x000000004c1e7000)]
0x00007f3d61582000 JavaThread "http-80-676" daemon [_thread_blocked,
id=970, stack(0x000000004c1a5000,0x000000004c1c6000)]
0x00007f3d59a88000 JavaThread "http-80-675" daemon [_thread_blocked,
id=969, stack(0x000000004c184000,0x000000004c1a5000)]
0x00007f3d61884000 JavaThread "http-80-674" daemon [_thread_blocked,
id=968, stack(0x000000004c163000,0x000000004c184000)]
0x00007f3d60d46800 JavaThread "http-80-673" daemon [_thread_blocked,
id=967, stack(0x000000004c142000,0x000000004c163000)]
0x00007f3d60a12800 JavaThread "http-80-672" daemon [_thread_blocked,
id=966, stack(0x000000004c121000,0x000000004c142000)]
0x00007f3d591cf000 JavaThread "http-80-671" daemon [_thread_blocked,
id=965, stack(0x000000004c100000,0x000000004c121000)]
0x00007f3d58402800 JavaThread "http-80-670" daemon [_thread_blocked,
id=964, stack(0x000000004c0df000,0x000000004c100000)]
0x00007f3d608f5800 JavaThread "http-80-669" daemon [_thread_blocked,
id=963, stack(0x000000004c0be000,0x000000004c0df000)]
0x00007f3d607da000 JavaThread "http-80-668" daemon [_thread_blocked,
id=962, stack(0x000000004c09d000,0x000000004c0be000)]
0x00007f3d59a81000 JavaThread "http-80-667" daemon [_thread_blocked,
id=961, stack(0x000000004c07c000,0x000000004c09d000)]
0x00007f3d59573800 JavaThread "http-80-666" daemon [_thread_blocked,
id=960, stack(0x000000004c05b000,0x000000004c07c000)]
0x00007f3d62985000 JavaThread "http-80-665" daemon [_thread_blocked,
id=959, stack(0x000000004c03a000,0x000000004c05b000)]
0x00007f3d61c80800 JavaThread "http-80-664" daemon [_thread_blocked,
id=958, stack(0x000000004c019000,0x000000004c03a000)]
0x00007f3d62525000 JavaThread "http-80-663" daemon [_thread_blocked,
id=957, stack(0x000000004bff8000,0x000000004c019000)]
0x00007f3d6250a800 JavaThread "http-80-662" daemon [_thread_blocked,
id=956, stack(0x000000004bfd7000,0x000000004bff8000)]
0x00007f3d6156d000 JavaThread "http-80-661" daemon [_thread_blocked,
id=955, stack(0x000000004bfb6000,0x000000004bfd7000)]
0x00007f3d61e3d800 JavaThread "http-80-660" daemon [_thread_blocked,
id=954, stack(0x000000004bf95000,0x000000004bfb6000)]
0x00007f3d60a58800 JavaThread "http-80-659" daemon [_thread_blocked,
id=953, stack(0x000000004bf74000,0x000000004bf95000)]
0x00007f3d6265d800 JavaThread "http-80-658" daemon [_thread_blocked,
id=952, stack(0x000000004bf53000,0x000000004bf74000)]
0x00007f3d58efd000 JavaThread "http-80-657" daemon [_thread_blocked,
id=951, stack(0x000000004bf32000,0x000000004bf53000)]
0x00007f3d6203d800 JavaThread "http-80-656" daemon [_thread_blocked,
id=950, stack(0x000000004bf11000,0x000000004bf32000)]
0x00007f3d607b7800 JavaThread "http-80-655" daemon [_thread_blocked,
id=949, stack(0x000000004bef0000,0x000000004bf11000)]
0x00007f3d59960000 JavaThread "http-80-654" daemon [_thread_blocked,
id=948, stack(0x000000004becf000,0x000000004bef0000)]
0x00007f3d58451800 JavaThread "http-80-653" daemon [_thread_blocked,
id=947, stack(0x000000004beae000,0x000000004becf000)]
0x00007f3d58c58000 JavaThread "http-80-652" daemon [_thread_blocked,
id=946, stack(0x000000004be8d000,0x000000004beae000)]
0x00007f3d60205800 JavaThread "http-80-651" daemon [_thread_blocked,
id=944, stack(0x000000004be4b000,0x000000004be6c000)]
0x00007f3d61545800 JavaThread "http-80-650" daemon [_thread_blocked,
id=943, stack(0x000000004be2a000,0x000000004be4b000)]
0x00007f3d61e38800 JavaThread "http-80-649" daemon [_thread_blocked,
id=942, stack(0x000000004be09000,0x000000004be2a000)]
0x00007f3d59565000 JavaThread "http-80-648" daemon [_thread_blocked,
id=941, stack(0x000000004bde8000,0x000000004be09000)]
0x00007f3d6208b800 JavaThread "http-80-647" daemon [_thread_blocked,
id=940, stack(0x000000004bdc7000,0x000000004bde8000)]
0x00007f3d62987800 JavaThread "http-80-646" daemon [_thread_blocked,
id=939, stack(0x000000004bda6000,0x000000004bdc7000)]
0x00007f3d60920000 JavaThread "http-80-645" daemon [_thread_blocked,
id=938, stack(0x000000004bd85000,0x000000004bda6000)]
0x00007f3d61c8c800 JavaThread "http-80-644" daemon [_thread_blocked,
id=937, stack(0x000000004bd64000,0x000000004bd85000)]
0x00007f3d59560000 JavaThread "http-80-643" daemon [_thread_blocked,
id=936, stack(0x000000004bd43000,0x000000004bd64000)]
0x00007f3d58aa6800 JavaThread "http-80-642" daemon [_thread_blocked,
id=935, stack(0x000000004bd22000,0x000000004bd43000)]
0x00007f3d58aa5000 JavaThread "http-80-641" daemon [_thread_blocked,
id=934, stack(0x000000004bd01000,0x000000004bd22000)]
0x00007f3d615da000 JavaThread "http-80-640" daemon [_thread_blocked,
id=933, stack(0x000000004bce0000,0x000000004bd01000)]
0x00007f3d58aa2000 JavaThread "http-80-639" daemon [_thread_blocked,
id=932, stack(0x000000004bcbf000,0x000000004bce0000)]
0x00007f3d5921d000 JavaThread "http-80-638" daemon [_thread_blocked,
id=931, stack(0x000000004bc9e000,0x000000004bcbf000)]
0x00007f3d5921b800 JavaThread "http-80-637" daemon [_thread_blocked,
id=930, stack(0x000000004bc7d000,0x000000004bc9e000)]
0x00007f3d5921b000 JavaThread "http-80-636" daemon [_thread_in_native,
id=929, stack(0x000000004a318000,0x000000004a339000)]
0x00007f3d591cc800 JavaThread "http-80-635" daemon [_thread_blocked,
id=928, stack(0x000000004bc5c000,0x000000004bc7d000)]
0x00007f3d591cb000 JavaThread "http-80-634" daemon [_thread_blocked,
id=927, stack(0x000000004bc3b000,0x000000004bc5c000)]
0x00007f3d590d3000 JavaThread "http-80-633" daemon [_thread_blocked,
id=925, stack(0x000000004bbf9000,0x000000004bc1a000)]
0x00007f3d590d1000 JavaThread "http-80-632" daemon [_thread_blocked,
id=924, stack(0x000000004bbd8000,0x000000004bbf9000)]
0x00007f3d599ef800 JavaThread "http-80-631" daemon [_thread_blocked,
id=923, stack(0x000000004bbb7000,0x000000004bbd8000)]
0x00007f3d599ed800 JavaThread "http-80-630" daemon [_thread_blocked,
id=922, stack(0x000000004bb96000,0x000000004bbb7000)]
0x00007f3d599eb800 JavaThread "http-80-629" daemon [_thread_blocked,
id=921, stack(0x000000004bb75000,0x000000004bb96000)]
0x00007f3d599ea800 JavaThread "http-80-628" daemon [_thread_blocked,
id=920, stack(0x000000004bb54000,0x000000004bb75000)]
0x00007f3d584cf000 JavaThread "http-80-627" daemon [_thread_blocked,
id=919, stack(0x000000004bb33000,0x000000004bb54000)]
0x00007f3d584cd000 JavaThread "http-80-626" daemon [_thread_blocked,
id=918, stack(0x000000004bb12000,0x000000004bb33000)]
0x00007f3d6162d000 JavaThread "http-80-625" daemon [_thread_blocked,
id=917, stack(0x000000004baf1000,0x000000004bb12000)]
0x00007f3d608f1800 JavaThread "http-80-624" daemon [_thread_blocked,
id=916, stack(0x000000004bad0000,0x000000004baf1000)]
0x00007f3d605fc800 JavaThread "http-80-623" daemon [_thread_blocked,
id=915, stack(0x000000004baaf000,0x000000004bad0000)]
0x00007f3d584cb800 JavaThread "http-80-622" daemon [_thread_blocked,
id=914, stack(0x000000004ba8e000,0x000000004baaf000)]
0x00007f3d59203800 JavaThread "http-80-621" daemon [_thread_blocked,
id=912, stack(0x000000004ba6d000,0x000000004ba8e000)]
0x00007f3d603c3000 JavaThread "http-80-620" daemon [_thread_blocked,
id=911, stack(0x000000004ba4c000,0x000000004ba6d000)]
0x00007f3d59201800 JavaThread "http-80-619" daemon [_thread_blocked,
id=910, stack(0x000000004ba2b000,0x000000004ba4c000)]
0x00007f3d5900d800 JavaThread "http-80-618" daemon [_thread_blocked,
id=908, stack(0x000000004b9e9000,0x000000004ba0a000)]
0x00007f3d607fb000 JavaThread "http-80-617" daemon [_thread_blocked,
id=906, stack(0x000000004b9a7000,0x000000004b9c8000)]
0x00007f3d59008800 JavaThread "http-80-616" daemon [_thread_blocked,
id=905, stack(0x000000004b986000,0x000000004b9a7000)]
0x00007f3d60278800 JavaThread "http-80-615" daemon [_thread_blocked,
id=904, stack(0x000000004b965000,0x000000004b986000)]
0x00007f3d60230800 JavaThread "http-80-614" daemon [_thread_blocked,
id=903, stack(0x000000004b944000,0x000000004b965000)]
0x00007f3d5990e800 JavaThread "http-80-613" daemon [_thread_blocked,
id=902, stack(0x000000004b923000,0x000000004b944000)]
0x00007f3d601b8800 JavaThread "http-80-612" daemon [_thread_blocked,
id=901, stack(0x000000004b902000,0x000000004b923000)]
0x00007f3d60200000 JavaThread "http-80-611" daemon [_thread_blocked,
id=900, stack(0x000000004b8e1000,0x000000004b902000)]
0x00007f3d6048f000 JavaThread "http-80-610" daemon [_thread_blocked,
id=899, stack(0x000000004b8c0000,0x000000004b8e1000)]
0x00007f3d5990c800 JavaThread "http-80-609" daemon [_thread_blocked,
id=898, stack(0x000000004b89f000,0x000000004b8c0000)]
0x00007f3d619d9800 JavaThread "http-80-608" daemon [_thread_blocked,
id=897, stack(0x000000004b87e000,0x000000004b89f000)]
0x00007f3d5990b000 JavaThread "http-80-607" daemon [_thread_in_native,
id=896, stack(0x000000004b85d000,0x000000004b87e000)]
0x00007f3d61e30800 JavaThread "http-80-606" daemon [_thread_blocked,
id=895, stack(0x000000004b83c000,0x000000004b85d000)]
0x00007f3d5a3e1800 JavaThread "http-80-605" daemon [_thread_blocked,
id=894, stack(0x000000004b81b000,0x000000004b83c000)]
0x00007f3d619c9800 JavaThread "http-80-604" daemon [_thread_blocked,
id=893, stack(0x000000004b7fa000,0x000000004b81b000)]
0x00007f3d5a3df800 JavaThread "http-80-603" daemon [_thread_blocked,
id=892, stack(0x000000004b7d9000,0x000000004b7fa000)]
0x00007f3d62b2a000 JavaThread "http-80-602" daemon [_thread_blocked,
id=891, stack(0x000000004b7b8000,0x000000004b7d9000)]
0x00007f3d618fe800 JavaThread "http-80-601" daemon [_thread_blocked,
id=890, stack(0x000000004b797000,0x000000004b7b8000)]
0x00007f3d58e23800 JavaThread "http-80-600" daemon [_thread_blocked,
id=889, stack(0x000000004b776000,0x000000004b797000)]
0x00007f3d58e21800 JavaThread "http-80-599" daemon [_thread_blocked,
id=888, stack(0x000000004b755000,0x000000004b776000)]
0x00007f3d58e1f800 JavaThread "http-80-598" daemon [_thread_blocked,
id=887, stack(0x000000004b734000,0x000000004b755000)]
0x00007f3d6259e000 JavaThread "http-80-597" daemon [_thread_blocked,
id=886, stack(0x000000004b713000,0x000000004b734000)]
0x00007f3d59964000 JavaThread "http-80-596" daemon [_thread_blocked,
id=885, stack(0x000000004b6f2000,0x000000004b713000)]
0x00007f3d60cb5000 JavaThread "http-80-595" daemon [_thread_blocked,
id=884, stack(0x000000004b6d1000,0x000000004b6f2000)]
0x00007f3d6010d000 JavaThread "http-80-594" daemon [_thread_blocked,
id=883, stack(0x000000004b6b0000,0x000000004b6d1000)]
0x00007f3d59962000 JavaThread "http-80-593" daemon [_thread_blocked,
id=882, stack(0x000000004b68f000,0x000000004b6b0000)]
0x00007f3d59a98800 JavaThread "http-80-592" daemon [_thread_blocked,
id=881, stack(0x000000004b66e000,0x000000004b68f000)]
0x00007f3d61bb5000 JavaThread "http-80-591" daemon [_thread_blocked,
id=880, stack(0x000000004b64d000,0x000000004b66e000)]
0x00007f3d60353000 JavaThread "http-80-590" daemon [_thread_blocked,
id=879, stack(0x000000004b62c000,0x000000004b64d000)]
0x00007f3d608e8800 JavaThread "http-80-589" daemon [_thread_blocked,
id=878, stack(0x000000004b60b000,0x000000004b62c000)]
0x00007f3d60b20800 JavaThread "http-80-588" daemon [_thread_blocked,
id=877, stack(0x000000004b5ea000,0x000000004b60b000)]
0x00007f3d60d22000 JavaThread "http-80-587" daemon [_thread_blocked,
id=876, stack(0x000000004b5c9000,0x000000004b5ea000)]
0x00007f3d607e0800 JavaThread "http-80-586" daemon [_thread_blocked,
id=875, stack(0x000000004b5a8000,0x000000004b5c9000)]
0x00007f3d6094a800 JavaThread "http-80-585" daemon [_thread_blocked,
id=874, stack(0x000000004b587000,0x000000004b5a8000)]
0x00007f3d616e5000 JavaThread "http-80-584" daemon [_thread_blocked,
id=873, stack(0x000000004b566000,0x000000004b587000)]
0x00007f3d58c9f800 JavaThread "http-80-583" daemon [_thread_blocked,
id=872, stack(0x000000004b545000,0x000000004b566000)]
0x00007f3d5a3f0800 JavaThread "http-80-582" daemon [_thread_blocked,
id=871, stack(0x000000004b524000,0x000000004b545000)]
0x00007f3d6227f800 JavaThread "http-80-581" daemon [_thread_blocked,
id=870, stack(0x000000004b503000,0x000000004b524000)]
0x00007f3d60752800 JavaThread "http-80-580" daemon [_thread_blocked,
id=868, stack(0x000000004b4e2000,0x000000004b503000)]
0x00007f3d6024a800 JavaThread "http-80-579" daemon [_thread_blocked,
id=867, stack(0x000000004b4c1000,0x000000004b4e2000)]
0x00007f3d5856d000 JavaThread "http-80-578" daemon [_thread_blocked,
id=866, stack(0x000000004b4a0000,0x000000004b4c1000)]
0x00007f3d6011f000 JavaThread "http-80-577" daemon [_thread_blocked,
id=865, stack(0x000000004b47f000,0x000000004b4a0000)]
0x00007f3d608a1800 JavaThread "http-80-576" daemon [_thread_blocked,
id=864, stack(0x000000004b45e000,0x000000004b47f000)]
0x00007f3d6059d000 JavaThread "http-80-575" daemon [_thread_blocked,
id=863, stack(0x000000004b43d000,0x000000004b45e000)]
0x00007f3d60a22000 JavaThread "http-80-574" daemon [_thread_blocked,
id=862, stack(0x000000004b41c000,0x000000004b43d000)]
0x00007f3d59968000 JavaThread "http-80-573" daemon [_thread_blocked,
id=861, stack(0x000000004b3fb000,0x000000004b41c000)]
0x00007f3d61668800 JavaThread "http-80-572" daemon [_thread_blocked,
id=860, stack(0x000000004b3da000,0x000000004b3fb000)]
0x00007f3d605e4800 JavaThread "http-80-571" daemon [_thread_blocked,
id=859, stack(0x000000004b3b9000,0x000000004b3da000)]
0x00007f3d60cee000 JavaThread "http-80-570" daemon [_thread_blocked,
id=858, stack(0x000000004b398000,0x000000004b3b9000)]
0x00007f3d60be0800 JavaThread "http-80-569" daemon [_thread_blocked,
id=857, stack(0x000000004b377000,0x000000004b398000)]
0x00007f3d60d06800 JavaThread "http-80-568" daemon [_thread_blocked,
id=856, stack(0x000000004b356000,0x000000004b377000)]
0x00007f3d60189000 JavaThread "http-80-567" daemon [_thread_blocked,
id=855, stack(0x000000004b335000,0x000000004b356000)]
0x00007f3d62528800 JavaThread "http-80-566" daemon [_thread_blocked,
id=854, stack(0x000000004b314000,0x000000004b335000)]
0x00007f3d59966000 JavaThread "http-80-565" daemon [_thread_blocked,
id=853, stack(0x000000004b2f3000,0x000000004b314000)]
0x00007f3d62274000 JavaThread "http-80-564" daemon [_thread_blocked,
id=852, stack(0x000000004b2d2000,0x000000004b2f3000)]
0x00007f3d589c8000 JavaThread "http-80-563" daemon [_thread_blocked,
id=851, stack(0x000000004b2b1000,0x000000004b2d2000)]
0x00007f3d61504000 JavaThread "http-80-562" daemon [_thread_blocked,
id=850, stack(0x000000004b290000,0x000000004b2b1000)]
0x00007f3d589c7000 JavaThread "http-80-561" daemon [_thread_blocked,
id=849, stack(0x000000004b26f000,0x000000004b290000)]
0x00007f3d61e1b000 JavaThread "http-80-560" daemon [_thread_blocked,
id=848, stack(0x000000004b24e000,0x000000004b26f000)]
0x00007f3d616b8000 JavaThread "http-80-559" daemon [_thread_blocked,
id=847, stack(0x000000004b22d000,0x000000004b24e000)]
0x00007f3d6252c000 JavaThread "http-80-558" daemon [_thread_blocked,
id=846, stack(0x000000004b20c000,0x000000004b22d000)]
0x00007f3d61c8f800 JavaThread "http-80-557" daemon [_thread_blocked,
id=845, stack(0x000000004b1eb000,0x000000004b20c000)]
0x00007f3d58f01800 JavaThread "http-80-556" daemon [_thread_blocked,
id=844, stack(0x000000004b1ca000,0x000000004b1eb000)]
0x00007f3d58eff800 JavaThread "http-80-555" daemon [_thread_blocked,
id=841, stack(0x000000004b1a9000,0x000000004b1ca000)]
0x00007f3d58efe000 JavaThread "http-80-554" daemon [_thread_blocked,
id=840, stack(0x000000004b188000,0x000000004b1a9000)]
0x00007f3d5900e800 JavaThread "http-80-553" daemon [_thread_blocked,
id=839, stack(0x000000004b167000,0x000000004b188000)]
0x00007f3d58e1e800 JavaThread "http-80-552" daemon [_thread_blocked,
id=838, stack(0x000000004b146000,0x000000004b167000)]
0x00007f3d59c5a800 JavaThread "http-80-551" daemon [_thread_blocked,
id=834, stack(0x000000004b104000,0x000000004b125000)]
0x00007f3d59c57000 JavaThread "http-80-550" daemon [_thread_blocked,
id=833, stack(0x000000004b0e3000,0x000000004b104000)]
0x00007f3d59a9c000 JavaThread "http-80-549" daemon [_thread_blocked,
id=832, stack(0x000000004b0c2000,0x000000004b0e3000)]
0x00007f3d60472000 JavaThread "http-80-548" daemon [_thread_blocked,
id=831, stack(0x000000004b0a1000,0x000000004b0c2000)]
0x00007f3d59a9a000 JavaThread "http-80-547" daemon [_thread_blocked,
id=830, stack(0x000000004b080000,0x000000004b0a1000)]
0x00007f3d6209b000 JavaThread "http-80-546" daemon [_thread_blocked,
id=829, stack(0x000000004b05f000,0x000000004b080000)]
0x00007f3d61885800 JavaThread "http-80-545" daemon [_thread_blocked,
id=828, stack(0x000000004b03e000,0x000000004b05f000)]
0x00007f3d59a96000 JavaThread "http-80-544" daemon [_thread_blocked,
id=827, stack(0x000000004b01d000,0x000000004b03e000)]
0x00007f3d5956a800 JavaThread "http-80-543" daemon [_thread_blocked,
id=826, stack(0x000000004affc000,0x000000004b01d000)]
0x00007f3d59569000 JavaThread "http-80-542" daemon [_thread_blocked,
id=825, stack(0x000000004afdb000,0x000000004affc000)]
0x00007f3d60530000 JavaThread "http-80-541" daemon [_thread_blocked,
id=824, stack(0x000000004afba000,0x000000004afdb000)]
0x00007f3d59566800 JavaThread "http-80-540" daemon [_thread_blocked,
id=823, stack(0x000000004af99000,0x000000004afba000)]
0x00007f3d6266d000 JavaThread "http-80-539" daemon [_thread_blocked,
id=822, stack(0x000000004af78000,0x000000004af99000)]
0x00007f3d58406000 JavaThread "http-80-538" daemon [_thread_blocked,
id=821, stack(0x000000004af57000,0x000000004af78000)]
0x00007f3d61484800 JavaThread "http-80-537" daemon [_thread_blocked,
id=820, stack(0x000000004af36000,0x000000004af57000)]
0x00007f3d60336800 JavaThread "http-80-536" daemon [_thread_blocked,
id=819, stack(0x000000004af15000,0x000000004af36000)]
0x00007f3d621d3000 JavaThread "http-80-535" daemon [_thread_blocked,
id=818, stack(0x000000004aef4000,0x000000004af15000)]
0x00007f3d59581000 JavaThread "http-80-534" daemon [_thread_blocked,
id=817, stack(0x000000004aed3000,0x000000004aef4000)]
0x00007f3d5957f000 JavaThread "http-80-533" daemon [_thread_blocked,
id=816, stack(0x000000004aeb2000,0x000000004aed3000)]
0x00007f3d629e5000 JavaThread "http-80-532" daemon [_thread_blocked,
id=815, stack(0x000000004ae91000,0x000000004aeb2000)]
0x00007f3d5957d000 JavaThread "http-80-531" daemon [_thread_blocked,
id=814, stack(0x000000004ae70000,0x000000004ae91000)]
0x00007f3d61846000 JavaThread "http-80-530" daemon [_thread_blocked,
id=813, stack(0x000000004ae4f000,0x000000004ae70000)]
0x00007f3d619dd000 JavaThread "http-80-529" daemon [_thread_blocked,
id=812, stack(0x000000004ae2e000,0x000000004ae4f000)]
0x00007f3d62603800 JavaThread "http-80-528" daemon [_thread_blocked,
id=811, stack(0x000000004ae0d000,0x000000004ae2e000)]
0x00007f3d60a94000 JavaThread "http-80-527" daemon [_thread_blocked,
id=810, stack(0x000000004adec000,0x000000004ae0d000)]
0x00007f3d6257c800 JavaThread "http-80-526" daemon [_thread_blocked,
id=809, stack(0x000000004adcb000,0x000000004adec000)]
0x00007f3d60952800 JavaThread "http-80-525" daemon [_thread_blocked,
id=808, stack(0x000000004adaa000,0x000000004adcb000)]
0x00007f3d60b28000 JavaThread "http-80-524" daemon [_thread_blocked,
id=807, stack(0x000000004ad89000,0x000000004adaa000)]
0x00007f3d6096d000 JavaThread "http-80-523" daemon [_thread_blocked,
id=806, stack(0x000000004ad68000,0x000000004ad89000)]
0x00007f3d6092b800 JavaThread "http-80-522" daemon [_thread_blocked,
id=805, stack(0x000000004ad47000,0x000000004ad68000)]
0x00007f3d605ab000 JavaThread "http-80-521" daemon [_thread_blocked,
id=804, stack(0x000000004ad26000,0x000000004ad47000)]
0x00007f3d6279d800 JavaThread "http-80-520" daemon [_thread_blocked,
id=803, stack(0x000000004ad05000,0x000000004ad26000)]
0x00007f3d6180c000 JavaThread "http-80-519" daemon [_thread_blocked,
id=802, stack(0x000000004ace4000,0x000000004ad05000)]
0x00007f3d5957b800 JavaThread "http-80-518" daemon [_thread_blocked,
id=801, stack(0x000000004acc3000,0x000000004ace4000)]
0x00007f3d61850000 JavaThread "http-80-517" daemon [_thread_blocked,
id=800, stack(0x000000004aca2000,0x000000004acc3000)]
0x00007f3d61853000 JavaThread "http-80-516" daemon [_thread_blocked,
id=799, stack(0x000000004ac81000,0x000000004aca2000)]
0x00007f3d62514000 JavaThread "http-80-515" daemon [_thread_blocked,
id=798, stack(0x000000004ac60000,0x000000004ac81000)]
0x00007f3d59491800 JavaThread "http-80-514" daemon [_thread_blocked,
id=797, stack(0x000000004ac3f000,0x000000004ac60000)]
0x00007f3d59490000 JavaThread "http-80-513" daemon [_thread_blocked,
id=796, stack(0x000000004ac1e000,0x000000004ac3f000)]
0x00007f3d5a8fa800 JavaThread "http-80-512" daemon [_thread_blocked,
id=795, stack(0x000000004abfd000,0x000000004ac1e000)]
0x00007f3d5a8f8800 JavaThread "http-80-511" daemon [_thread_blocked,
id=794, stack(0x000000004abdc000,0x000000004abfd000)]
0x00007f3d5899d000 JavaThread "http-80-510" daemon [_thread_blocked,
id=793, stack(0x000000004abbb000,0x000000004abdc000)]
0x00007f3d5899b800 JavaThread "http-80-509" daemon [_thread_blocked,
id=792, stack(0x000000004ab9a000,0x000000004abbb000)]
0x00007f3d58045800 JavaThread "http-80-508" daemon [_thread_blocked,
id=791, stack(0x000000004ab79000,0x000000004ab9a000)]
0x00007f3d58043800 JavaThread "http-80-507" daemon [_thread_blocked,
id=790, stack(0x000000004ab58000,0x000000004ab79000)]
0x00007f3d593e8800 JavaThread "http-80-506" daemon [_thread_blocked,
id=789, stack(0x000000004ab37000,0x000000004ab58000)]
0x00007f3d588f9800 JavaThread "http-80-505" daemon [_thread_blocked,
id=788, stack(0x000000004ab16000,0x000000004ab37000)]
0x00007f3d588f7800 JavaThread "http-80-504" daemon [_thread_blocked,
id=787, stack(0x000000004aaf5000,0x000000004ab16000)]
0x00007f3d594a7000 JavaThread "http-80-503" daemon [_thread_blocked,
id=786, stack(0x000000004aad4000,0x000000004aaf5000)]
0x00007f3d58a7e800 JavaThread "http-80-502" daemon [_thread_blocked,
id=785, stack(0x000000004aab3000,0x000000004aad4000)]
0x00007f3d58a7c800 JavaThread "http-80-501" daemon [_thread_blocked,
id=784, stack(0x000000004aa92000,0x000000004aab3000)]
0x00007f3d58cac000 JavaThread "http-80-500" daemon [_thread_blocked,
id=783, stack(0x000000004aa71000,0x000000004aa92000)]
0x00007f3d58755800 JavaThread "http-80-499" daemon [_thread_blocked,
id=782, stack(0x000000004aa50000,0x000000004aa71000)]
0x00007f3d59430000 JavaThread "http-80-498" daemon [_thread_blocked,
id=781, stack(0x000000004aa2f000,0x000000004aa50000)]
0x00007f3d5804b800 JavaThread "http-80-497" daemon [_thread_blocked,
id=780, stack(0x000000004aa0e000,0x000000004aa2f000)]
0x00007f3d58c56000 JavaThread "http-80-496" daemon [_thread_blocked,
id=779, stack(0x000000004a9ed000,0x000000004aa0e000)]
0x00007f3d58434800 JavaThread "http-80-495" daemon [_thread_blocked,
id=778, stack(0x000000004a9cc000,0x000000004a9ed000)]
0x00007f3d59784800 JavaThread "http-80-494" daemon [_thread_blocked,
id=777, stack(0x000000004a9ab000,0x000000004a9cc000)]
0x00007f3d58e0f000 JavaThread "http-80-493" daemon [_thread_blocked,
id=776, stack(0x000000004a98a000,0x000000004a9ab000)]
0x00007f3d591d2000 JavaThread "http-80-492" daemon [_thread_blocked,
id=775, stack(0x000000004a969000,0x000000004a98a000)]
0x00007f3d599c5800 JavaThread "http-80-491" daemon [_thread_blocked,
id=774, stack(0x000000004a948000,0x000000004a969000)]
0x00007f3d596ec000 JavaThread "http-80-490" daemon [_thread_blocked,
id=773, stack(0x000000004a927000,0x000000004a948000)]
0x00007f3d59c5d800 JavaThread "http-80-489" daemon [_thread_blocked,
id=772, stack(0x000000004a906000,0x000000004a927000)]
0x00007f3d58042800 JavaThread "http-80-488" daemon [_thread_blocked,
id=771, stack(0x000000004a8e5000,0x000000004a906000)]
0x00007f3d5995b000 JavaThread "http-80-487" daemon [_thread_blocked,
id=770, stack(0x000000004a8c4000,0x000000004a8e5000)]
0x00007f3d598b2800 JavaThread "http-80-486" daemon [_thread_blocked,
id=769, stack(0x000000004a8a3000,0x000000004a8c4000)]
0x00007f3d5995e000 JavaThread "http-80-485" daemon [_thread_blocked,
id=768, stack(0x000000004a882000,0x000000004a8a3000)]
0x00007f3d59959800 JavaThread "http-80-484" daemon [_thread_blocked,
id=767, stack(0x000000004a861000,0x000000004a882000)]
0x00007f3d58a6c000 JavaThread "http-80-483" daemon [_thread_blocked,
id=766, stack(0x000000004a840000,0x000000004a861000)]
0x00007f3d58f8c800 JavaThread "http-80-482" daemon [_thread_blocked,
id=765, stack(0x000000004a81f000,0x000000004a840000)]
0x00007f3d58f88800 JavaThread "http-80-481" daemon [_thread_blocked,
id=764, stack(0x000000004a7fe000,0x000000004a81f000)]
0x00007f3d58554800 JavaThread "http-80-480" daemon [_thread_blocked,
id=763, stack(0x000000004a7dd000,0x000000004a7fe000)]
0x00007f3d58552800 JavaThread "http-80-479" daemon [_thread_blocked,
id=762, stack(0x000000004a7bc000,0x000000004a7dd000)]
0x00007f3d58551800 JavaThread "http-80-478" daemon [_thread_blocked,
id=761, stack(0x000000004a79b000,0x000000004a7bc000)]
0x00007f3d591a0800 JavaThread "http-80-477" daemon [_thread_blocked,
id=760, stack(0x000000004a77a000,0x000000004a79b000)]
0x00007f3d59027800 JavaThread "http-80-476" daemon [_thread_blocked,
id=759, stack(0x000000004a759000,0x000000004a77a000)]
0x00007f3d58f21000 JavaThread "http-80-475" daemon [_thread_blocked,
id=758, stack(0x000000004a738000,0x000000004a759000)]
0x00007f3d58f1f800 JavaThread "http-80-474" daemon [_thread_blocked,
id=757, stack(0x000000004a717000,0x000000004a738000)]
0x00007f3d59a95000 JavaThread "http-80-473" daemon [_thread_blocked,
id=756, stack(0x000000004a6f6000,0x000000004a717000)]
0x00007f3d59a93000 JavaThread "http-80-472" daemon [_thread_blocked,
id=755, stack(0x000000004a6d5000,0x000000004a6f6000)]
0x00007f3d599fa000 JavaThread "http-80-471" daemon [_thread_blocked,
id=754, stack(0x000000004a6b4000,0x000000004a6d5000)]
0x00007f3d599f7800 JavaThread "http-80-470" daemon [_thread_blocked,
id=753, stack(0x000000004a693000,0x000000004a6b4000)]
0x00007f3d595dd800 JavaThread "http-80-469" daemon [_thread_blocked,
id=752, stack(0x000000004a672000,0x000000004a693000)]
0x00007f3d595db000 JavaThread "http-80-468" daemon [_thread_blocked,
id=751, stack(0x000000004a651000,0x000000004a672000)]
0x00007f3d5869a800 JavaThread "http-80-467" daemon [_thread_blocked,
id=750, stack(0x000000004a630000,0x000000004a651000)]
0x00007f3d58914800 JavaThread "http-80-466" daemon [_thread_blocked,
id=749, stack(0x000000004a60f000,0x000000004a630000)]
0x00007f3d58913000 JavaThread "http-80-465" daemon [_thread_blocked,
id=748, stack(0x000000004a5ee000,0x000000004a60f000)]
0x00007f3d507ac000 JavaThread "http-80-464" daemon [_thread_blocked,
id=747, stack(0x000000004a5cd000,0x000000004a5ee000)]
0x00007f3d59502800 JavaThread "http-80-463" daemon [_thread_blocked,
id=746, stack(0x000000004a5ac000,0x000000004a5cd000)]
0x00007f3d59500800 JavaThread "http-80-462" daemon [_thread_blocked,
id=745, stack(0x000000004a58b000,0x000000004a5ac000)]
0x00007f3d59536000 JavaThread "http-80-461" daemon [_thread_blocked,
id=744, stack(0x000000004a56a000,0x000000004a58b000)]
0x00007f3d50235800 JavaThread "http-80-460" daemon [_thread_blocked,
id=743, stack(0x000000004a549000,0x000000004a56a000)]
0x00007f3d59533800 JavaThread "http-80-459" daemon [_thread_blocked,
id=742, stack(0x000000004a528000,0x000000004a549000)]
0x00007f3d513ca800 JavaThread "http-80-458" daemon [_thread_blocked,
id=741, stack(0x000000004a507000,0x000000004a528000)]
0x00007f3d50e2b800 JavaThread "http-80-457" daemon [_thread_blocked,
id=740, stack(0x000000004a4e6000,0x000000004a507000)]
0x00007f3d511ce800 JavaThread "http-80-456" daemon [_thread_blocked,
id=739, stack(0x000000004a4c5000,0x000000004a4e6000)]
0x00007f3d5855a800 JavaThread "http-80-455" daemon [_thread_blocked,
id=738, stack(0x000000004a4a4000,0x000000004a4c5000)]
0x00007f3d50edc000 JavaThread "http-80-454" daemon [_thread_blocked,
id=737, stack(0x000000004a483000,0x000000004a4a4000)]
0x00007f3d58558800 JavaThread "http-80-453" daemon [_thread_blocked,
id=736, stack(0x000000004a462000,0x000000004a483000)]
0x00007f3d58ca5800 JavaThread "http-80-452" daemon [_thread_blocked,
id=735, stack(0x000000004a441000,0x000000004a462000)]
0x00007f3d51167800 JavaThread "http-80-451" daemon [_thread_blocked,
id=734, stack(0x000000004a420000,0x000000004a441000)]
0x00007f3d58ca3800 JavaThread "http-80-450" daemon [_thread_blocked,
id=733, stack(0x000000004a3ff000,0x000000004a420000)]
0x00007f3d5162c000 JavaThread "http-80-449" daemon [_thread_blocked,
id=732, stack(0x000000004a3de000,0x000000004a3ff000)]
0x00007f3d588ec800 JavaThread "http-80-448" daemon [_thread_blocked,
id=731, stack(0x000000004a3bd000,0x000000004a3de000)]
0x00007f3d588eb800 JavaThread "http-80-447" daemon [_thread_blocked,
id=730, stack(0x000000004a39c000,0x000000004a3bd000)]
0x00007f3d50abb800 JavaThread "http-80-446" daemon [_thread_blocked,
id=729, stack(0x000000004a37b000,0x000000004a39c000)]
0x00007f3d588e8800 JavaThread "http-80-445" daemon [_thread_blocked,
id=728, stack(0x000000004a35a000,0x000000004a37b000)]
0x00007f3d50844000 JavaThread "http-80-444" daemon [_thread_blocked,
id=727, stack(0x000000004a339000,0x000000004a35a000)]
0x00007f3d5006f800 JavaThread "http-80-443" daemon [_thread_blocked,
id=725, stack(0x000000004a2f7000,0x000000004a318000)]
0x00007f3d594a4800 JavaThread "http-80-442" daemon [_thread_blocked,
id=724, stack(0x000000004a2d6000,0x000000004a2f7000)]
0x00007f3d5949a000 JavaThread "http-80-441" daemon [_thread_blocked,
id=723, stack(0x000000004a2b5000,0x000000004a2d6000)]
0x00007f3d5009c800 JavaThread "http-80-440" daemon [_thread_blocked,
id=715, stack(0x000000004a294000,0x000000004a2b5000)]
0x00007f3d59497800 JavaThread "http-80-439" daemon [_thread_blocked,
id=714, stack(0x000000004a273000,0x000000004a294000)]
0x00007f3d59b44000 JavaThread "http-80-438" daemon [_thread_blocked,
id=712, stack(0x000000004a252000,0x000000004a273000)]
0x00007f3d50d67800 JavaThread "http-80-437" daemon [_thread_in_native,
id=710, stack(0x000000004a231000,0x000000004a252000)]
0x00007f3d50049000 JavaThread "http-80-436" daemon [_thread_blocked,
id=709, stack(0x000000004a210000,0x000000004a231000)]
0x00007f3d584ec800 JavaThread "http-80-435" daemon [_thread_blocked,
id=708, stack(0x000000004a1ef000,0x000000004a210000)]
0x00007f3d51ec0800 JavaThread "http-80-434" daemon [_thread_blocked,
id=707, stack(0x000000004a1ce000,0x000000004a1ef000)]
0x00007f3d59431000 JavaThread "http-80-433" daemon [_thread_blocked,
id=706, stack(0x000000004a1ad000,0x000000004a1ce000)]
0x00007f3d5148c000 JavaThread "http-80-432" daemon [_thread_blocked,
id=705, stack(0x000000004a18c000,0x000000004a1ad000)]
0x00007f3d58490800 JavaThread "http-80-431" daemon [_thread_blocked,
id=704, stack(0x000000004a16b000,0x000000004a18c000)]
0x00007f3d50dd6000 JavaThread "http-80-430" daemon [_thread_blocked,
id=703, stack(0x000000004a14a000,0x000000004a16b000)]
0x00007f3d50a65000 JavaThread "http-80-429" daemon [_thread_blocked,
id=702, stack(0x000000004a129000,0x000000004a14a000)]
0x00007f3d58753800 JavaThread "http-80-428" daemon [_thread_blocked,
id=701, stack(0x000000004a108000,0x000000004a129000)]
0x00007f3d513f2800 JavaThread "http-80-427" daemon [_thread_blocked,
id=700, stack(0x000000004a0e7000,0x000000004a108000)]
0x00007f3d510e4800 JavaThread "http-80-426" daemon [_thread_blocked,
id=699, stack(0x000000004a0c6000,0x000000004a0e7000)]
0x00007f3d52310800 JavaThread "http-80-425" daemon [_thread_blocked,
id=698, stack(0x000000004a0a5000,0x000000004a0c6000)]
0x00007f3d511a6800 JavaThread "http-80-424" daemon [_thread_blocked,
id=697, stack(0x000000004a084000,0x000000004a0a5000)]
0x00007f3d5202a800 JavaThread "http-80-423" daemon [_thread_blocked,
id=696, stack(0x000000004a063000,0x000000004a084000)]
0x00007f3d59012800 JavaThread "http-80-422" daemon [_thread_blocked,
id=695, stack(0x000000004a042000,0x000000004a063000)]
0x00007f3d515ce000 JavaThread "http-80-421" daemon [_thread_blocked,
id=694, stack(0x000000004a021000,0x000000004a042000)]
0x00007f3d50e98800 JavaThread "http-80-420" daemon [_thread_blocked,
id=693, stack(0x000000004a000000,0x000000004a021000)]
0x00007f3d58a7f800 JavaThread "http-80-419" daemon [_thread_blocked,
id=692, stack(0x0000000049fdf000,0x000000004a000000)]
0x00007f3d50d38000 JavaThread "http-80-418" daemon [_thread_blocked,
id=691, stack(0x0000000049fbe000,0x0000000049fdf000)]
0x00007f3d50411000 JavaThread "http-80-417" daemon [_thread_blocked,
id=690, stack(0x0000000049f9d000,0x0000000049fbe000)]
0x00007f3d517b4800 JavaThread "http-80-416" daemon [_thread_blocked,
id=689, stack(0x0000000049f7c000,0x0000000049f9d000)]
0x00007f3d58435800 JavaThread "http-80-415" daemon [_thread_blocked,
id=688, stack(0x0000000049f5b000,0x0000000049f7c000)]
0x00007f3d51f76000 JavaThread "http-80-414" daemon [_thread_blocked,
id=687, stack(0x0000000049f3a000,0x0000000049f5b000)]
0x00007f3d507c6000 JavaThread "http-80-413" daemon [_thread_blocked,
id=686, stack(0x0000000049f19000,0x0000000049f3a000)]
0x00007f3d4d13e000 JavaThread "http-80-412" daemon [_thread_blocked,
id=685, stack(0x0000000049ef8000,0x0000000049f19000)]
0x00007f3d4ce76000 JavaThread "http-80-411" daemon [_thread_blocked,
id=684, stack(0x0000000049ed7000,0x0000000049ef8000)]
0x00007f3d4ce41000 JavaThread "http-80-410" daemon [_thread_blocked,
id=683, stack(0x0000000049eb6000,0x0000000049ed7000)]
0x00007f3d4c01c000 JavaThread "http-80-409" daemon [_thread_blocked,
id=682, stack(0x0000000049e95000,0x0000000049eb6000)]
0x00007f3d59119000 JavaThread "http-80-408" daemon [_thread_blocked,
id=681, stack(0x0000000049e74000,0x0000000049e95000)]
0x00007f3d58bbc000 JavaThread "http-80-407" daemon [_thread_blocked,
id=680, stack(0x0000000049e53000,0x0000000049e74000)]
0x00007f3d590bf800 JavaThread "http-80-406" daemon [_thread_blocked,
id=679, stack(0x0000000049e32000,0x0000000049e53000)]
0x00007f3d599c6800 JavaThread "http-80-405" daemon [_thread_blocked,
id=678, stack(0x0000000049e11000,0x0000000049e32000)]
0x00007f3d59f58000 JavaThread "http-80-404" daemon [_thread_blocked,
id=677, stack(0x0000000049df0000,0x0000000049e11000)]
0x00007f3d5a3f1800 JavaThread "http-80-403" daemon [_thread_blocked,
id=676, stack(0x0000000049dcf000,0x0000000049df0000)]
0x00007f3d5a907800 JavaThread "http-80-402" daemon [_thread_blocked,
id=675, stack(0x0000000049dae000,0x0000000049dcf000)]
0x00007f3d4c128000 JavaThread "http-80-401" daemon [_thread_blocked,
id=674, stack(0x0000000049d8d000,0x0000000049dae000)]
0x00007f3d59d9b000 JavaThread "http-80-400" daemon [_thread_blocked,
id=673, stack(0x0000000049d6c000,0x0000000049d8d000)]
0x00007f3d4c946800 JavaThread "http-80-399" daemon [_thread_blocked,
id=672, stack(0x0000000049d4b000,0x0000000049d6c000)]
0x00007f3d4c075800 JavaThread "http-80-398" daemon [_thread_blocked,
id=671, stack(0x0000000049d2a000,0x0000000049d4b000)]
0x00007f3d5a272800 JavaThread "http-80-397" daemon [_thread_blocked,
id=670, stack(0x0000000049d09000,0x0000000049d2a000)]
0x00007f3d592d4800 JavaThread "http-80-396" daemon [_thread_blocked,
id=669, stack(0x0000000049ce8000,0x0000000049d09000)]
0x00007f3d4c078000 JavaThread "http-80-395" daemon [_thread_blocked,
id=667, stack(0x0000000049ca6000,0x0000000049cc7000)]
0x00007f3d58039800 JavaThread "http-80-394" daemon [_thread_blocked,
id=666, stack(0x0000000049c85000,0x0000000049ca6000)]
0x00007f3d5a438800 JavaThread "http-80-393" daemon [_thread_blocked,
id=665, stack(0x0000000049c64000,0x0000000049c85000)]
0x00007f3d59c85000 JavaThread "http-80-392" daemon [_thread_blocked,
id=664, stack(0x0000000049c43000,0x0000000049c64000)]
0x00007f3d4c473000 JavaThread "http-80-391" daemon [_thread_blocked,
id=661, stack(0x0000000049be0000,0x0000000049c01000)]
0x00007f3d598ce800 JavaThread "http-80-390" daemon [_thread_blocked,
id=660, stack(0x0000000049bbf000,0x0000000049be0000)]
0x00007f3d586c2800 JavaThread "http-80-389" daemon [_thread_blocked,
id=659, stack(0x0000000049b9e000,0x0000000049bbf000)]
0x00007f3d5a432800 JavaThread "http-80-388" daemon [_thread_blocked,
id=658, stack(0x0000000049b7d000,0x0000000049b9e000)]
0x00007f3d59304000 JavaThread "http-80-387" daemon [_thread_blocked,
id=657, stack(0x0000000049b5c000,0x0000000049b7d000)]
0x00007f3d598e0000 JavaThread "http-80-386" daemon [_thread_blocked,
id=656, stack(0x0000000049b3b000,0x0000000049b5c000)]
0x00007f3d59998800 JavaThread "http-80-385" daemon [_thread_blocked,
id=655, stack(0x0000000049b1a000,0x0000000049b3b000)]
0x00007f3d5949e000 JavaThread "http-80-384" daemon [_thread_blocked,
id=654, stack(0x0000000049af9000,0x0000000049b1a000)]
0x00007f3d58885000 JavaThread "http-80-383" daemon [_thread_blocked,
id=653, stack(0x0000000049ad8000,0x0000000049af9000)]
0x00007f3d4c284800 JavaThread "http-80-382" daemon [_thread_blocked,
id=652, stack(0x0000000049ab7000,0x0000000049ad8000)]
0x00007f3d4cf36000 JavaThread "http-80-381" daemon [_thread_blocked,
id=651, stack(0x0000000049a96000,0x0000000049ab7000)]
0x00007f3d4ce7b800 JavaThread "http-80-380" daemon [_thread_blocked,
id=650, stack(0x0000000049a75000,0x0000000049a96000)]
0x00007f3d4c475800 JavaThread "http-80-379" daemon [_thread_blocked,
id=649, stack(0x0000000049a54000,0x0000000049a75000)]
0x00007f3d4c327800 JavaThread "http-80-378" daemon [_thread_blocked,
id=648, stack(0x0000000049a33000,0x0000000049a54000)]
0x00007f3d4c14d800 JavaThread "http-80-377" daemon [_thread_blocked,
id=647, stack(0x0000000049a12000,0x0000000049a33000)]
0x00007f3d4cf42800 JavaThread "http-80-376" daemon [_thread_blocked,
id=645, stack(0x00000000499f1000,0x0000000049a12000)]
0x00007f3d4d434000 JavaThread "http-80-375" daemon [_thread_blocked,
id=644, stack(0x00000000499d0000,0x00000000499f1000)]
0x00007f3d4d078000 JavaThread "http-80-374" daemon [_thread_blocked,
id=643, stack(0x00000000499af000,0x00000000499d0000)]
0x00007f3d4c145000 JavaThread "http-80-373" daemon [_thread_blocked,
id=642, stack(0x000000004998e000,0x00000000499af000)]
0x00007f3d4c0ad800 JavaThread "http-80-372" daemon [_thread_blocked,
id=641, stack(0x000000004996d000,0x000000004998e000)]
0x00007f3d4c4d2000 JavaThread "http-80-371" daemon [_thread_blocked,
id=640, stack(0x000000004994c000,0x000000004996d000)]
0x00007f3d4c492800 JavaThread "http-80-370" daemon [_thread_blocked,
id=639, stack(0x000000004992b000,0x000000004994c000)]
0x00007f3d4c0ac000 JavaThread "http-80-369" daemon [_thread_blocked,
id=638, stack(0x000000004990a000,0x000000004992b000)]
0x00007f3d4c26d800 JavaThread "http-80-368" daemon [_thread_blocked,
id=637, stack(0x00000000498e9000,0x000000004990a000)]
0x00007f3d4c046800 JavaThread "http-80-367" daemon [_thread_blocked,
id=636, stack(0x00000000498c8000,0x00000000498e9000)]
0x00007f3d4c0f9000 JavaThread "http-80-366" daemon [_thread_blocked,
id=635, stack(0x00000000498a7000,0x00000000498c8000)]
0x00007f3d4c4f1800 JavaThread "http-80-365" daemon [_thread_blocked,
id=634, stack(0x0000000049886000,0x00000000498a7000)]
0x00007f3d4cecc000 JavaThread "http-80-364" daemon [_thread_blocked,
id=633, stack(0x0000000049865000,0x0000000049886000)]
0x00007f3d4c48a800 JavaThread "http-80-363" daemon [_thread_blocked,
id=632, stack(0x0000000049844000,0x0000000049865000)]
0x00007f3d4c00a000 JavaThread "http-80-362" daemon [_thread_blocked,
id=630, stack(0x0000000049802000,0x0000000049823000)]
0x00007f3d58cbb800 JavaThread "http-80-361" daemon [_thread_blocked,
id=622, stack(0x00000000496fa000,0x000000004971b000)]
0x00007f3d59551000 JavaThread "http-80-360" daemon [_thread_blocked,
id=621, stack(0x00000000496d9000,0x00000000496fa000)]
0x00007f3d58df3000 JavaThread "http-80-359" daemon [_thread_blocked,
id=620, stack(0x00000000496b8000,0x00000000496d9000)]
0x00007f3d58e1d000 JavaThread "http-80-358" daemon [_thread_in_native,
id=619, stack(0x0000000049697000,0x00000000496b8000)]
0x00007f3d589f5800 JavaThread "http-80-357" daemon [_thread_blocked,
id=618, stack(0x0000000049676000,0x0000000049697000)]
0x00007f3d583dc000 JavaThread "http-80-356" daemon [_thread_blocked,
id=617, stack(0x0000000049655000,0x0000000049676000)]
0x00007f3d59c90800 JavaThread "http-80-355" daemon [_thread_blocked,
id=616, stack(0x0000000049634000,0x0000000049655000)]
0x00007f3d589d6800 JavaThread "http-80-354" daemon [_thread_blocked,
id=615, stack(0x0000000049613000,0x0000000049634000)]
0x00007f3d59526800 JavaThread "http-80-353" daemon [_thread_blocked,
id=614, stack(0x00000000495f2000,0x0000000049613000)]
0x00007f3d598b0800 JavaThread "http-80-352" daemon [_thread_blocked,
id=613, stack(0x00000000495d1000,0x00000000495f2000)]
0x00007f3d58524800 JavaThread "http-80-351" daemon [_thread_blocked,
id=612, stack(0x00000000495b0000,0x00000000495d1000)]
0x00007f3d59e02800 JavaThread "http-80-350" daemon [_thread_blocked,
id=611, stack(0x000000004958f000,0x00000000495b0000)]
0x00007f3d5845e800 JavaThread "http-80-349" daemon [_thread_blocked,
id=609, stack(0x000000004956e000,0x000000004958f000)]
0x00007f3d589ff800 JavaThread "http-80-348" daemon [_thread_blocked,
id=608, stack(0x000000004954d000,0x000000004956e000)]
0x00007f3d59425000 JavaThread "http-80-347" daemon [_thread_blocked,
id=607, stack(0x000000004952c000,0x000000004954d000)]
0x00007f3d59c63800 JavaThread "http-80-346" daemon [_thread_blocked,
id=606, stack(0x000000004950b000,0x000000004952c000)]
0x00007f3d58700000 JavaThread "http-80-345" daemon [_thread_blocked,
id=605, stack(0x00000000494ea000,0x000000004950b000)]
0x00007f3d59daf000 JavaThread "http-80-344" daemon [_thread_blocked,
id=604, stack(0x00000000494c9000,0x00000000494ea000)]
0x00007f3d4c0af000 JavaThread "http-80-343" daemon [_thread_blocked,
id=603, stack(0x00000000494a8000,0x00000000494c9000)]
0x00007f3d58cca800 JavaThread "http-80-342" daemon [_thread_blocked,
id=602, stack(0x0000000049487000,0x00000000494a8000)]
0x00007f3d584c8000 JavaThread "http-80-341" daemon [_thread_blocked,
id=601, stack(0x0000000049466000,0x0000000049487000)]
0x00007f3d4c199000 JavaThread "http-80-340" daemon [_thread_blocked,
id=600, stack(0x0000000049445000,0x0000000049466000)]
0x00007f3d5855f000 JavaThread "http-80-339" daemon [_thread_blocked,
id=599, stack(0x0000000049424000,0x0000000049445000)]
0x00007f3d4c943800 JavaThread "http-80-338" daemon [_thread_blocked,
id=598, stack(0x0000000049403000,0x0000000049424000)]
0x00007f3d5888a000 JavaThread "http-80-337" daemon [_thread_blocked,
id=597, stack(0x00000000493e2000,0x0000000049403000)]
0x00007f3d58539000 JavaThread "http-80-336" daemon [_thread_blocked,
id=596, stack(0x00000000493c1000,0x00000000493e2000)]
0x00007f3d58ad6000 JavaThread "http-80-335" daemon [_thread_blocked,
id=595, stack(0x00000000493a0000,0x00000000493c1000)]
0x00007f3d59455000 JavaThread "http-80-334" daemon [_thread_blocked,
id=594, stack(0x000000004937f000,0x00000000493a0000)]
0x00007f3d4c308800 JavaThread "http-80-333" daemon [_thread_blocked,
id=593, stack(0x000000004935e000,0x000000004937f000)]
0x00007f3d5891c800 JavaThread "http-80-332" daemon [_thread_blocked,
id=592, stack(0x000000004933d000,0x000000004935e000)]
0x00007f3d4cf61800 JavaThread "http-80-331" daemon [_thread_blocked,
id=591, stack(0x000000004931c000,0x000000004933d000)]
0x00007f3d58df5000 JavaThread "http-80-330" daemon [_thread_blocked,
id=590, stack(0x00000000492fb000,0x000000004931c000)]
0x00007f3d649da000 JavaThread "http-80-329" daemon [_thread_blocked,
id=589, stack(0x00000000492da000,0x00000000492fb000)]
0x00007f3d5d41d000 JavaThread "http-80-328" daemon [_thread_blocked,
id=588, stack(0x00000000492b9000,0x00000000492da000)]
0x00007f3d58758800 JavaThread "http-80-327" daemon [_thread_blocked,
id=587, stack(0x0000000049298000,0x00000000492b9000)]
0x00007f3d602fe000 JavaThread "http-80-326" daemon [_thread_blocked,
id=586, stack(0x0000000049277000,0x0000000049298000)]
0x00007f3d5a43c800 JavaThread "http-80-325" daemon [_thread_blocked,
id=585, stack(0x0000000049256000,0x0000000049277000)]
0x00007f3d601a6800 JavaThread "http-80-324" daemon [_thread_blocked,
id=584, stack(0x0000000049235000,0x0000000049256000)]
0x00007f3d59287800 JavaThread "http-80-323" daemon [_thread_blocked,
id=583, stack(0x0000000049214000,0x0000000049235000)]
0x00007f3d5935e000 JavaThread "http-80-322" daemon [_thread_blocked,
id=582, stack(0x00000000491f3000,0x0000000049214000)]
0x00007f3d594a9800 JavaThread "http-80-321" daemon [_thread_blocked,
id=581, stack(0x00000000491d2000,0x00000000491f3000)]
0x00007f3d60ce2000 JavaThread "http-80-320" daemon [_thread_blocked,
id=580, stack(0x00000000491b1000,0x00000000491d2000)]
0x00007f3d60296800 JavaThread "http-80-319" daemon [_thread_blocked,
id=579, stack(0x0000000049190000,0x00000000491b1000)]
0x00007f3d6049c800 JavaThread "http-80-318" daemon [_thread_blocked,
id=578, stack(0x000000004916f000,0x0000000049190000)]
0x00007f3d598a4000 JavaThread "http-80-317" daemon [_thread_blocked,
id=577, stack(0x000000004914e000,0x000000004916f000)]
0x00007f3d626c1800 JavaThread "http-80-316" daemon [_thread_blocked,
id=576, stack(0x000000004912d000,0x000000004914e000)]
0x00007f3d60316000 JavaThread "http-80-315" daemon [_thread_blocked,
id=575, stack(0x000000004910c000,0x000000004912d000)]
0x00007f3d603d6800 JavaThread "http-80-314" daemon [_thread_blocked,
id=574, stack(0x00000000490eb000,0x000000004910c000)]
0x00007f3d610fd800 JavaThread "http-80-313" daemon [_thread_blocked,
id=572, stack(0x00000000490a9000,0x00000000490ca000)]
0x00007f3d6030b000 JavaThread "http-80-312" daemon [_thread_blocked,
id=571, stack(0x0000000049088000,0x00000000490a9000)]
0x00007f3d604d5000 JavaThread "http-80-311" daemon [_thread_blocked,
id=569, stack(0x0000000049046000,0x0000000049067000)]
0x00007f3d60b87000 JavaThread "http-80-310" daemon [_thread_blocked,
id=568, stack(0x0000000049025000,0x0000000049046000)]
0x00007f3d61613000 JavaThread "http-80-309" daemon [_thread_blocked,
id=567, stack(0x0000000049004000,0x0000000049025000)]
0x00007f3d58882800 JavaThread "http-80-308" daemon [_thread_in_native,
id=566, stack(0x0000000048fe3000,0x0000000049004000)]
0x00007f3d58013000 JavaThread "http-80-307" daemon [_thread_blocked,
id=565, stack(0x0000000048fc2000,0x0000000048fe3000)]
0x00007f3d588ee800 JavaThread "http-80-306" daemon [_thread_blocked,
id=564, stack(0x0000000048fa1000,0x0000000048fc2000)]
0x00007f3d58db0800 JavaThread "http-80-305" daemon [_thread_blocked,
id=563, stack(0x0000000048f80000,0x0000000048fa1000)]
0x00007f3d58874800 JavaThread "http-80-304" daemon [_thread_blocked,
id=562, stack(0x0000000048f5f000,0x0000000048f80000)]
0x00007f3d58f4c800 JavaThread "http-80-303" daemon [_thread_blocked,
id=561, stack(0x0000000048f3e000,0x0000000048f5f000)]
0x00007f3d595c9800 JavaThread "http-80-302" daemon [_thread_blocked,
id=560, stack(0x0000000048f1d000,0x0000000048f3e000)]
0x00007f3d583f5000 JavaThread "http-80-301" daemon [_thread_blocked,
id=559, stack(0x0000000048efc000,0x0000000048f1d000)]
0x00007f3d5943f000 JavaThread "http-80-300" daemon [_thread_blocked,
id=558, stack(0x0000000048edb000,0x0000000048efc000)]
0x00007f3d5853e800 JavaThread "http-80-299" daemon [_thread_blocked,
id=557, stack(0x0000000048eba000,0x0000000048edb000)]
0x00007f3d59b63000 JavaThread "http-80-298" daemon [_thread_blocked,
id=555, stack(0x0000000048e78000,0x0000000048e99000)]
0x00007f3d58b7e800 JavaThread "http-80-297" daemon [_thread_blocked,
id=553, stack(0x0000000048e36000,0x0000000048e57000)]
0x00007f3d58f04000 JavaThread "http-80-296" daemon [_thread_blocked,
id=549, stack(0x0000000048db2000,0x0000000048dd3000)]
0x00007f3d5a431800 JavaThread "http-80-295" daemon [_thread_blocked,
id=548, stack(0x0000000048d91000,0x0000000048db2000)]
0x00007f3d5a277000 JavaThread "http-80-294" daemon [_thread_blocked,
id=547, stack(0x0000000048d70000,0x0000000048d91000)]
0x00007f3d595a8800 JavaThread "http-80-293" daemon [_thread_blocked,
id=535, stack(0x0000000048be4000,0x0000000048c05000)]
0x00007f3d60243800 JavaThread "http-80-292" daemon [_thread_blocked,
id=534, stack(0x0000000048bc3000,0x0000000048be4000)]
0x00007f3d60bb7800 JavaThread "http-80-291" daemon [_thread_blocked,
id=533, stack(0x0000000048ba2000,0x0000000048bc3000)]
0x00007f3d589e8000 JavaThread "http-80-290" daemon [_thread_blocked,
id=518, stack(0x00000000489b3000,0x00000000489d4000)]
0x00007f3d59e00800 JavaThread "http-80-289" daemon [_thread_blocked,
id=517, stack(0x0000000048992000,0x00000000489b3000)]
0x00007f3d599c7800 JavaThread "http-80-288" daemon [_thread_blocked,
id=516, stack(0x0000000048971000,0x0000000048992000)]
0x00007f3d58ad8800 JavaThread "http-80-287" daemon [_thread_blocked,
id=515, stack(0x0000000048950000,0x0000000048971000)]
0x00007f3d58a9f800 JavaThread "http-80-286" daemon [_thread_blocked,
id=514, stack(0x000000004892f000,0x0000000048950000)]
0x00007f3d58646800 JavaThread "http-80-285" daemon [_thread_blocked,
id=513, stack(0x000000004890e000,0x000000004892f000)]
0x00007f3d5947e000 JavaThread "http-80-284" daemon [_thread_blocked,
id=512, stack(0x00000000488ed000,0x000000004890e000)]
0x00007f3d58030800 JavaThread "http-80-283" daemon [_thread_in_native,
id=511, stack(0x00000000488cc000,0x00000000488ed000)]
0x00007f3d58f32000 JavaThread "http-80-282" daemon [_thread_blocked,
id=510, stack(0x00000000488ab000,0x00000000488cc000)]
0x00007f3d59454800 JavaThread "http-80-281" daemon [_thread_blocked,
id=509, stack(0x000000004888a000,0x00000000488ab000)]
0x00007f3d59496800 JavaThread "http-80-280" daemon [_thread_blocked,
id=508, stack(0x0000000048869000,0x000000004888a000)]
0x00007f3d60451000 JavaThread "http-80-279" daemon [_thread_blocked,
id=507, stack(0x0000000048848000,0x0000000048869000)]
0x00007f3d5902e000 JavaThread "http-80-278" daemon [_thread_blocked,
id=506, stack(0x0000000048827000,0x0000000048848000)]
0x00007f3d51d6f800 JavaThread "http-80-277" daemon [_thread_blocked,
id=505, stack(0x0000000048806000,0x0000000048827000)]
0x00007f3d51d7b000 JavaThread "http-80-276" daemon [_thread_blocked,
id=504, stack(0x00000000487e5000,0x0000000048806000)]
0x00007f3d51d79000 JavaThread "http-80-275" daemon [_thread_blocked,
id=503, stack(0x00000000487c4000,0x00000000487e5000)]
0x00007f3d51d4f800 JavaThread "http-80-274" daemon [_thread_blocked,
id=463, stack(0x000000004829c000,0x00000000482bd000)]
0x00007f3d51d68000 JavaThread "http-80-273" daemon [_thread_blocked,
id=461, stack(0x000000004825a000,0x000000004827b000)]
0x00007f3d51d81800 JavaThread "http-80-272" daemon [_thread_blocked,
id=460, stack(0x0000000048239000,0x000000004825a000)]
0x00007f3d51d87000 JavaThread "http-80-271" daemon [_thread_blocked,
id=459, stack(0x0000000048218000,0x0000000048239000)]
0x00007f3d51d8a000 JavaThread "http-80-270" daemon [_thread_blocked,
id=458, stack(0x00000000481f7000,0x0000000048218000)]
0x00007f3d51d91800 JavaThread "http-80-269" daemon [_thread_blocked,
id=457, stack(0x00000000481d6000,0x00000000481f7000)]
0x00007f3d51da5000 JavaThread "http-80-268" daemon [_thread_blocked,
id=456, stack(0x00000000481b5000,0x00000000481d6000)]
0x00007f3d51daa000 JavaThread "http-80-267" daemon [_thread_blocked,
id=455, stack(0x0000000048194000,0x00000000481b5000)]
0x00007f3d51db7000 JavaThread "http-80-266" daemon [_thread_blocked,
id=454, stack(0x0000000048173000,0x0000000048194000)]
0x00007f3d51ee4800 JavaThread "http-80-265" daemon [_thread_blocked,
id=453, stack(0x0000000048152000,0x0000000048173000)]
0x00007f3d51e70000 JavaThread "http-80-264" daemon [_thread_blocked,
id=452, stack(0x0000000048131000,0x0000000048152000)]
0x00007f3d51f6d800 JavaThread "http-80-263" daemon [_thread_blocked,
id=451, stack(0x0000000048110000,0x0000000048131000)]
0x00007f3d51f5f800 JavaThread "http-80-262" daemon [_thread_blocked,
id=450, stack(0x00000000480ef000,0x0000000048110000)]
0x00007f3d52153000 JavaThread "http-80-261" daemon [_thread_blocked,
id=449, stack(0x00000000480ce000,0x00000000480ef000)]
0x00007f3d51e30000 JavaThread "http-80-260" daemon [_thread_blocked,
id=448, stack(0x00000000480ad000,0x00000000480ce000)]
0x00007f3d6204d000 JavaThread "http-80-259" daemon [_thread_blocked,
id=447, stack(0x000000004808c000,0x00000000480ad000)]
0x00007f3d608f2800 JavaThread "http-80-258" daemon [_thread_blocked,
id=446, stack(0x000000004806b000,0x000000004808c000)]
0x00007f3d5249d800 JavaThread "http-80-257" daemon [_thread_blocked,
id=445, stack(0x000000004804a000,0x000000004806b000)]
0x00007f3d603c4000 JavaThread "http-80-256" daemon [_thread_blocked,
id=444, stack(0x0000000048029000,0x000000004804a000)]
0x00007f3d508fb000 JavaThread "http-80-255" daemon [_thread_blocked,
id=443, stack(0x0000000048008000,0x0000000048029000)]
0x00007f3d51ed7800 JavaThread "http-80-254" daemon [_thread_blocked,
id=442, stack(0x0000000047fe7000,0x0000000048008000)]
0x00007f3d61669800 JavaThread "http-80-253" daemon [_thread_blocked,
id=441, stack(0x0000000047fc6000,0x0000000047fe7000)]
0x00007f3d607b2000 JavaThread "http-80-252" daemon [_thread_blocked,
id=440, stack(0x0000000047fa5000,0x0000000047fc6000)]
0x00007f3d508bd000 JavaThread "http-80-251" daemon [_thread_blocked,
id=439, stack(0x0000000047f84000,0x0000000047fa5000)]
0x00007f3d609ed000 JavaThread "http-80-250" daemon [_thread_blocked,
id=438, stack(0x0000000047f63000,0x0000000047f84000)]
0x00007f3d508bf800 JavaThread "http-80-249" daemon [_thread_blocked,
id=437, stack(0x0000000047f42000,0x0000000047f63000)]
0x00007f3d52509000 JavaThread "http-80-248" daemon [_thread_blocked,
id=436, stack(0x0000000047f21000,0x0000000047f42000)]
0x00007f3d60bf3800 JavaThread "http-80-247" daemon [_thread_blocked,
id=435, stack(0x0000000047f00000,0x0000000047f21000)]
0x00007f3d60219800 JavaThread "http-80-246" daemon [_thread_blocked,
id=434, stack(0x0000000047edf000,0x0000000047f00000)]
0x00007f3d601f9800 JavaThread "http-80-245" daemon [_thread_blocked,
id=433, stack(0x0000000047ebe000,0x0000000047edf000)]
0x00007f3d521d3000 JavaThread "http-80-244" daemon [_thread_blocked,
id=432, stack(0x0000000047e9d000,0x0000000047ebe000)]
0x00007f3d60431000 JavaThread "http-80-243" daemon [_thread_blocked,
id=431, stack(0x0000000047e7c000,0x0000000047e9d000)]
0x00007f3d4c320000 JavaThread "http-80-242" daemon [_thread_blocked,
id=430, stack(0x0000000047e5b000,0x0000000047e7c000)]
0x00007f3d604f9800 JavaThread "http-80-241" daemon [_thread_blocked,
id=429, stack(0x0000000047e3a000,0x0000000047e5b000)]
0x00007f3d4c31e000 JavaThread "http-80-240" daemon [_thread_blocked,
id=428, stack(0x0000000047e19000,0x0000000047e3a000)]
0x00007f3d4d0f0000 JavaThread "http-80-239" daemon [_thread_blocked,
id=427, stack(0x0000000047df8000,0x0000000047e19000)]
0x00007f3d60999800 JavaThread "http-80-238" daemon [_thread_blocked,
id=426, stack(0x0000000047dd7000,0x0000000047df8000)]
0x00007f3d61805800 JavaThread "http-80-237" daemon [_thread_blocked,
id=425, stack(0x0000000047db6000,0x0000000047dd7000)]
0x00007f3d4d0e1000 JavaThread "http-80-236" daemon [_thread_blocked,
id=424, stack(0x0000000047d95000,0x0000000047db6000)]
0x00007f3d4d0df000 JavaThread "http-80-235" daemon [_thread_blocked,
id=423, stack(0x0000000047d74000,0x0000000047d95000)]
0x00007f3d60c8f800 JavaThread "http-80-234" daemon [_thread_blocked,
id=422, stack(0x0000000047d53000,0x0000000047d74000)]
0x00007f3d602d3000 JavaThread "http-80-233" daemon [_thread_blocked,
id=421, stack(0x0000000047d32000,0x0000000047d53000)]
0x00007f3d4d432000 JavaThread "http-80-232" daemon [_thread_blocked,
id=420, stack(0x0000000047d11000,0x0000000047d32000)]
0x00007f3d4d430000 JavaThread "http-80-231" daemon [_thread_blocked,
id=419, stack(0x0000000047cf0000,0x0000000047d11000)]
0x00007f3d60d0f000 JavaThread "http-80-230" daemon [_thread_blocked,
id=418, stack(0x0000000047ccf000,0x0000000047cf0000)]
0x00007f3d4d42e000 JavaThread "http-80-229" daemon [_thread_blocked,
id=417, stack(0x0000000047cae000,0x0000000047ccf000)]
0x00007f3d61655000 JavaThread "http-80-228" daemon [_thread_blocked,
id=416, stack(0x0000000047c8d000,0x0000000047cae000)]
0x00007f3d4d47c000 JavaThread "http-80-227" daemon [_thread_blocked,
id=415, stack(0x0000000047c6c000,0x0000000047c8d000)]
0x00007f3d616cd800 JavaThread "http-80-226" daemon [_thread_blocked,
id=414, stack(0x0000000047c4b000,0x0000000047c6c000)]
0x00007f3d60273800 JavaThread "http-80-225" daemon [_thread_blocked,
id=413, stack(0x0000000047c2a000,0x0000000047c4b000)]
0x00007f3d4d477000 JavaThread "http-80-224" daemon [_thread_blocked,
id=412, stack(0x0000000047c09000,0x0000000047c2a000)]
0x00007f3d6005f800 JavaThread "http-80-223" daemon [_thread_blocked,
id=411, stack(0x0000000047be8000,0x0000000047c09000)]
0x00007f3d620d6000 JavaThread "http-80-222" daemon [_thread_blocked,
id=410, stack(0x0000000047bc7000,0x0000000047be8000)]
0x00007f3d4c469800 JavaThread "http-80-221" daemon [_thread_blocked,
id=409, stack(0x0000000047ba6000,0x0000000047bc7000)]
0x00007f3d4c467800 JavaThread "http-80-220" daemon [_thread_blocked,
id=408, stack(0x0000000047b85000,0x0000000047ba6000)]
0x00007f3d4d07e000 JavaThread "http-80-219" daemon [_thread_blocked,
id=407, stack(0x0000000047b64000,0x0000000047b85000)]
0x00007f3d6069d800 JavaThread "http-80-218" daemon [_thread_blocked,
id=406, stack(0x0000000047b43000,0x0000000047b64000)]
0x00007f3d606cd800 JavaThread "http-80-217" daemon [_thread_blocked,
id=405, stack(0x0000000047b22000,0x0000000047b43000)]
0x00007f3d4c19c000 JavaThread "http-80-216" daemon [_thread_blocked,
id=404, stack(0x0000000047b01000,0x0000000047b22000)]
0x00007f3d62982000 JavaThread "http-80-215" daemon [_thread_blocked,
id=403, stack(0x0000000047ae0000,0x0000000047b01000)]
0x00007f3d62289800 JavaThread "http-80-214" daemon [_thread_blocked,
id=402, stack(0x0000000047abf000,0x0000000047ae0000)]
0x00007f3d4c134000 JavaThread "http-80-213" daemon [_thread_blocked,
id=401, stack(0x0000000047a9e000,0x0000000047abf000)]
0x00007f3d60cce000 JavaThread "http-80-212" daemon [_thread_blocked,
id=400, stack(0x0000000047a7d000,0x0000000047a9e000)]
0x00007f3d4cec9000 JavaThread "http-80-211" daemon [_thread_blocked,
id=399, stack(0x0000000047a5c000,0x0000000047a7d000)]
0x00007f3d61baa000 JavaThread "http-80-210" daemon [_thread_blocked,
id=398, stack(0x0000000047a3b000,0x0000000047a5c000)]
0x00007f3d4c081000 JavaThread "http-80-209" daemon [_thread_blocked,
id=397, stack(0x0000000047a1a000,0x0000000047a3b000)]
0x00007f3d62579800 JavaThread "http-80-208" daemon [_thread_blocked,
id=396, stack(0x00000000479f9000,0x0000000047a1a000)]
0x00007f3d4c1d1800 JavaThread "http-80-207" daemon [_thread_blocked,
id=395, stack(0x00000000479d8000,0x00000000479f9000)]
0x00007f3d6151c000 JavaThread "http-80-206" daemon [_thread_blocked,
id=394, stack(0x00000000479b7000,0x00000000479d8000)]
0x00007f3d4c1bc000 JavaThread "http-80-205" daemon [_thread_blocked,
id=393, stack(0x0000000047996000,0x00000000479b7000)]
0x00007f3d4ceee800 JavaThread "http-80-204" daemon [_thread_blocked,
id=392, stack(0x0000000047975000,0x0000000047996000)]
0x00007f3d62b9c800 JavaThread "http-80-203" daemon [_thread_blocked,
id=391, stack(0x0000000047954000,0x0000000047975000)]
0x00007f3d61f82000 JavaThread "http-80-202" daemon [_thread_blocked,
id=390, stack(0x0000000047933000,0x0000000047954000)]
0x00007f3d4cefb800 JavaThread "http-80-201" daemon [_thread_blocked,
id=389, stack(0x0000000047912000,0x0000000047933000)]
0x00007f3d604aa000 JavaThread "http-80-200" daemon [_thread_blocked,
id=388, stack(0x00000000478f1000,0x0000000047912000)]
0x00007f3d601fc800 JavaThread "http-80-199" daemon [_thread_blocked,
id=387, stack(0x00000000478d0000,0x00000000478f1000)]
0x00007f3d4c1db000 JavaThread "http-80-198" daemon [_thread_in_native,
id=386, stack(0x00000000478af000,0x00000000478d0000)]
0x00007f3d4cfff000 JavaThread "http-80-197" daemon [_thread_blocked,
id=385, stack(0x000000004788e000,0x00000000478af000)]
0x00007f3d62006800 JavaThread "http-80-196" daemon [_thread_blocked,
id=384, stack(0x000000004786d000,0x000000004788e000)]
0x00007f3d60606000 JavaThread "http-80-195" daemon [_thread_blocked,
id=383, stack(0x000000004784c000,0x000000004786d000)]
0x00007f3d4c094000 JavaThread "http-80-194" daemon [_thread_blocked,
id=382, stack(0x000000004782b000,0x000000004784c000)]
0x00007f3d61f20800 JavaThread "http-80-193" daemon [_thread_blocked,
id=381, stack(0x000000004780a000,0x000000004782b000)]
0x00007f3d61d55000 JavaThread "http-80-192" daemon [_thread_blocked,
id=380, stack(0x00000000477e9000,0x000000004780a000)]
0x00007f3d4c109000 JavaThread "http-80-191" daemon [_thread_blocked,
id=379, stack(0x00000000477c8000,0x00000000477e9000)]
0x00007f3d4c143800 JavaThread "http-80-190" daemon [_thread_blocked,
id=378, stack(0x00000000477a7000,0x00000000477c8000)]
0x00007f3d6163c800 JavaThread "http-80-189" daemon [_thread_blocked,
id=377, stack(0x0000000047786000,0x00000000477a7000)]
0x00007f3d4c14e800 JavaThread "http-80-188" daemon [_thread_blocked,
id=376, stack(0x0000000047765000,0x0000000047786000)]
0x00007f3d4d402800 JavaThread "http-80-187" daemon [_thread_blocked,
id=375, stack(0x0000000047744000,0x0000000047765000)]
0x00007f3d602c3000 JavaThread "http-80-186" daemon [_thread_blocked,
id=374, stack(0x0000000047723000,0x0000000047744000)]
0x00007f3d4c945800 JavaThread "http-80-185" daemon [_thread_blocked,
id=373, stack(0x0000000047702000,0x0000000047723000)]
0x00007f3d61c21000 JavaThread "http-80-184" daemon [_thread_blocked,
id=372, stack(0x00000000476e1000,0x0000000047702000)]
0x00007f3d61847000 JavaThread "http-80-183" daemon [_thread_blocked,
id=371, stack(0x00000000476c0000,0x00000000476e1000)]
0x00007f3d4c00d000 JavaThread "http-80-182" daemon [_thread_blocked,
id=370, stack(0x000000004769f000,0x00000000476c0000)]
0x00007f3d61991800 JavaThread "http-80-181" daemon [_thread_blocked,
id=369, stack(0x000000004767e000,0x000000004769f000)]
0x00007f3d4c1ed000 JavaThread "http-80-180" daemon [_thread_blocked,
id=368, stack(0x000000004765d000,0x000000004767e000)]
0x00007f3d4c0c5800 JavaThread "http-80-179" daemon [_thread_blocked,
id=367, stack(0x000000004763c000,0x000000004765d000)]
0x00007f3d4d0f5800 JavaThread "http-80-178" daemon [_thread_blocked,
id=366, stack(0x000000004761b000,0x000000004763c000)]
0x00007f3d4d0a1000 JavaThread "http-80-177" daemon [_thread_blocked,
id=365, stack(0x00000000475fa000,0x000000004761b000)]
0x00007f3d6026b800 JavaThread "http-80-176" daemon [_thread_blocked,
id=364, stack(0x00000000475d9000,0x00000000475fa000)]
0x00007f3d627af800 JavaThread "http-80-175" daemon [_thread_blocked,
id=363, stack(0x00000000475b8000,0x00000000475d9000)]
0x00007f3d60266800 JavaThread "http-80-174" daemon [_thread_blocked,
id=362, stack(0x0000000047597000,0x00000000475b8000)]
0x00007f3d617fa800 JavaThread "http-80-173" daemon [_thread_blocked,
id=361, stack(0x0000000047576000,0x0000000047597000)]
0x00007f3d60332000 JavaThread "http-80-172" daemon [_thread_blocked,
id=360, stack(0x0000000047555000,0x0000000047576000)]
0x00007f3d60191800 JavaThread "http-80-171" daemon [_thread_blocked,
id=359, stack(0x0000000047534000,0x0000000047555000)]
0x00007f3d60609000 JavaThread "http-80-170" daemon [_thread_blocked,
id=358, stack(0x0000000047513000,0x0000000047534000)]
0x00007f3d61d9e000 JavaThread "http-80-169" daemon [_thread_blocked,
id=357, stack(0x00000000474f2000,0x0000000047513000)]
0x00007f3d6227c800 JavaThread "http-80-168" daemon [_thread_blocked,
id=356, stack(0x00000000474d1000,0x00000000474f2000)]
0x00007f3d62afd800 JavaThread "http-80-167" daemon [_thread_blocked,
id=355, stack(0x00000000474b0000,0x00000000474d1000)]
0x00007f3d4c305000 JavaThread "http-80-166" daemon [_thread_blocked,
id=354, stack(0x000000004748f000,0x00000000474b0000)]
0x00007f3d4d15c800 JavaThread "http-80-165" daemon [_thread_blocked,
id=322, stack(0x000000004706f000,0x0000000047090000)]
0x00007f3d4d44c000 JavaThread "http-80-164" daemon [_thread_blocked,
id=321, stack(0x000000004704e000,0x000000004706f000)]
0x00007f3d61f39000 JavaThread "http-80-163" daemon [_thread_blocked,
id=320, stack(0x000000004702d000,0x000000004704e000)]
0x00007f3d4c19e000 JavaThread "http-80-162" daemon [_thread_blocked,
id=318, stack(0x0000000046feb000,0x000000004700c000)]
0x00007f3d4c4af000 JavaThread "http-80-161" daemon [_thread_blocked,
id=317, stack(0x0000000046fca000,0x0000000046feb000)]
0x00007f3d4ce7a800 JavaThread "http-80-160" daemon [_thread_blocked,
id=308, stack(0x0000000046fa9000,0x0000000046fca000)]
0x00007f3d4d12b800 JavaThread "http-80-159" daemon [_thread_blocked,
id=307, stack(0x0000000046f88000,0x0000000046fa9000)]
0x00007f3d4c0b6800 JavaThread "http-80-158" daemon [_thread_blocked,
id=305, stack(0x0000000046f67000,0x0000000046f88000)]
0x00007f3d62762000 JavaThread "http-80-157" daemon [_thread_blocked,
id=304, stack(0x0000000046f46000,0x0000000046f67000)]
0x00007f3d61686000 JavaThread "http-80-156" daemon [_thread_blocked,
id=303, stack(0x0000000046f25000,0x0000000046f46000)]
0x00007f3d601d1800 JavaThread "http-80-155" daemon [_thread_blocked,
id=302, stack(0x0000000046f04000,0x0000000046f25000)]
0x00007f3d60abd000 JavaThread "http-80-154" daemon [_thread_blocked,
id=301, stack(0x0000000046ee3000,0x0000000046f04000)]
0x00007f3d4c22a800 JavaThread "http-80-153" daemon [_thread_blocked,
id=300, stack(0x0000000046ec2000,0x0000000046ee3000)]
0x00007f3d4d0f6800 JavaThread "http-80-152" daemon [_thread_blocked,
id=32767, stack(0x0000000046ea1000,0x0000000046ec2000)]
0x00007f3d4c12c800 JavaThread "http-80-151" daemon [_thread_blocked,
id=32766, stack(0x0000000046e80000,0x0000000046ea1000)]
0x00007f3d4d48b800 JavaThread "http-80-150" daemon [_thread_blocked,
id=32765, stack(0x0000000046e5f000,0x0000000046e80000)]
0x00007f3d616c6000 JavaThread "http-80-149" daemon [_thread_blocked,
id=32764, stack(0x0000000046e3e000,0x0000000046e5f000)]
0x00007f3d4c94a800 JavaThread "http-80-148" daemon [_thread_blocked,
id=32763, stack(0x0000000046e1d000,0x0000000046e3e000)]
0x00007f3d6071f800 JavaThread "http-80-147" daemon [_thread_blocked,
id=32762, stack(0x0000000046dfc000,0x0000000046e1d000)]
0x00007f3d4c0e2800 JavaThread "http-80-146" daemon [_thread_blocked,
id=32760, stack(0x0000000045e84000,0x0000000045ea5000)]
0x00007f3d4ce42000 JavaThread "http-80-145" daemon [_thread_in_native,
id=32759, stack(0x0000000044c78000,0x0000000044c99000)]
0x00007f3d61696000 JavaThread "http-80-144" daemon [_thread_blocked,
id=32758, stack(0x0000000043376000,0x0000000043397000)]
0x00007f3d4c248800 JavaThread "http-80-143" daemon [_thread_blocked,
id=32757, stack(0x0000000044bb2000,0x0000000044bd3000)]
0x00007f3d62522800 JavaThread "http-443-7" daemon [_thread_blocked,
id=32467, stack(0x0000000043d42000,0x0000000043d63000)]
0x00007f3d61c5f800 JavaThread "http-80-142" daemon [_thread_blocked,
id=31722, stack(0x0000000046ac3000,0x0000000046ae4000)]
0x00007f3d4c025800 JavaThread "http-80-141" daemon [_thread_blocked,
id=31721, stack(0x0000000046aa2000,0x0000000046ac3000)]
0x00007f3d60153800 JavaThread "http-80-140" daemon [_thread_blocked,
id=31720, stack(0x0000000046a81000,0x0000000046aa2000)]
0x00007f3d607de000 JavaThread "http-80-139" daemon [_thread_blocked,
id=31719, stack(0x0000000046a60000,0x0000000046a81000)]
0x00007f3d4c265800 JavaThread "http-80-138" daemon [_thread_blocked,
id=31718, stack(0x0000000046a3f000,0x0000000046a60000)]
0x00007f3d61536000 JavaThread "http-80-137" daemon [_thread_blocked,
id=31717, stack(0x0000000046a1e000,0x0000000046a3f000)]
0x00007f3d4c00b000 JavaThread "http-80-136" daemon [_thread_blocked,
id=31716, stack(0x00000000469fd000,0x0000000046a1e000)]
0x00007f3d4c28d000 JavaThread "http-80-135" daemon [_thread_blocked,
id=31715, stack(0x00000000469dc000,0x00000000469fd000)]
0x00007f3d4c10a000 JavaThread "http-80-134" daemon [_thread_blocked,
id=31714, stack(0x00000000469bb000,0x00000000469dc000)]
0x00007f3d60490000 JavaThread "http-80-133" daemon [_thread_blocked,
id=31713, stack(0x000000004699a000,0x00000000469bb000)]
0x00007f3d4cef5800 JavaThread "http-80-132" daemon [_thread_blocked,
id=31712, stack(0x0000000046979000,0x000000004699a000)]
0x00007f3d62567000 JavaThread "http-80-131" daemon [_thread_blocked,
id=31711, stack(0x0000000046958000,0x0000000046979000)]
0x00007f3d602ad000 JavaThread "http-80-130" daemon [_thread_blocked,
id=31710, stack(0x0000000046937000,0x0000000046958000)]
0x00007f3d4c4b6800 JavaThread "http-80-129" daemon [_thread_blocked,
id=31709, stack(0x0000000046916000,0x0000000046937000)]
0x00007f3d4c095800 JavaThread "http-80-128" daemon [_thread_blocked,
id=31708, stack(0x00000000468f5000,0x0000000046916000)]
0x00007f3d60ca0800 JavaThread "http-80-127" daemon [_thread_blocked,
id=31702, stack(0x00000000468d4000,0x00000000468f5000)]
0x00007f3d62537000 JavaThread "http-80-126" daemon [_thread_in_native,
id=31700, stack(0x0000000046892000,0x00000000468b3000)]
0x00007f3d4d000000 JavaThread "http-80-125" daemon [_thread_blocked,
id=31699, stack(0x0000000046871000,0x0000000046892000)]
0x00007f3d601c0000 JavaThread "http-80-124" daemon [_thread_blocked,
id=31698, stack(0x0000000046850000,0x0000000046871000)]
0x00007f3d4c1dc000 JavaThread "http-80-123" daemon [_thread_blocked,
id=31697, stack(0x000000004682f000,0x0000000046850000)]
0x00007f3d57ef3800 JavaThread "http-80-122" daemon [_thread_blocked,
id=31696, stack(0x000000004680e000,0x000000004682f000)]
0x00007f3d60d12000 JavaThread "http-80-121" daemon [_thread_blocked,
id=31695, stack(0x00000000467ed000,0x000000004680e000)]
0x00007f3d60cb6800 JavaThread "http-80-120" daemon [_thread_blocked,
id=31694, stack(0x00000000467cc000,0x00000000467ed000)]
0x00007f3d60a68000 JavaThread "http-80-119" daemon [_thread_blocked,
id=31693, stack(0x00000000467ab000,0x00000000467cc000)]
0x00007f3d56e99000 JavaThread "http-80-118" daemon [_thread_blocked,
id=31692, stack(0x000000004678a000,0x00000000467ab000)]
0x00007f3d56ec7000 JavaThread "http-80-117" daemon [_thread_blocked,
id=31691, stack(0x0000000046769000,0x000000004678a000)]
0x00007f3d55c4b000 JavaThread "http-80-116" daemon [_thread_blocked,
id=31690, stack(0x0000000045c32000,0x0000000045c53000)]
0x00007f3d5c73a000 JavaThread "http-80-115" daemon [_thread_blocked,
id=31689, stack(0x0000000045ec6000,0x0000000045ee7000)]
0x00007f3d55780800 JavaThread "http-80-114" daemon [_thread_blocked,
id=31688, stack(0x0000000046661000,0x0000000046682000)]
0x00007f3d55573000 JavaThread "http-80-113" daemon [_thread_blocked,
id=31687, stack(0x000000004341b000,0x000000004343c000)]
0x00007f3d5ef2a000 JavaThread "http-80-112" daemon [_thread_blocked,
id=31686, stack(0x0000000044eeb000,0x0000000044f0c000)]
0x00007f3d56b71800 JavaThread "http-80-111" daemon [_thread_blocked,
id=31685, stack(0x0000000043cbe000,0x0000000043cdf000)]
0x00007f3d602f2000 JavaThread "http-80-110" daemon [_thread_blocked,
id=31683, stack(0x0000000043f73000,0x0000000043f94000)]
0x00007f3d5d402000 JavaThread "http-80-109" daemon [_thread_blocked,
id=31682, stack(0x0000000044f2d000,0x0000000044f4e000)]
0x00007f3d56d14000 JavaThread "http-80-108" daemon [_thread_blocked,
id=31681, stack(0x00000000464b4000,0x00000000464d5000)]
0x00007f3d5ee7c800 JavaThread "http-80-107" daemon [_thread_blocked,
id=31680, stack(0x0000000045b6c000,0x0000000045b8d000)]
0x00007f3d51651800 JavaThread "BANNERSERVICEPROXY-50" daemon
[_thread_in_native, id=30177,
stack(0x00000000460b5000,0x00000000460d6000)]
0x00007f3d50e9a000 JavaThread "BANNERSERVICEPROXY-49" daemon
[_thread_blocked, id=30176,
stack(0x0000000046094000,0x00000000460b5000)]
0x00007f3d50f49000 JavaThread "BANNERSERVICEPROXY-48" daemon
[_thread_blocked, id=30175,
stack(0x0000000046073000,0x0000000046094000)]
0x00007f3d4c08c800 JavaThread "BANNERSERVICEPROXY-47" daemon
[_thread_blocked, id=30174,
stack(0x0000000046052000,0x0000000046073000)]
0x00007f3d4c4be000 JavaThread "BANNERSERVICEPROXY-46" daemon
[_thread_in_native, id=30173,
stack(0x0000000046031000,0x0000000046052000)]
0x00007f3d4c0bb800 JavaThread "BANNERSERVICEPROXY-45" daemon
[_thread_blocked, id=30172,
stack(0x0000000046010000,0x0000000046031000)]
0x00007f3d51751000 JavaThread "BANNERSERVICEPROXY-44" daemon
[_thread_blocked, id=30171,
stack(0x0000000045fef000,0x0000000046010000)]
0x00007f3d51429800 JavaThread "BANNERSERVICEPROXY-43" daemon
[_thread_blocked, id=30170,
stack(0x0000000045fce000,0x0000000045fef000)]
0x00007f3d51406000 JavaThread "BANNERSERVICEPROXY-42" daemon
[_thread_blocked, id=30169,
stack(0x0000000045fad000,0x0000000045fce000)]
0x00007f3d51391000 JavaThread "BANNERSERVICEPROXY-41" daemon
[_thread_blocked, id=30168,
stack(0x0000000045f8c000,0x0000000045fad000)]
0x00007f3d50e2f000 JavaThread "BANNERSERVICEPROXY-40" daemon
[_thread_blocked, id=30167,
stack(0x0000000045f6b000,0x0000000045f8c000)]
0x00007f3d5023d800 JavaThread "BANNERSERVICEPROXY-39" daemon
[_thread_blocked, id=30166,
stack(0x0000000045f4a000,0x0000000045f6b000)]
0x00007f3d513d6000 JavaThread "BANNERSERVICEPROXY-38" daemon
[_thread_blocked, id=30165,
stack(0x0000000045f29000,0x0000000045f4a000)]
0x00007f3d515cb000 JavaThread "BANNERSERVICEPROXY-37" daemon
[_thread_blocked, id=30164,
stack(0x0000000045f08000,0x0000000045f29000)]
0x00007f3d500f4800 JavaThread "BANNERSERVICEPROXY-36" daemon
[_thread_in_native, id=30163,
stack(0x0000000042905000,0x0000000042926000)]
0x00007f3d50e1e000 JavaThread "BANNERSERVICEPROXY-35" daemon
[_thread_in_native, id=30162,
stack(0x0000000044eca000,0x0000000044eeb000)]
0x00007f3d51028800 JavaThread "BANNERSERVICEPROXY-34" daemon
[_thread_in_native, id=30161,
stack(0x000000004530b000,0x000000004532c000)]
0x00007f3d51617800 JavaThread "BANNERSERVICEPROXY-33" daemon
[_thread_blocked, id=30160,
stack(0x0000000044d3e000,0x0000000044d5f000)]
0x00007f3d50c06000 JavaThread "BANNERSERVICEPROXY-32" daemon
[_thread_blocked, id=30159,
stack(0x00000000411cd000,0x00000000411ee000)]
0x00007f3d5e2e0800 JavaThread "BANNERSERVICEPROXY-31" daemon
[_thread_blocked, id=30158,
stack(0x0000000043d84000,0x0000000043da5000)]
0x00007f3d5150d800 JavaThread "BANNERSERVICEPROXY-30" daemon
[_thread_blocked, id=30157,
stack(0x00000000434c0000,0x00000000434e1000)]
0x00007f3d5745b800 JavaThread "BANNERSERVICEPROXY-29" daemon
[_thread_in_native, id=30156,
stack(0x0000000044e46000,0x0000000044e67000)]
0x00007f3d50e89000 JavaThread "BANNERSERVICEPROXY-28" daemon
[_thread_blocked, id=30155,
stack(0x0000000043523000,0x0000000043544000)]
0x00007f3d510af800 JavaThread "BANNERSERVICEPROXY-27" daemon
[_thread_blocked, id=30154,
stack(0x0000000042eb1000,0x0000000042ed2000)]
0x00007f3d50da1000 JavaThread "BANNERSERVICEPROXY-26" daemon
[_thread_blocked, id=30153,
stack(0x0000000042b36000,0x0000000042b57000)]
0x00007f3d51ce2000 JavaThread "BANNERSERVICEPROXY-25" daemon
[_thread_in_native, id=30152,
stack(0x00000000450fb000,0x000000004511c000)]
0x00007f3d5115b800 JavaThread "BANNERSERVICEPROXY-24" daemon
[_thread_blocked, id=30151,
stack(0x0000000042e90000,0x0000000042eb1000)]
0x00007f3d5123c800 JavaThread "BANNERSERVICEPROXY-23" daemon
[_thread_blocked, id=30150,
stack(0x0000000042f98000,0x0000000042fb9000)]
0x00007f3d51018800 JavaThread "BANNERSERVICEPROXY-22" daemon
[_thread_blocked, id=30149,
stack(0x0000000043e29000,0x0000000043e4a000)]
0x00007f3d501bf000 JavaThread "BANNERSERVICEPROXY-21" daemon
[_thread_blocked, id=30148,
stack(0x0000000045665000,0x0000000045686000)]
0x00007f3d51159800 JavaThread "BANNERSERVICEPROXY-20" daemon
[_thread_blocked, id=30147,
stack(0x000000004281e000,0x000000004283f000)]
0x00007f3d5137f800 JavaThread "BANNERSERVICEPROXY-19" daemon
[_thread_in_native, id=30146,
stack(0x0000000042e4e000,0x0000000042e6f000)]
0x00007f3d5160d000 JavaThread "BANNERSERVICEPROXY-18" daemon
[_thread_in_native, id=30145,
stack(0x00000000433b8000,0x00000000433d9000)]
0x00007f3d5160f000 JavaThread "BANNERSERVICEPROXY-17" daemon
[_thread_in_native, id=30144,
stack(0x0000000043aae000,0x0000000043acf000)]
0x00007f3d500af800 JavaThread "BANNERSERVICEPROXY-16" daemon
[_thread_in_native, id=30143,
stack(0x0000000044771000,0x0000000044792000)]
0x00007f3d50e40000 JavaThread "BANNERSERVICEPROXY-15" daemon
[_thread_blocked, id=30142,
stack(0x0000000045e63000,0x0000000045e84000)]
0x00007f3d50dd9000 JavaThread "BANNERSERVICEPROXY-14" daemon
[_thread_blocked, id=30141,
stack(0x00000000432f2000,0x0000000043313000)]
0x00007f3d50023800 JavaThread "BANNERSERVICEPROXY-13" daemon
[_thread_blocked, id=30140,
stack(0x0000000042b78000,0x0000000042b99000)]
0x00007f3d500b5000 JavaThread "BANNERSERVICEPROXY-12" daemon
[_thread_in_native, id=30139,
stack(0x00000000427bb000,0x00000000427dc000)]
0x00007f3d50f04800 JavaThread "BANNERSERVICEPROXY-11" daemon
[_thread_in_native, id=30138,
stack(0x0000000045d3a000,0x0000000045d5b000)]
0x00007f3d50573000 JavaThread "BANNERSERVICEPROXY-10" daemon
[_thread_blocked, id=30137,
stack(0x0000000045d5b000,0x0000000045d7c000)]
0x00007f3d51168800 JavaThread "BANNERSERVICEPROXY-9" daemon
[_thread_in_native, id=30136,
stack(0x0000000045ea5000,0x0000000045ec6000)]
0x00007f3d50f27800 JavaThread "BANNERSERVICEPROXY-8" daemon
[_thread_in_native, id=30135,
stack(0x0000000045e42000,0x0000000045e63000)]
0x00007f3d5011c800 JavaThread "BANNERSERVICEPROXY-7" daemon
[_thread_blocked, id=30134,
stack(0x0000000045e21000,0x0000000045e42000)]
0x00007f3d50d5a000 JavaThread "BANNERSERVICEPROXY-6" daemon
[_thread_blocked, id=30133,
stack(0x000000004345d000,0x000000004347e000)]
0x00007f3d505f1000 JavaThread "BANNERSERVICEPROXY-5" daemon
[_thread_blocked, id=30132,
stack(0x0000000045e00000,0x0000000045e21000)]
0x00007f3d513a7800 JavaThread "BANNERSERVICEPROXY-4" daemon
[_thread_blocked, id=30131,
stack(0x0000000045bf0000,0x0000000045c11000)]
0x00007f3d5e302000 JavaThread "BANNERSERVICEPROXY-3" daemon
[_thread_blocked, id=30130,
stack(0x00000000443b4000,0x00000000443d5000)]
0x00007f3d6442d800 JavaThread "BANNERSERVICEPROXY-2" daemon
[_thread_blocked, id=30129,
stack(0x0000000042ad3000,0x0000000042af4000)]
0x00007f3d5e9b2800 JavaThread "BANNERSERVICEPROXY-1" daemon
[_thread_blocked, id=30128,
stack(0x0000000043145000,0x0000000043166000)]
0x00007f3d5864b800 JavaThread "http-443-6" daemon [_thread_blocked,
id=29848, stack(0x0000000045ee7000,0x0000000045f08000)]
0x00007f3d5e352800 JavaThread "AOL-10" daemon [_thread_blocked,
id=29754, stack(0x0000000042bba000,0x0000000042bdb000)]
0x00007f3d4c09e000 JavaThread "AOL-9" daemon [_thread_blocked,
id=29461, stack(0x0000000045bcf000,0x0000000045bf0000)]
0x00007f3d51246800 JavaThread "AOL-8" daemon [_thread_blocked,
id=29441, stack(0x0000000045c53000,0x0000000045c74000)]
0x00007f3d50c04800 JavaThread "AOL-7" daemon [_thread_blocked,
id=29380, stack(0x0000000044c57000,0x0000000044c78000)]
0x00007f3d588af000 JavaThread "AOL-6" daemon [_thread_blocked,
id=29351, stack(0x0000000043ff7000,0x0000000044018000)]
0x00007f3d59214000 JavaThread "AOL-5" daemon [_thread_blocked,
id=29089, stack(0x000000004468a000,0x00000000446ab000)]
0x00007f3d6020a800 JavaThread "AOL-4" daemon [_thread_blocked,
id=29060, stack(0x00000000445e5000,0x0000000044606000)]
0x00007f3d60071800 JavaThread "AOL-3" daemon [_thread_blocked,
id=29059, stack(0x0000000042f77000,0x0000000042f98000)]
0x00007f3d50787800 JavaThread "AOL-2" daemon [_thread_blocked,
id=28774, stack(0x000000004322c000,0x000000004324d000)]
0x00007f3d5854f800 JavaThread "AOL-1" daemon [_thread_blocked,
id=28735, stack(0x00000000431c9000,0x00000000431ea000)]
0x00007f3d64320800 JavaThread "HYVES-9" daemon [_thread_blocked,
id=28392, stack(0x000000004326e000,0x000000004328f000)]
0x00007f3d5e338800 JavaThread "HYVES-8" daemon [_thread_blocked,
id=28391, stack(0x0000000042ffb000,0x000000004301c000)]
0x00007f3d5e41f000 JavaThread "HYVES-7" daemon [_thread_blocked,
id=28389, stack(0x0000000042b57000,0x0000000042b78000)]
0x00007f3d5e68b800 JavaThread "HYVES-6" daemon [_thread_blocked,
id=28388, stack(0x0000000043355000,0x0000000043376000)]
0x00007f3d5cfc8000 JavaThread "HYVES-5" daemon [_thread_blocked,
id=28387, stack(0x0000000042cc2000,0x0000000042ce3000)]
0x00007f3d5ef2c000 JavaThread "HYVES-4" daemon [_thread_blocked,
id=28386, stack(0x0000000042e2d000,0x0000000042e4e000)]
0x00007f3d5cad8000 JavaThread "HYVES-3" daemon [_thread_blocked,
id=28385, stack(0x00000000428e4000,0x0000000042905000)]
0x00007f3d5cc5f000 JavaThread "HYVES-2" daemon [_thread_blocked,
id=28384, stack(0x0000000042c3e000,0x0000000042c5f000)]
0x00007f3d5e568000 JavaThread "HYVES-1" daemon [_thread_blocked,
id=28383, stack(0x0000000042989000,0x00000000429aa000)]
0x00007f3d5ea96800 JavaThread "HYVES-0" daemon [_thread_blocked,
id=28382, stack(0x0000000042b15000,0x0000000042b36000)]
0x00007f3d515fc000 JavaThread
"RefQueueWorker@org.apache.http.impl.conn.tsccm.ConnPoolByRoute@6b64a717" daemon [_thread_blocked, id=28379, stack(0x0000000044540000,0x0000000044561000)]
0x00007f3d5e55a800 JavaThread "MultiBackend-Executor-Thread-8" daemon
[_thread_blocked, id=27979,
stack(0x0000000042ef3000,0x0000000042f14000)]
0x00007f3d50878800 JavaThread "MultiBackend-Executor-Thread-33" daemon
[_thread_blocked, id=27940,
stack(0x0000000043eef000,0x0000000043f10000)]
0x00007f3d50ebc800 JavaThread "MultiBackend-Executor-Thread-7" daemon
[_thread_blocked, id=27939,
stack(0x00000000442ac000,0x00000000442cd000)]
0x00007f3d60020000 JavaThread "JOSCAR-MISC-THREAD-5" daemon
[_thread_blocked, id=27909,
stack(0x0000000041803000,0x0000000041824000)]
0x00007f3d604e5000 JavaThread "OSCAR-EXTERNAL-SERVICE-4" daemon
[_thread_blocked, id=27908,
stack(0x0000000044249000,0x000000004426a000)]
0x00007f3d60637000 JavaThread "OSCAR-BUDDY-INFO-4" daemon
[_thread_blocked, id=27907,
stack(0x0000000045287000,0x00000000452a8000)]
0x00007f3d649c6800 JavaThread "MYSPACE-9" daemon [_thread_blocked,
id=27901, stack(0x00000000430c1000,0x00000000430e2000)]
0x00007f3d5e9b5000 JavaThread "MYSPACE-8" daemon [_thread_blocked,
id=27900, stack(0x00000000430a0000,0x00000000430c1000)]
0x00007f3d643b3800 JavaThread "MYSPACE-7" daemon [_thread_blocked,
id=27899, stack(0x0000000043187000,0x00000000431a8000)]
0x00007f3d64428800 JavaThread "MYSPACE-6" daemon [_thread_blocked,
id=27897, stack(0x000000004320b000,0x000000004322c000)]
0x00007f3d645f1800 JavaThread "MYSPACE-5" daemon [_thread_blocked,
id=27896, stack(0x000000004307f000,0x00000000430a0000)]
0x00007f3d5e692000 JavaThread "MYSPACE-4" daemon [_thread_blocked,
id=27894, stack(0x00000000431ea000,0x000000004320b000)]
0x00007f3d5e698800 JavaThread "MYSPACE-3" daemon [_thread_blocked,
id=27893, stack(0x0000000043124000,0x0000000043145000)]
0x00007f3d645f8000 JavaThread "MYSPACE-2" daemon [_thread_blocked,
id=27892, stack(0x0000000043334000,0x0000000043355000)]
0x00007f3d50ef7000 JavaThread "JOSCAR-MISC-THREAD-4" daemon
[_thread_blocked, id=27891,
stack(0x0000000043103000,0x0000000043124000)]
0x00007f3d5e418000 JavaThread "MYSPACE-1" daemon [_thread_blocked,
id=27890, stack(0x000000004324d000,0x000000004326e000)]
0x00007f3d5d637000 JavaThread "MYSPACE-0" daemon [_thread_blocked,
id=27889, stack(0x000000004538f000,0x00000000453b0000)]
0x00007f3d50d37000 JavaThread "OSCAR-EXTERNAL-SERVICE-3" daemon
[_thread_blocked, id=27885,
stack(0x0000000045854000,0x0000000045875000)]
0x00007f3d50d5b000 JavaThread "OSCAR-BUDDY-INFO-3" daemon
[_thread_blocked, id=27884,
stack(0x0000000044d80000,0x0000000044da1000)]
0x00007f3d598da000 JavaThread "MultiBackend-Executor-Thread-6" daemon
[_thread_blocked, id=27868,
stack(0x00000000433d9000,0x00000000433fa000)]
0x00007f3d5a3e7800 JavaThread "MultiBackend-Executor-Thread-5" daemon
[_thread_blocked, id=27776,
stack(0x0000000042881000,0x00000000428a2000)]
0x00007f3d60c36800 JavaThread "FACEBOOK-MESSENGER-39" daemon
[_thread_blocked, id=27637,
stack(0x0000000045b4b000,0x0000000045b6c000)]
0x00007f3d5d546000 JavaThread "OSCAR-KEEPALIVE-4" daemon
[_thread_blocked, id=27632,
stack(0x0000000045ae8000,0x0000000045b09000)]
0x00007f3d5c77c000 JavaThread "OSCAR-KEEPALIVE-3" daemon
[_thread_blocked, id=27631,
stack(0x0000000045ac7000,0x0000000045ae8000)]
0x00007f3d511f8800 JavaThread "FACEBOOK-MESSENGER-38" daemon
[_thread_blocked, id=27630,
stack(0x0000000045aa6000,0x0000000045ac7000)]
0x00007f3d602f8800 JavaThread "FACEBOOK-MESSENGER-37" daemon
[_thread_blocked, id=27624,
stack(0x0000000045a85000,0x0000000045aa6000)]
0x00007f3d50634000 JavaThread "FACEBOOK-MESSENGER-36" daemon
[_thread_blocked, id=27623,
stack(0x0000000045a64000,0x0000000045a85000)]
0x00007f3d50d12000 JavaThread "FACEBOOK-MESSENGER-35" daemon
[_thread_blocked, id=27622,
stack(0x0000000045a43000,0x0000000045a64000)]
0x00007f3d57f40000 JavaThread "SocketConnectorIoProcessor-5.1" daemon
[_thread_in_native, id=27621,
stack(0x0000000045a22000,0x0000000045a43000)]
0x00007f3d649bc800 JavaThread "AIM-8" daemon [_thread_blocked,
id=27619, stack(0x00000000459e0000,0x0000000045a01000)]
0x00007f3d5ef67800 JavaThread "FACEBOOK-MESSENGER-34" daemon
[_thread_blocked, id=27612,
stack(0x00000000458f9000,0x000000004591a000)]
0x00007f3d5c2d0000 JavaThread "FACEBOOK-MESSENGER-33" daemon
[_thread_blocked, id=27611,
stack(0x00000000458d8000,0x00000000458f9000)]
0x00007f3d645d5000 JavaThread "SocketConnectorIoProcessor-5.0" daemon
[_thread_in_native, id=27608,
stack(0x0000000045875000,0x0000000045896000)]
0x00007f3d58612800 JavaThread "FACEBOOK-MESSENGER-32" daemon
[_thread_blocked, id=27606,
stack(0x0000000045833000,0x0000000045854000)]
0x00007f3d50d13000 JavaThread "FACEBOOK-MESSENGER-31" daemon
[_thread_blocked, id=27605,
stack(0x0000000045812000,0x0000000045833000)]
0x00007f3d5edac000 JavaThread "FACEBOOK-MESSENGER-30" daemon
[_thread_blocked, id=27604,
stack(0x00000000457f1000,0x0000000045812000)]
0x00007f3d5c762000 JavaThread "FACEBOOK-MESSENGER-29" daemon
[_thread_blocked, id=27603,
stack(0x00000000457d0000,0x00000000457f1000)]
0x00007f3d5d40d800 JavaThread "FACEBOOK-MESSENGER-28" daemon
[_thread_blocked, id=27601,
stack(0x00000000457af000,0x00000000457d0000)]
0x00007f3d50d16800 JavaThread "FACEBOOK-MESSENGER-27" daemon
[_thread_in_native, id=27600,
stack(0x000000004578e000,0x00000000457af000)]
0x00007f3d5edc9800 JavaThread "FACEBOOK-MESSENGER-26" daemon
[_thread_blocked, id=27599,
stack(0x000000004576d000,0x000000004578e000)]
0x00007f3d5cc99800 JavaThread "FACEBOOK-MESSENGER-25" daemon
[_thread_in_native, id=27598,
stack(0x000000004574c000,0x000000004576d000)]
0x00007f3d5cd23800 JavaThread "FACEBOOK-MESSENGER-24" daemon
[_thread_blocked, id=27596,
stack(0x000000004572b000,0x000000004574c000)]
0x00007f3d5d42e800 JavaThread "FACEBOOK-MESSENGER-23" daemon
[_thread_blocked, id=27595,
stack(0x000000004570a000,0x000000004572b000)]
0x00007f3d5c74f800 JavaThread "FACEBOOK-MESSENGER-22" daemon
[_thread_blocked, id=27594,
stack(0x00000000456e9000,0x000000004570a000)]
0x00007f3d6466c800 JavaThread "FACEBOOK-MESSENGER-21" daemon
[_thread_blocked, id=27592,
stack(0x00000000456c8000,0x00000000456e9000)]
0x00007f3d60635800 JavaThread "FACEBOOK-MESSENGER-20" daemon
[_thread_blocked, id=27591,
stack(0x00000000456a7000,0x00000000456c8000)]
0x00007f3d59403000 JavaThread "FACEBOOK-MESSENGER-19" daemon
[_thread_blocked, id=27590,
stack(0x0000000045686000,0x00000000456a7000)]
0x00007f3d60857800 JavaThread "FACEBOOK-MESSENGER-18" daemon
[_thread_blocked, id=27588,
stack(0x0000000045644000,0x0000000045665000)]
0x00007f3d5c91f800 JavaThread "OSCAR-KEEPALIVE-2" daemon
[_thread_blocked, id=27587,
stack(0x0000000045623000,0x0000000045644000)]
0x00007f3d503c9800 JavaThread "JOSCAR-MISC-THREAD-3" daemon
[_thread_blocked, id=27586,
stack(0x0000000045602000,0x0000000045623000)]
0x00007f3d51180800 JavaThread "OSCAR-EXTERNAL-SERVICE-2" daemon
[_thread_blocked, id=27584,
stack(0x00000000455e1000,0x0000000045602000)]
0x00007f3d50582800 JavaThread "OSCAR-BUDDY-INFO-2" daemon
[_thread_blocked, id=27583,
stack(0x00000000455c0000,0x00000000455e1000)]
0x00007f3d50c07800 JavaThread "OSCAR-FLAP-PROCESSOR-4" daemon
[_thread_blocked, id=27582,
stack(0x000000004559f000,0x00000000455c0000)]
0x00007f3d51239000 JavaThread "FACEBOOK-MESSENGER-17" daemon
[_thread_blocked, id=27581,
stack(0x000000004557e000,0x000000004559f000)]
0x00007f3d5034a000 JavaThread "FACEBOOK-MESSENGER-16" daemon
[_thread_blocked, id=27569,
stack(0x000000004555d000,0x000000004557e000)]
0x00007f3d60286800 JavaThread "FACEBOOK-MESSENGER-15" daemon
[_thread_blocked, id=27568,
stack(0x000000004553c000,0x000000004555d000)]
0x00007f3d5c7dd000 JavaThread "OSCAR-KEEPALIVE-1" daemon
[_thread_blocked, id=27566,
stack(0x00000000454fa000,0x000000004551b000)]
0x00007f3d50007800 JavaThread "JOSCAR-MISC-THREAD-2" daemon
[_thread_blocked, id=27565,
stack(0x00000000454d9000,0x00000000454fa000)]
0x00007f3d5cd13000 JavaThread "SocketConnectorIoProcessor-4.1" daemon
[_thread_in_native, id=27564,
stack(0x00000000454b8000,0x00000000454d9000)]
0x00007f3d5110f000 JavaThread "OSCAR-FLAP-PROCESSOR-3" daemon
[_thread_in_native, id=27563,
stack(0x0000000045497000,0x00000000454b8000)]
0x00007f3d50383800 JavaThread "OSCAR-EXTERNAL-SERVICE-1" daemon
[_thread_blocked, id=27562,
stack(0x0000000045476000,0x0000000045497000)]
0x00007f3d50c03800 JavaThread "OSCAR-BUDDY-INFO-1" daemon
[_thread_blocked, id=27561,
stack(0x0000000045455000,0x0000000045476000)]
0x00007f3d50225800 JavaThread "OSCAR-FLAP-PROCESSOR-2" daemon
[_thread_blocked, id=27560,
stack(0x0000000045434000,0x0000000045455000)]
0x00007f3d60bea800 JavaThread "FACEBOOK-MESSENGER-14" daemon
[_thread_blocked, id=27559,
stack(0x0000000045413000,0x0000000045434000)]
0x00007f3d584f6800 JavaThread "http-443-5" daemon [_thread_blocked,
id=27558, stack(0x00000000453f2000,0x0000000045413000)]
0x00007f3d58b85800 JavaThread "http-443-4" daemon [_thread_blocked,
id=27557, stack(0x00000000453d1000,0x00000000453f2000)]
0x00007f3d5c7de000 JavaThread "FACEBOOK-MESSENGER-13" daemon
[_thread_blocked, id=27556,
stack(0x00000000453b0000,0x00000000453d1000)]
0x00007f3d50008800 JavaThread "FACEBOOK-MESSENGER-12" daemon
[_thread_blocked, id=27546,
stack(0x0000000045266000,0x0000000045287000)]
0x00007f3d51233000 JavaThread "FACEBOOK-MESSENGER-11" daemon
[_thread_blocked, id=27542,
stack(0x00000000451e2000,0x0000000045203000)]
0x00007f3d5ed17800 JavaThread "MultiBackend-Executor-Thread-4" daemon
[_thread_blocked, id=27536,
stack(0x000000004513d000,0x000000004515e000)]
0x00007f3d511e1000 JavaThread "MultiBackend-Executor-Thread-3" daemon
[_thread_blocked, id=27533,
stack(0x00000000450da000,0x00000000450fb000)]
0x00007f3d51185000 JavaThread "FACEBOOK-MESSENGER-10" daemon
[_thread_blocked, id=27532,
stack(0x00000000450b9000,0x00000000450da000)]
0x00007f3d5e52b000 JavaThread "AOL-9" daemon [_thread_blocked,
id=27530, stack(0x0000000045077000,0x0000000045098000)]
0x00007f3d5ee30800 JavaThread "AOL-8" daemon [_thread_blocked,
id=27529, stack(0x0000000045056000,0x0000000045077000)]
0x00007f3d5c703000 JavaThread "AOL-7" daemon [_thread_blocked,
id=27528, stack(0x0000000045035000,0x0000000045056000)]
0x00007f3d5c95c800 JavaThread "AOL-6" daemon [_thread_blocked,
id=27527, stack(0x0000000045014000,0x0000000045035000)]
0x00007f3d5c14f000 JavaThread "AOL-5" daemon [_thread_blocked,
id=27526, stack(0x0000000044ff3000,0x0000000045014000)]
0x00007f3d5c900800 JavaThread "AOL-4" daemon [_thread_blocked,
id=27523, stack(0x0000000044f90000,0x0000000044fb1000)]
0x00007f3d5cc2c000 JavaThread "MultiBackend-Executor-Thread-2" daemon
[_thread_blocked, id=27522,
stack(0x0000000044f6f000,0x0000000044f90000)]
0x00007f3d60491800 JavaThread "MultiBackend-Executor-Thread-1" daemon
[_thread_blocked, id=27521,
stack(0x0000000044f4e000,0x0000000044f6f000)]
0x00007f3d5ea20800 JavaThread "AOL-3" daemon [_thread_blocked,
id=27519, stack(0x0000000044f0c000,0x0000000044f2d000)]
0x00007f3d5d4a8800 JavaThread "AOL-2" daemon [_thread_blocked,
id=27515, stack(0x0000000044e88000,0x0000000044ea9000)]
0x00007f3d647b3000 JavaThread "AOL-1" daemon [_thread_blocked,
id=27514, stack(0x0000000044e67000,0x0000000044e88000)]
0x00007f3d51121800 JavaThread "JOSCAR-MISC-THREAD-1" daemon
[_thread_blocked, id=27512,
stack(0x0000000044e25000,0x0000000044e46000)]
0x00007f3d5cca4000 JavaThread "FACEBOOK-MESSENGER-9" daemon
[_thread_blocked, id=27511,
stack(0x0000000044e04000,0x0000000044e25000)]
0x00007f3d5d53c800 JavaThread "OSCAR-KEEPALIVE-0" daemon
[_thread_blocked, id=27510,
stack(0x0000000044de3000,0x0000000044e04000)]
0x00007f3d57f49800 JavaThread "AOL-0" daemon [_thread_blocked,
id=27509, stack(0x0000000044dc2000,0x0000000044de3000)]
0x00007f3d57f77800 JavaThread "SocketConnectorIoProcessor-4.0" daemon
[_thread_in_native, id=27508,
stack(0x0000000044da1000,0x0000000044dc2000)]
0x00007f3d510f3000 JavaThread "OSCAR-FLAP-PROCESSOR-1" daemon
[_thread_blocked, id=27506,
stack(0x0000000044d5f000,0x0000000044d80000)]
0x00007f3d5cf6f800 JavaThread "FACEBOOK-MESSENGER-8" daemon
[_thread_blocked, id=27504,
stack(0x0000000044d1d000,0x0000000044d3e000)]
0x00007f3d50607800 JavaThread "FACEBOOK-MESSENGER-7" daemon
[_thread_in_native, id=27503,
stack(0x0000000044cfc000,0x0000000044d1d000)]
0x00007f3d50d13800 JavaThread "OSCAR-EXTERNAL-SERVICE-0" daemon
[_thread_blocked, id=27502,
stack(0x0000000044cdb000,0x0000000044cfc000)]
0x00007f3d50d70000 JavaThread "OSCAR-BUDDY-INFO-0" daemon
[_thread_blocked, id=27501,
stack(0x0000000044cba000,0x0000000044cdb000)]
0x00007f3d503d3000 JavaThread "OSCAR-FLAP-PROCESSOR-0" daemon
[_thread_in_native, id=27500,
stack(0x0000000044c99000,0x0000000044cba000)]
0x00007f3d5cc84000 JavaThread "FACEBOOK-MESSENGER-6" daemon
[_thread_blocked, id=27487,
stack(0x0000000044aec000,0x0000000044b0d000)]
0x00007f3d5cd1e000 JavaThread "GTALK-9" daemon [_thread_blocked,
id=27486, stack(0x0000000044acb000,0x0000000044aec000)]
0x00007f3d5c89a000 JavaThread "GTALK-8" daemon [_thread_blocked,
id=27482, stack(0x0000000044a47000,0x0000000044a68000)]
0x00007f3d5cc36000 JavaThread "GTALK-7" daemon [_thread_blocked,
id=27481, stack(0x0000000044a26000,0x0000000044a47000)]
0x00007f3d5c801800 JavaThread "GTALK-6" daemon [_thread_blocked,
id=27480, stack(0x0000000044a05000,0x0000000044a26000)]
0x00007f3d5c7fe000 JavaThread "GTALK-5" daemon [_thread_blocked,
id=27479, stack(0x00000000449e4000,0x0000000044a05000)]
0x00007f3d5c7fb800 JavaThread "GTALK-4" daemon [_thread_blocked,
id=27478, stack(0x00000000449c3000,0x00000000449e4000)]
0x00007f3d5c7fa000 JavaThread "FACEBOOK-MESSENGER-5" daemon
[_thread_blocked, id=27477,
stack(0x00000000449a2000,0x00000000449c3000)]
0x00007f3d5039d800 JavaThread "FACEBOOK-MESSENGER-4" daemon
[_thread_blocked, id=27476,
stack(0x0000000044981000,0x00000000449a2000)]
0x00007f3d5c9c1800 JavaThread "FACEBOOK-MESSENGER-3" daemon
[_thread_blocked, id=27475,
stack(0x0000000044960000,0x0000000044981000)]
0x00007f3d5c6f5800 JavaThread "SocketConnectorIoProcessor-3.1" daemon
[_thread_blocked, id=27473,
stack(0x000000004491e000,0x000000004493f000)]
0x00007f3d60f5c800 JavaThread "FACEBOOK-MESSENGER-2" daemon
[_thread_blocked, id=27472,
stack(0x00000000448fd000,0x000000004491e000)]
0x00007f3d5c960800 JavaThread "SocketConnectorIoProcessor-3.0" daemon
[_thread_blocked, id=27470,
stack(0x00000000448bb000,0x00000000448dc000)]
0x00007f3d644d1000 JavaThread "SocketConnectorIoProcessor-2.1" daemon
[_thread_in_native, id=27469,
stack(0x000000004489a000,0x00000000448bb000)]
0x00007f3d5c829800 JavaThread "SocketConnector-3" daemon
[_thread_in_native, id=27468,
stack(0x0000000044879000,0x000000004489a000)]
0x00007f3d5c9db000 JavaThread "FACEBOOK-MESSENGER-1" daemon
[_thread_blocked, id=27467,
stack(0x0000000044858000,0x0000000044879000)]
0x00007f3d50388000 JavaThread "FACEBOOK-MESSENGER-0" daemon
[_thread_blocked, id=27466,
stack(0x0000000044837000,0x0000000044858000)]
0x00007f3d5ecf4800 JavaThread "GTALK-3" daemon [_thread_blocked,
id=27464, stack(0x00000000447f5000,0x0000000044816000)]
0x00007f3d6466d800 JavaThread "GTALK-2" daemon [_thread_blocked,
id=27461, stack(0x0000000044792000,0x00000000447b3000)]
0x00007f3d649c2800 JavaThread "GTALK-1" daemon [_thread_blocked,
id=27458, stack(0x000000004472f000,0x0000000044750000)]
0x00007f3d5c64e800 JavaThread "GTALK-0" daemon [_thread_blocked,
id=27457, stack(0x000000004470e000,0x000000004472f000)]
0x00007f3d5c17d000 JavaThread "SocketConnectorIoProcessor-2.0" daemon
[_thread_in_native, id=27456,
stack(0x00000000446ed000,0x000000004470e000)]
0x00007f3d595ce800 JavaThread "http-443-3" daemon [_thread_blocked,
id=27440, stack(0x00000000444dd000,0x00000000444fe000)]
0x00007f3d5c889800 JavaThread "MultiBackend-Executor-Thread-30" daemon
[_thread_blocked, id=27434,
stack(0x0000000044417000,0x0000000044438000)]
0x00007f3d5ccdf000 JavaThread "MultiBackend-Executor-Thread-28" daemon
[_thread_blocked, id=27430,
stack(0x0000000044393000,0x00000000443b4000)]
0x00007f3d5c9dd000 JavaThread "MultiBackend-Executor-Thread-26" daemon
[_thread_blocked, id=27428,
stack(0x0000000044351000,0x0000000044372000)]
0x00007f3d5c824000 JavaThread "MultiBackend-Executor-Thread-25" daemon
[_thread_blocked, id=27426,
stack(0x000000004430f000,0x0000000044330000)]
0x00007f3d58625000 JavaThread "MultiThreadedHttpConnectionManager
cleanup" daemon [_thread_blocked, id=27421,
stack(0x000000004426a000,0x000000004428b000)]
0x00007f3d5861d800 JavaThread "http-443-2" daemon [_thread_blocked,
id=27410, stack(0x00000000440ff000,0x0000000044120000)]
0x00007f3d5c7f7000 JavaThread "SocketConnectorIoProcessor-1.1" daemon
[_thread_in_native, id=27409,
stack(0x00000000440de000,0x00000000440ff000)]
0x00007f3d5cb6a800 JavaThread "SocketConnectorIoProcessor-1.0" daemon
[_thread_in_native, id=27407,
stack(0x000000004409c000,0x00000000440bd000)]
0x00007f3d5cb63000 JavaThread "MultiBackend-Executor-Thread-20" daemon
[_thread_blocked, id=27404,
stack(0x0000000044039000,0x000000004405a000)]
0x00007f3d5cb49000 JavaThread "MultiBackend-Executor-Thread-18" daemon
[_thread_blocked, id=27399,
stack(0x0000000043f94000,0x0000000043fb5000)]
0x00007f3d5ca6c800 JavaThread "MultiBackend-Executor-Thread-15" daemon
[_thread_blocked, id=27396,
stack(0x0000000043f31000,0x0000000043f52000)]
0x00007f3d5011e800 JavaThread "MultiBackend-Executor-Thread-14" daemon
[_thread_blocked, id=27395,
stack(0x0000000043f10000,0x0000000043f31000)]
0x00007f3d5ec2a800 JavaThread "SocketConnectorIoProcessor-0.0" daemon
[_thread_blocked, id=27391,
stack(0x0000000043c9d000,0x0000000043cbe000)]
0x00007f3d5e9d5800 JavaThread "MultiBackend-Executor-Thread-10" daemon
[_thread_blocked, id=27390,
stack(0x0000000043e8c000,0x0000000043ead000)]
0x00007f3d5ec32800 JavaThread "MultiBackend-Executor-Thread-9" daemon
[_thread_blocked, id=27389,
stack(0x0000000043e6b000,0x0000000043e8c000)]
0x00007f3d500cb000 JavaThread "BANNERSERVICEPROXY-50" daemon
[_thread_blocked, id=27388,
stack(0x0000000043e4a000,0x0000000043e6b000)]
0x00007f3d5ce71800 JavaThread "SocketConnectorIoProcessor-0.1" daemon
[_thread_blocked, id=27384,
stack(0x0000000043dc6000,0x0000000043de7000)]
0x00007f3d501c6800 JavaThread "BANNERSERVICEPROXY-49" daemon
[_thread_blocked, id=27377,
stack(0x0000000043cdf000,0x0000000043d00000)]
0x00007f3d589f8000 JavaThread "SocketConnector-0" daemon
[_thread_in_native, id=27374,
stack(0x0000000043c7c000,0x0000000043c9d000)]
0x00007f3d50606800 JavaThread "BANNERSERVICEPROXY-48" daemon
[_thread_blocked, id=27373,
stack(0x0000000043c5b000,0x0000000043c7c000)]
0x00007f3d5862b000 JavaThread "BANNERSERVICEPROXY-47" daemon
[_thread_blocked, id=27372,
stack(0x0000000043c3a000,0x0000000043c5b000)]
0x00007f3d58629000 JavaThread "BANNERSERVICEPROXY-46" daemon
[_thread_blocked, id=27371,
stack(0x0000000043c19000,0x0000000043c3a000)]
0x00007f3d5861a000 JavaThread "BANNERSERVICEPROXY-45" daemon
[_thread_blocked, id=27370,
stack(0x0000000043bf8000,0x0000000043c19000)]
0x00007f3d58618000 JavaThread "BANNERSERVICEPROXY-44" daemon
[_thread_blocked, id=27369,
stack(0x0000000043bd7000,0x0000000043bf8000)]
0x00007f3d58502000 JavaThread "BANNERSERVICEPROXY-43" daemon
[_thread_blocked, id=27368,
stack(0x0000000043bb6000,0x0000000043bd7000)]
0x00007f3d58500000 JavaThread "BANNERSERVICEPROXY-42" daemon
[_thread_blocked, id=27367,
stack(0x0000000043b95000,0x0000000043bb6000)]
0x00007f3d58a2f000 JavaThread "BANNERSERVICEPROXY-41" daemon
[_thread_blocked, id=27366,
stack(0x0000000043b74000,0x0000000043b95000)]
0x00007f3d58a2d000 JavaThread "BANNERSERVICEPROXY-40" daemon
[_thread_blocked, id=27365,
stack(0x0000000043b53000,0x0000000043b74000)]
0x00007f3d589f6000 JavaThread "BANNERSERVICEPROXY-39" daemon
[_thread_blocked, id=27364,
stack(0x0000000043b32000,0x0000000043b53000)]
0x00007f3d583f6000 JavaThread "BANNERSERVICEPROXY-38" daemon
[_thread_blocked, id=27363,
stack(0x0000000043b11000,0x0000000043b32000)]
0x00007f3d5cab3000 JavaThread "pool-18-thread-4" [_thread_blocked,
id=27362, stack(0x0000000043af0000,0x0000000043b11000)]
0x00007f3d5862f800 JavaThread "BANNERSERVICEPROXY-37" daemon
[_thread_blocked, id=27361,
stack(0x0000000043acf000,0x0000000043af0000)]
0x00007f3d5d54d000 JavaThread "pool-18-thread-3" [_thread_blocked,
id=27359, stack(0x0000000043a8d000,0x0000000043aae000)]
0x00007f3d58616000 JavaThread "BANNERSERVICEPROXY-36" daemon
[_thread_blocked, id=27358,
stack(0x0000000043a6c000,0x0000000043a8d000)]
0x00007f3d58614000 JavaThread "BANNERSERVICEPROXY-35" daemon
[_thread_blocked, id=27357,
stack(0x0000000043a4b000,0x0000000043a6c000)]
0x00007f3d5d55e800 JavaThread "pool-18-thread-2" [_thread_blocked,
id=27356, stack(0x0000000043a2a000,0x0000000043a4b000)]
0x00007f3d58635800 JavaThread "BANNERSERVICEPROXY-34" daemon
[_thread_blocked, id=27355,
stack(0x0000000043a09000,0x0000000043a2a000)]
0x00007f3d58634000 JavaThread "BANNERSERVICEPROXY-33" daemon
[_thread_blocked, id=27354,
stack(0x00000000439e8000,0x0000000043a09000)]
0x00007f3d5cf25800 JavaThread "pool-18-thread-1" [_thread_blocked,
id=27353, stack(0x00000000439c7000,0x00000000439e8000)]
0x00007f3d58633000 JavaThread "BANNERSERVICEPROXY-32" daemon
[_thread_blocked, id=27352,
stack(0x00000000439a6000,0x00000000439c7000)]
0x00007f3d58631000 JavaThread "BANNERSERVICEPROXY-31" daemon
[_thread_blocked, id=27351,
stack(0x0000000043985000,0x00000000439a6000)]
0x00007f3d58415000 JavaThread "BANNERSERVICEPROXY-30" daemon
[_thread_blocked, id=27350,
stack(0x0000000043964000,0x0000000043985000)]
0x00007f3d58414800 JavaThread "BANNERSERVICEPROXY-29" daemon
[_thread_blocked, id=27349,
stack(0x0000000043943000,0x0000000043964000)]
0x00007f3d583f8800 JavaThread "BANNERSERVICEPROXY-28" daemon
[_thread_blocked, id=27348,
stack(0x0000000043922000,0x0000000043943000)]
0x00007f3d583f7000 JavaThread "BANNERSERVICEPROXY-27" daemon
[_thread_blocked, id=27347,
stack(0x0000000043901000,0x0000000043922000)]
0x00007f3d583f2800 JavaThread "BANNERSERVICEPROXY-26" daemon
[_thread_blocked, id=27346,
stack(0x00000000438e0000,0x0000000043901000)]
0x00007f3d583f0800 JavaThread "BANNERSERVICEPROXY-25" daemon
[_thread_blocked, id=27345,
stack(0x00000000438bf000,0x00000000438e0000)]
0x00007f3d591c3800 JavaThread "BANNERSERVICEPROXY-24" daemon
[_thread_blocked, id=27344,
stack(0x000000004389e000,0x00000000438bf000)]
0x00007f3d591c1800 JavaThread "BANNERSERVICEPROXY-23" daemon
[_thread_blocked, id=27343,
stack(0x000000004387d000,0x000000004389e000)]
0x00007f3d591bf800 JavaThread "BANNERSERVICEPROXY-22" daemon
[_thread_blocked, id=27342,
stack(0x000000004385c000,0x000000004387d000)]
0x00007f3d583e5000 JavaThread "BANNERSERVICEPROXY-21" daemon
[_thread_blocked, id=27341,
stack(0x000000004383b000,0x000000004385c000)]
0x00007f3d583e3000 JavaThread "BANNERSERVICEPROXY-20" daemon
[_thread_blocked, id=27340,
stack(0x000000004381a000,0x000000004383b000)]
0x00007f3d591d5000 JavaThread "BANNERSERVICEPROXY-19" daemon
[_thread_blocked, id=27339,
stack(0x00000000437f9000,0x000000004381a000)]
0x00007f3d591d4000 JavaThread "BANNERSERVICEPROXY-18" daemon
[_thread_blocked, id=27338,
stack(0x00000000437d8000,0x00000000437f9000)]
0x00007f3d58416800 JavaThread "BANNERSERVICEPROXY-17" daemon
[_thread_blocked, id=27337,
stack(0x00000000437b7000,0x00000000437d8000)]
0x00007f3d5885b000 JavaThread "BANNERSERVICEPROXY-16" daemon
[_thread_blocked, id=27336,
stack(0x0000000043796000,0x00000000437b7000)]
0x00007f3d58436000 JavaThread "BANNERSERVICEPROXY-15" daemon
[_thread_blocked, id=27335,
stack(0x0000000043775000,0x0000000043796000)]
0x00007f3d591c8000 JavaThread "BANNERSERVICEPROXY-14" daemon
[_thread_blocked, id=27334,
stack(0x0000000043754000,0x0000000043775000)]
0x00007f3d501c4800 JavaThread "BANNERSERVICEPROXY-13" daemon
[_thread_blocked, id=27333,
stack(0x0000000043733000,0x0000000043754000)]
0x00007f3d50cb6000 JavaThread "BANNERSERVICEPROXY-12" daemon
[_thread_blocked, id=27332,
stack(0x0000000043712000,0x0000000043733000)]
0x00007f3d501c2000 JavaThread "BANNERSERVICEPROXY-11" daemon
[_thread_blocked, id=27331,
stack(0x00000000436f1000,0x0000000043712000)]
0x00007f3d501c0000 JavaThread "BANNERSERVICEPROXY-10" daemon
[_thread_blocked, id=27330,
stack(0x00000000436d0000,0x00000000436f1000)]
0x00007f3d5060e800 JavaThread "BANNERSERVICEPROXY-9" daemon
[_thread_blocked, id=27329,
stack(0x00000000436af000,0x00000000436d0000)]
0x00007f3d5060c000 JavaThread "BANNERSERVICEPROXY-8" daemon
[_thread_blocked, id=27328,
stack(0x000000004368e000,0x00000000436af000)]
0x00007f3d50123800 JavaThread "BANNERSERVICEPROXY-7" daemon
[_thread_blocked, id=27327,
stack(0x000000004366d000,0x000000004368e000)]
0x00007f3d5023f800 JavaThread "BANNERSERVICEPROXY-6" daemon
[_thread_blocked, id=27326,
stack(0x000000004364c000,0x000000004366d000)]
0x00007f3d500c6000 JavaThread "BANNERSERVICEPROXY-5" daemon
[_thread_blocked, id=27325,
stack(0x000000004362b000,0x000000004364c000)]
0x00007f3d50240000 JavaThread "BANNERSERVICEPROXY-4" daemon
[_thread_blocked, id=27324,
stack(0x000000004360a000,0x000000004362b000)]
0x00007f3d5e7c1800 JavaThread "BANNERSERVICEPROXY-3" daemon
[_thread_blocked, id=27323,
stack(0x00000000435e9000,0x000000004360a000)]
0x00007f3d5005f800 JavaThread "BANNERSERVICEPROXY-2" daemon
[_thread_blocked, id=27322,
stack(0x00000000435c8000,0x00000000435e9000)]
0x00007f3d5e68a800 JavaThread "BANNERSERVICEPROXY-1" daemon
[_thread_blocked, id=27321,
stack(0x00000000435a7000,0x00000000435c8000)]
0x00007f3d58410000 JavaThread "PooledByteBufferExpirer-0" daemon
[_thread_blocked, id=27279,
stack(0x000000004303d000,0x000000004305e000)]
0x00007f3d60c0e000 JavaThread "SocketConnectorIoProcessor-0.0" daemon
[_thread_in_native, id=27276,
stack(0x0000000042fda000,0x0000000042ffb000)]
0x00007f3d60a97000 JavaThread "http-80-106" daemon [_thread_blocked,
id=27210, stack(0x0000000042779000,0x000000004279a000)]
0x00007f3d500bb000 JavaThread
"SocketAcceptorIoProcessor-1.7" [_thread_in_native, id=27208,
stack(0x0000000042737000,0x0000000042758000)]
0x00007f3d50068000 JavaThread
"SocketAcceptorIoProcessor-1.6" [_thread_blocked, id=27207,
stack(0x0000000042716000,0x0000000042737000)]
0x00007f3d500b8800 JavaThread
"SocketAcceptorIoProcessor-1.5" [_thread_in_native, id=27206,
stack(0x00000000426f5000,0x0000000042716000)]
0x00007f3d500b6800 JavaThread
"SocketAcceptorIoProcessor-1.4" [_thread_in_native, id=27205,
stack(0x00000000426d4000,0x00000000426f5000)]
0x00007f3d500a2000 JavaThread
"SocketAcceptorIoProcessor-1.3" [_thread_in_native, id=27204,
stack(0x00000000426b3000,0x00000000426d4000)]
0x00007f3d50090800 JavaThread
"SocketAcceptorIoProcessor-1.2" [_thread_in_native, id=27203,
stack(0x0000000042692000,0x00000000426b3000)]
0x00007f3d60c07800 JavaThread "http-80-105" daemon [_thread_blocked,
id=27202, stack(0x0000000042671000,0x0000000042692000)]
0x00007f3d5002b000 JavaThread
"SocketAcceptorIoProcessor-1.1" [_thread_in_native, id=27201,
stack(0x0000000042650000,0x0000000042671000)]
0x00007f3d5001d000 JavaThread
"SocketAcceptorIoProcessor-1.0" [_thread_in_native, id=27200,
stack(0x000000004262f000,0x0000000042650000)]
0x00007f3d60583800 JavaThread "http-80-104" daemon [_thread_blocked,
id=27199, stack(0x000000004260e000,0x000000004262f000)]
0x00007f3d60581000 JavaThread "http-80-103" daemon [_thread_blocked,
id=27198, stack(0x00000000425ed000,0x000000004260e000)]
0x00007f3d58427000 JavaThread "SocketConnector-0" daemon
[_thread_in_native, id=27197,
stack(0x00000000425cc000,0x00000000425ed000)]
0x00007f3d6056c000 JavaThread "http-80-102" daemon [_thread_blocked,
id=27196, stack(0x00000000425ab000,0x00000000425cc000)]
0x00007f3d604e4800 JavaThread "http-80-101" daemon [_thread_blocked,
id=27195, stack(0x000000004258a000,0x00000000425ab000)]
0x00007f3d605f0800 JavaThread "http-80-100" daemon [_thread_blocked,
id=27194, stack(0x0000000042569000,0x000000004258a000)]
0x00007f3d610eb000 JavaThread "http-80-99" daemon [_thread_blocked,
id=27193, stack(0x0000000042548000,0x0000000042569000)]
0x00007f3d58428000 JavaThread "MultiThreadedHttpConnectionManager
cleanup" daemon [_thread_blocked, id=27192,
stack(0x0000000042527000,0x0000000042548000)]
0x00007f3d610e3800 JavaThread "http-80-98" daemon [_thread_blocked,
id=27191, stack(0x0000000042506000,0x0000000042527000)]
0x00007f3d60e0a800 JavaThread "http-80-97" daemon [_thread_blocked,
id=27190, stack(0x00000000424e5000,0x0000000042506000)]
0x00007f3d60e07800 JavaThread "http-80-96" daemon [_thread_blocked,
id=27189, stack(0x00000000424c4000,0x00000000424e5000)]
0x00007f3d60e03800 JavaThread "http-80-95" daemon [_thread_blocked,
id=27188, stack(0x000000004008e000,0x00000000400af000)]
0x00007f3d60dff800 JavaThread "http-80-94" daemon [_thread_blocked,
id=27187, stack(0x00000000424a3000,0x00000000424c4000)]
0x00007f3d60bce800 JavaThread "http-80-93" daemon [_thread_blocked,
id=27186, stack(0x0000000042482000,0x00000000424a3000)]
0x00007f3d60bca800 JavaThread "http-80-92" daemon [_thread_blocked,
id=27185, stack(0x0000000042461000,0x0000000042482000)]
0x00007f3d60c42800 JavaThread "http-80-91" daemon [_thread_blocked,
id=27184, stack(0x0000000042440000,0x0000000042461000)]
0x00007f3d60400000 JavaThread "http-80-90" daemon [_thread_blocked,
id=27183, stack(0x000000004241f000,0x0000000042440000)]
0x00007f3d60228800 JavaThread "http-80-89" daemon [_thread_blocked,
id=27182, stack(0x00000000423fe000,0x000000004241f000)]
0x00007f3d60bae800 JavaThread "http-80-88" daemon [_thread_blocked,
id=27181, stack(0x0000000040553000,0x0000000040574000)]
0x00007f3d6064e800 JavaThread "http-80-87" daemon [_thread_blocked,
id=27180, stack(0x00000000423dd000,0x00000000423fe000)]
0x00007f3d60c85000 JavaThread "http-80-86" daemon [_thread_blocked,
id=27179, stack(0x00000000423bc000,0x00000000423dd000)]
0x00007f3d60bd7800 JavaThread "http-80-85" daemon [_thread_blocked,
id=27178, stack(0x000000004239b000,0x00000000423bc000)]
0x00007f3d60717800 JavaThread "http-80-84" daemon [_thread_blocked,
id=27177, stack(0x000000004237a000,0x000000004239b000)]
0x00007f3d60716800 JavaThread "http-80-83" daemon [_thread_blocked,
id=27176, stack(0x0000000042359000,0x000000004237a000)]
0x00007f3d60c21800 JavaThread "http-80-82" daemon [_thread_blocked,
id=27175, stack(0x0000000042338000,0x0000000042359000)]
0x00007f3d607a8000 JavaThread "http-80-81" daemon [_thread_blocked,
id=27174, stack(0x0000000042317000,0x0000000042338000)]
0x00007f3d6061e800 JavaThread "http-80-80" daemon [_thread_blocked,
id=27173, stack(0x00000000422f6000,0x0000000042317000)]
0x00007f3d604e8800 JavaThread "http-80-79" daemon [_thread_blocked,
id=27172, stack(0x000000004002a000,0x000000004004b000)]
0x00007f3d606e9800 JavaThread "http-80-78" daemon [_thread_blocked,
id=27171, stack(0x00000000422d5000,0x00000000422f6000)]
0x00007f3d60c15000 JavaThread "http-80-77" daemon [_thread_blocked,
id=27170, stack(0x0000000040719000,0x000000004073a000)]
0x00007f3d6083e000 JavaThread "http-80-76" daemon [_thread_blocked,
id=27169, stack(0x00000000422b4000,0x00000000422d5000)]
0x00007f3d60393000 JavaThread "http-80-75" daemon [_thread_blocked,
id=27168, stack(0x0000000042293000,0x00000000422b4000)]
0x00007f3d6097e800 JavaThread "http-80-74" daemon [_thread_blocked,
id=27167, stack(0x0000000042272000,0x0000000042293000)]
0x00007f3d601a0800 JavaThread "http-80-73" daemon [_thread_blocked,
id=27166, stack(0x0000000042251000,0x0000000042272000)]
0x00007f3d60385800 JavaThread "http-80-72" daemon [_thread_blocked,
id=27165, stack(0x0000000042230000,0x0000000042251000)]
0x00007f3d60601000 JavaThread "http-80-71" daemon [_thread_blocked,
id=27164, stack(0x000000004220f000,0x0000000042230000)]
0x00007f3d60600800 JavaThread "http-80-70" daemon [_thread_in_native,
id=27163, stack(0x00000000421ee000,0x000000004220f000)]
0x00007f3d60c6f800 JavaThread "http-80-69" daemon [_thread_blocked,
id=27162, stack(0x00000000421cd000,0x00000000421ee000)]
0x00007f3d6098b000 JavaThread "http-80-68" daemon [_thread_blocked,
id=27161, stack(0x00000000421ac000,0x00000000421cd000)]
0x00007f3d60c50800 JavaThread "http-80-67" daemon [_thread_blocked,
id=27160, stack(0x000000004218b000,0x00000000421ac000)]
0x00007f3d60c55000 JavaThread "http-80-66" daemon [_thread_blocked,
id=27159, stack(0x000000004216a000,0x000000004218b000)]
0x00007f3d5ecdf000 JavaThread "http-443-1" daemon [_thread_blocked,
id=27158, stack(0x0000000042149000,0x000000004216a000)]
0x00007f3d60646800 JavaThread "http-80-65" daemon [_thread_blocked,
id=27157, stack(0x0000000042128000,0x0000000042149000)]
0x00007f3d604b2000 JavaThread "http-80-64" daemon [_thread_blocked,
id=27156, stack(0x0000000042107000,0x0000000042128000)]
0x00007f3d5822c800 JavaThread "http-443-Acceptor-0" daemon
[_thread_in_native, id=27155,
stack(0x00000000420e6000,0x0000000042107000)]
0x00007f3d5822a800 JavaThread "http-443-CometPoller-0" daemon
[_thread_blocked, id=27154,
stack(0x00000000420c5000,0x00000000420e6000)]
0x00007f3d60685800 JavaThread "http-80-63" daemon [_thread_blocked,
id=27153, stack(0x0000000040532000,0x0000000040553000)]
0x00007f3d58226000 JavaThread "http-443-Poller-0" daemon
[_thread_blocked, id=27152,
stack(0x00000000420a4000,0x00000000420c5000)]
0x00007f3d608fb800 JavaThread "http-80-62" daemon [_thread_blocked,
id=27151, stack(0x0000000042083000,0x00000000420a4000)]
0x00007f3d58230800 JavaThread "http-80-61" daemon [_thread_blocked,
id=27150, stack(0x0000000042062000,0x0000000042083000)]
0x00007f3d58222000 JavaThread "http-80-60" daemon [_thread_blocked,
id=27149, stack(0x0000000040699000,0x00000000406ba000)]
0x00007f3d5821e000 JavaThread "http-80-59" daemon [_thread_blocked,
id=27148, stack(0x000000004006d000,0x000000004008e000)]
0x00007f3d5821a000 JavaThread "http-80-58" daemon [_thread_blocked,
id=27147, stack(0x00000000404c1000,0x00000000404e2000)]
0x00007f3d58216000 JavaThread "http-80-57" daemon [_thread_in_native,
id=27146, stack(0x0000000040626000,0x0000000040647000)]
0x00007f3d58212000 JavaThread "http-80-56" daemon [_thread_blocked,
id=27145, stack(0x0000000042041000,0x0000000042062000)]
0x00007f3d5820e000 JavaThread "http-80-55" daemon [_thread_blocked,
id=27144, stack(0x0000000042020000,0x0000000042041000)]
0x00007f3d5820a000 JavaThread "http-80-54" daemon [_thread_blocked,
id=27143, stack(0x0000000041fff000,0x0000000042020000)]
0x00007f3d58206000 JavaThread "http-80-53" daemon [_thread_blocked,
id=27142, stack(0x0000000041fde000,0x0000000041fff000)]
0x00007f3d58202000 JavaThread "http-80-52" daemon [_thread_blocked,
id=27141, stack(0x0000000041fbd000,0x0000000041fde000)]
0x00007f3d581fe000 JavaThread "http-80-51" daemon [_thread_blocked,
id=27140, stack(0x0000000041f9c000,0x0000000041fbd000)]
0x00007f3d581fa000 JavaThread "http-80-50" daemon [_thread_blocked,
id=27139, stack(0x0000000041f7b000,0x0000000041f9c000)]
0x00007f3d581f6000 JavaThread "http-80-49" daemon [_thread_in_native,
id=27138, stack(0x0000000040678000,0x0000000040699000)]
0x00007f3d581f2000 JavaThread "http-80-48" daemon [_thread_blocked,
id=27137, stack(0x000000004047c000,0x000000004049d000)]
0x00007f3d581ee000 JavaThread "http-80-47" daemon [_thread_blocked,
id=27136, stack(0x0000000041605000,0x0000000041626000)]
0x00007f3d581ea000 JavaThread "http-80-46" daemon [_thread_blocked,
id=27135, stack(0x00000000415e4000,0x0000000041605000)]
0x00007f3d581bf000 JavaThread "http-80-45" daemon [_thread_blocked,
id=27134, stack(0x0000000041386000,0x00000000413a7000)]
0x00007f3d581bd000 JavaThread "http-80-44" daemon [_thread_blocked,
id=27133, stack(0x0000000041f5a000,0x0000000041f7b000)]
0x00007f3d581b9000 JavaThread "http-80-43" daemon [_thread_blocked,
id=27132, stack(0x0000000041458000,0x0000000041479000)]
0x00007f3d581d6800 JavaThread "http-80-42" daemon [_thread_blocked,
id=27131, stack(0x0000000041365000,0x0000000041386000)]
0x00007f3d581d1000 JavaThread "http-80-41" daemon [_thread_blocked,
id=27130, stack(0x0000000041f39000,0x0000000041f5a000)]
0x00007f3d581d4000 JavaThread "http-80-40" daemon [_thread_blocked,
id=27129, stack(0x0000000041317000,0x0000000041338000)]
0x00007f3d581de000 JavaThread "http-80-39" daemon [_thread_blocked,
id=27128, stack(0x00000000406f8000,0x0000000040719000)]
0x00007f3d581b0000 JavaThread "http-80-38" daemon [_thread_blocked,
id=27127, stack(0x000000004045b000,0x000000004047c000)]
0x00007f3d581e1800 JavaThread "http-80-37" daemon [_thread_blocked,
id=27126, stack(0x000000004043a000,0x000000004045b000)]
0x00007f3d581d9800 JavaThread "http-80-36" daemon [_thread_blocked,
id=27125, stack(0x0000000041432000,0x0000000041453000)]
0x00007f3d581ce000 JavaThread "http-80-35" daemon [_thread_blocked,
id=27124, stack(0x0000000041ee6000,0x0000000041f07000)]
0x00007f3d581ca000 JavaThread "http-80-34" daemon [_thread_blocked,
id=27123, stack(0x00000000412f6000,0x0000000041317000)]
0x00007f3d581c6000 JavaThread "http-80-33" daemon [_thread_blocked,
id=27122, stack(0x0000000041a37000,0x0000000041a58000)]
0x00007f3d581c2000 JavaThread "http-80-32" daemon [_thread_blocked,
id=27121, stack(0x0000000040511000,0x0000000040532000)]
0x00007f3d581ae000 JavaThread "http-80-31" daemon [_thread_blocked,
id=27120, stack(0x00000000403e9000,0x000000004040a000)]
0x00007f3d581a5000 JavaThread "http-80-30" daemon [_thread_blocked,
id=27119, stack(0x0000000041cf1000,0x0000000041d12000)]
0x00007f3d581a1000 JavaThread "http-80-29" daemon [_thread_blocked,
id=27118, stack(0x0000000041344000,0x0000000041365000)]
0x00007f3d5819d000 JavaThread "http-80-28" daemon [_thread_blocked,
id=27117, stack(0x0000000041ec5000,0x0000000041ee6000)]
0x00007f3d58199000 JavaThread "http-80-27" daemon [_thread_blocked,
id=27116, stack(0x0000000041ea4000,0x0000000041ec5000)]
0x00007f3d58195000 JavaThread "http-80-26" daemon [_thread_blocked,
id=27115, stack(0x0000000041c94000,0x0000000041cb5000)]
0x00007f3d58191000 JavaThread "http-80-25" daemon [_thread_blocked,
id=27114, stack(0x0000000041c73000,0x0000000041c94000)]
0x00007f3d5818d000 JavaThread "http-80-24" daemon [_thread_blocked,
id=27113, stack(0x0000000040f6b000,0x0000000040f8c000)]
0x00007f3d58189000 JavaThread "http-80-23" daemon [_thread_blocked,
id=27112, stack(0x0000000040f4a000,0x0000000040f6b000)]
0x00007f3d58185000 JavaThread "http-80-22" daemon [_thread_blocked,
id=27111, stack(0x0000000041a16000,0x0000000041a37000)]
0x00007f3d58181000 JavaThread "http-80-21" daemon [_thread_blocked,
id=27110, stack(0x00000000419f5000,0x0000000041a16000)]
0x00007f3d5817d000 JavaThread "http-80-20" daemon [_thread_blocked,
id=27109, stack(0x0000000040761000,0x0000000040782000)]
0x00007f3d58179000 JavaThread "http-80-19" daemon [_thread_blocked,
id=27108, stack(0x0000000041c2b000,0x0000000041c4c000)]
0x00007f3d58175000 JavaThread "http-80-18" daemon [_thread_blocked,
id=27107, stack(0x0000000040f29000,0x0000000040f4a000)]
0x00007f3d58171000 JavaThread "http-80-17" daemon [_thread_blocked,
id=27106, stack(0x0000000040c0b000,0x0000000040c2c000)]
0x00007f3d5816d000 JavaThread "http-80-16" daemon [_thread_blocked,
id=27105, stack(0x0000000040de0000,0x0000000040e01000)]
0x00007f3d58169000 JavaThread "http-80-15" daemon [_thread_blocked,
id=27104, stack(0x0000000041824000,0x0000000041845000)]
0x00007f3d58165000 JavaThread "http-80-14" daemon [_thread_blocked,
id=27103, stack(0x00000000412d5000,0x00000000412f6000)]
0x00007f3d58161000 JavaThread "http-80-13" daemon [_thread_blocked,
id=27102, stack(0x0000000040605000,0x0000000040626000)]
0x00007f3d5815d000 JavaThread "http-80-12" daemon [_thread_blocked,
id=27101, stack(0x000000004059e000,0x00000000405bf000)]
0x00007f3d58159000 JavaThread "http-80-11" daemon [_thread_blocked,
id=27100, stack(0x0000000040bea000,0x0000000040c0b000)]
0x00007f3d58155000 JavaThread "http-80-10" daemon [_thread_blocked,
id=27099, stack(0x00000000412b4000,0x00000000412d5000)]
0x00007f3d58151000 JavaThread "http-80-9" daemon [_thread_blocked,
id=27098, stack(0x0000000040dbf000,0x0000000040de0000)]
0x00007f3d5814d000 JavaThread "http-80-8" daemon [_thread_blocked,
id=27097, stack(0x0000000040796000,0x00000000407b7000)]
0x00007f3d58149000 JavaThread "http-80-7" daemon [_thread_blocked,
id=27096, stack(0x0000000041411000,0x0000000041432000)]
0x00007f3d58145000 JavaThread "http-80-6" daemon [_thread_blocked,
id=27095, stack(0x00000000419d4000,0x00000000419f5000)]
0x00007f3d58141000 JavaThread "http-80-5" daemon [_thread_blocked,
id=27094, stack(0x0000000041293000,0x00000000412b4000)]
0x00007f3d5e9bf800 JavaThread "http-80-4" daemon [_thread_blocked,
id=27093, stack(0x0000000041f18000,0x0000000041f39000)]
0x00007f3d5e9fb800 JavaThread "http-80-3" daemon [_thread_blocked,
id=27092, stack(0x0000000041272000,0x0000000041293000)]
0x00007f3d5e668000 JavaThread "http-80-2" daemon [_thread_blocked,
id=27091, stack(0x0000000041e81000,0x0000000041ea2000)]
0x00007f3d6447c800 JavaThread "http-80-1" daemon [_thread_blocked,
id=27090, stack(0x0000000041e60000,0x0000000041e81000)]
0x00007f3d60866000 JavaThread "http-80-Acceptor-0" daemon
[_thread_blocked, id=27089,
stack(0x0000000040f08000,0x0000000040f29000)]
0x00007f3d60a78800 JavaThread "http-80-Sendfile-0" daemon
[_thread_blocked, id=27088,
stack(0x00000000404f0000,0x0000000040511000)]
0x00007f3d605bb800 JavaThread "http-80-CometPoller-0" daemon
[_thread_blocked, id=27087,
stack(0x0000000041c0a000,0x0000000041c2b000)]
0x00007f3d60a76000 JavaThread "http-80-Poller-0" daemon
[_thread_blocked, id=27086,
stack(0x0000000041251000,0x0000000041272000)]
0x00007f3d60843000 JavaThread
"ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon
[_thread_blocked, id=27085,
stack(0x0000000041230000,0x0000000041251000)]
0x00007f3d6060a800 JavaThread "Thread-15" daemon [_thread_blocked,
id=27084, stack(0x0000000041e3f000,0x0000000041e60000)]
0x00007f3d60122000 JavaThread "Thread-14" daemon [_thread_blocked,
id=27083, stack(0x000000004004c000,0x000000004006d000)]
0x00007f3d5813c800 JavaThread "I/O dispatcher 8" daemon
[_thread_blocked, id=27082,
stack(0x00000000403b9000,0x00000000403da000)]
0x00007f3d5813a800 JavaThread "I/O dispatcher 7" daemon
[_thread_blocked, id=27081,
stack(0x0000000040d9e000,0x0000000040dbf000)]
0x00007f3d58138800 JavaThread "I/O dispatcher 6" daemon
[_thread_blocked, id=27080,
stack(0x0000000041bb7000,0x0000000041bd8000)]
0x00007f3d58137000 JavaThread "I/O dispatcher 5" daemon
[_thread_blocked, id=27079,
stack(0x0000000040376000,0x0000000040397000)]
0x00007f3d58050000 JavaThread "I/O dispatcher 4" daemon
[_thread_blocked, id=27078,
stack(0x0000000040d7d000,0x0000000040d9e000)]
0x00007f3d5804e000 JavaThread "I/O dispatcher 3" daemon
[_thread_blocked, id=27077,
stack(0x0000000041479000,0x000000004149a000)]
0x00007f3d58041800 JavaThread "I/O dispatcher 2" daemon
[_thread_blocked, id=27076,
stack(0x00000000415c3000,0x00000000415e4000)]
0x00007f3d5803c800 JavaThread "I/O dispatcher 1" daemon
[_thread_blocked, id=27075,
stack(0x00000000419b3000,0x00000000419d4000)]
0x00007f3d58011800 JavaThread "HttpNioServer MAIN" daemon
[_thread_blocked, id=27074,
stack(0x0000000040740000,0x0000000040761000)]
0x00007f3d60535800 JavaThread "MultiBackend-Executor-Thread-7" daemon
[_thread_blocked, id=27073,
stack(0x0000000041992000,0x00000000419b3000)]
0x00007f3d60a69800 JavaThread "MultiBackend-Executor-Thread-6" daemon
[_thread_blocked, id=27072,
stack(0x0000000040bc9000,0x0000000040bea000)]
0x00007f3d5ec07000 JavaThread "FTPPoolWorker-5" [_thread_in_native,
id=27071, stack(0x0000000040398000,0x00000000403b9000)]
0x00007f3d5ec05000 JavaThread "FTPPoolWorker-4" [_thread_in_native,
id=27070, stack(0x00000000413b2000,0x00000000413d3000)]
0x00007f3d5eeed800 JavaThread "FTPPoolWorker-3" [_thread_in_native,
id=27069, stack(0x000000004032d000,0x000000004034e000)]
0x00007f3d5ebfd800 JavaThread "FTPPoolWorker-2" [_thread_in_native,
id=27068, stack(0x0000000041b96000,0x0000000041bb7000)]
0x00007f3d5ecdd000 JavaThread "FTPPoolWorker-1" [_thread_in_native,
id=27067, stack(0x000000004034e000,0x000000004036f000)]
0x00007f3d64381800 JavaThread "ServerUpdateThread -
1" [_thread_blocked, id=27065,
stack(0x000000004120f000,0x0000000041230000)]
0x00007f3d5ed26800 JavaThread "SocketAcceptor-1" [_thread_in_native,
id=27064, stack(0x00000000411ee000,0x000000004120f000)]
0x00007f3d60323000 JavaThread "MultiBackend-Executor-Thread-4" daemon
[_thread_blocked, id=27061,
stack(0x0000000041cd0000,0x0000000041cf1000)]
0x00007f3d5ee9f800 JavaThread "MultiBackend-Executor-Thread-3" daemon
[_thread_blocked, id=27060,
stack(0x00000000413f0000,0x0000000041411000)]
0x00007f3d64502800 JavaThread "MultiBackend-Executor-Thread-2" daemon
[_thread_blocked, id=27059,
stack(0x000000004057d000,0x000000004059e000)]
0x00007f3d6440e800 JavaThread "MultiBackend-Executor-Thread-1" daemon
[_thread_blocked, id=27058,
stack(0x0000000040419000,0x000000004043a000)]
0x00007f3d5ecaf800 JavaThread "MaintThread" daemon [_thread_blocked,
id=27057, stack(0x0000000041be9000,0x0000000041c0a000)]
0x00007f3d5ee73800 JavaThread "MaintThread" daemon [_thread_blocked,
id=27056, stack(0x00000000400d4000,0x00000000400f5000)]
0x00007f3d5e869800 JavaThread "MaintThread" daemon [_thread_blocked,
id=27055, stack(0x0000000041a66000,0x0000000041a87000)]
0x00007f3d5ee7f800 JavaThread "MaintThread" daemon [_thread_blocked,
id=27054, stack(0x0000000040657000,0x0000000040678000)]
0x00007f3d5e75f000 JavaThread "MaintThread" daemon [_thread_blocked,
id=27053, stack(0x0000000041196000,0x00000000411b7000)]
0x00007f3d5ea4c800 JavaThread "PooledByteBufferExpirer-0" daemon
[_thread_blocked, id=27052,
stack(0x0000000040d5c000,0x0000000040d7d000)]
0x00007f3d5eccb800 JavaThread "SocketAcceptor-0" [_thread_in_native,
id=27051, stack(0x00000000415a2000,0x00000000415c3000)]
0x00007f3d6092a800 JavaThread "Timer-0" daemon [_thread_blocked,
id=27050, stack(0x000000004195b000,0x000000004197c000)]
0x00007f3d606ef800 JavaThread "Thread-4" daemon [_thread_blocked,
id=27049, stack(0x00000000405e4000,0x0000000040605000)]
0x00007f3d60ccf000 JavaThread "MySQL Statement Cancellation Timer"
daemon [_thread_blocked, id=27048,
stack(0x0000000040d3b000,0x0000000040d5c000)]
0x00007f3d607aa000 JavaThread "Thread-2" daemon [_thread_blocked,
id=27047, stack(0x000000004030c000,0x000000004032d000)]
0x00007f3d64951000 JavaThread "Low Memory Detector" daemon
[_thread_blocked, id=27043,
stack(0x00000000406d7000,0x00000000406f8000)]
0x00007f3d6494f800 JavaThread "CompilerThread1" daemon
[_thread_blocked, id=27042,
stack(0x0000000040ac8000,0x0000000040bc9000)]
0x00007f3d6494d000 JavaThread "CompilerThread0" daemon
[_thread_blocked, id=27041,
stack(0x000000004185a000,0x000000004195b000)]
0x00007f3d6494b000 JavaThread "Signal Dispatcher" daemon
[_thread_blocked, id=27040,
stack(0x00000000404a0000,0x00000000404c1000)]
0x00007f3d64949800 JavaThread "Surrogate Locker Thread (CMS)" daemon
[_thread_blocked, id=27039,
stack(0x0000000040009000,0x000000004002a000)]
0x00007f3d729d5000 JavaThread "Finalizer" daemon [_thread_blocked,
id=27038, stack(0x0000000041e1e000,0x0000000041e3f000)]
0x00007f3d729d3000 JavaThread "Reference Handler" daemon
[_thread_blocked, id=27037,
stack(0x00000000405c3000,0x00000000405e4000)]
0x0000000041640800 JavaThread "main" [_thread_in_native, id=27024,
stack(0x0000000041c52000,0x0000000041c73000)]
Other Threads:
0x00007f3d729ce800 VMThread [stack:
0x0000000041d1d000,0x0000000041e1e000] [id=27036]
0x00007f3d60005800 WatcherThread [stack:
0x0000000041a95000,0x0000000041b96000] [id=27044]
=>0x000000004164f000 (exited) GCTaskThread [stack:
0x0000000000000000,0x0000000000000000] [id=27025]
VM state:at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x000000004163d790] Threads_lock - owner thread: 0x00007f3d729ce800
[0x000000004163dd10] Heap_lock - owner thread: 0x00007f3d584c8000
Heap
par new generation total 1887488K, used 1854437K [0x00002aaaaac00000,
0x00002aab2ac00000, 0x00002aab2ac00000)
eden space 1677824K, 100% used [0x00002aaaaac00000,
0x00002aab11280000, 0x00002aab11280000)
from space 209664K, 84% used [0x00002aab11280000, 0x00002aab1bef9748,
0x00002aab1df40000)
to space 209664K, 100% used [0x00002aab1df40000, 0x00002aab2ac00000,
0x00002aab2ac00000)
concurrent mark-sweep generation total 10485760K, used 2565196K
[0x00002aab2ac00000, 0x00002aadaac00000, 0x00002aadaac00000)
concurrent-mark-sweep perm gen total 131072K, used 62907K
[0x00002aadaac00000, 0x00002aadb2c00000, 0x00002aadb2c00000)
Dynamic libraries:
40000000-40009000 r-xp 00000000 08:01
8405017 /opt/jdk1.6.0_18/bin/java
40009000-4000c000 ---p 00000000 00:00 0
4000c000-4002a000 rwxp 00000000 00:00 0
4002a000-4002d000 ---p 00000000 00:00 0
4002d000-4004b000 rwxp 00000000 00:00 0
4004c000-4004f000 ---p 00000000 00:00 0
4004f000-4006d000 rwxp 00000000 00:00 0
4006d000-40070000 ---p 00000000 00:00 0
40070000-4008e000 rwxp 00000000 00:00 0
4008e000-40091000 ---p 00000000 00:00 0
40091000-400af000 rwxp 00000000 00:00 0
400d4000-400d7000 ---p 00000000 00:00 0
400d7000-400f5000 rwxp 00000000 00:00 0
40108000-4010a000 rwxp 00008000 08:01
8405017 /opt/jdk1.6.0_18/bin/java
4010a000-4010b000 ---p 00000000 00:00 0
4010b000-4020b000 rwxp 00000000 00:00 0
4020b000-4020c000 ---p 00000000 00:00 0
4020c000-4030c000 rwxp 00000000 00:00 0
4030c000-4030f000 ---p 00000000 00:00 0
4030f000-4032d000 rwxp 00000000 00:00 0
4032d000-40330000 ---p 00000000 00:00 0
40330000-4034e000 rwxp 00000000 00:00 0
4034e000-40351000 ---p 00000000 00:00 0
40351000-4036f000 rwxp 00000000 00:00 0
40376000-40379000 ---p 00000000 00:00 0
40379000-40397000 rwxp 00000000 00:00 0
40398000-4039b000 ---p 00000000 00:00 0
4039b000-403b9000 rwxp 00000000 00:00 0
403b9000-403bc000 ---p 00000000 00:00 0
403bc000-403da000 rwxp 00000000 00:00 0
403e9000-403ec000 ---p 00000000 00:00 0
403ec000-4040a000 rwxp 00000000 00:00 0
40419000-4041c000 ---p 00000000 00:00 0
4041c000-4043a000 rwxp 00000000 00:00 0
4043a000-4043d000 ---p 00000000 00:00 0
4043d000-4045b000 rwxp 00000000 00:00 0
4045b000-4045e000 ---p 00000000 00:00 0
4045e000-4047c000 rwxp 00000000 00:00 0
4047c000-4047f000 ---p 00000000 00:00 0
4047f000-4049d000 rwxp 00000000 00:00 0
404a0000-404a3000 ---p 00000000 00:00 0
404a3000-404c1000 rwxp 00000000 00:00 0
404c1000-404c4000 ---p 00000000 00:00 0
404c4000-404e2000 rwxp 00000000 00:00 0
404f0000-404f3000 ---p 00000000 00:00 0
404f3000-40511000 rwxp 00000000 00:00 0
40511000-40514000 ---p 00000000 00:00 0
40514000-40532000 rwxp 00000000 00:00 0
40532000-40535000 ---p 00000000 00:00 0
40535000-40553000 rwxp 00000000 00:00 0
40553000-40556000 ---p 00000000 00:00 0
40556000-40574000 rwxp 00000000 00:00 0
4057d000-40580000 ---p 00000000 00:00 0
40580000-4059e000 rwxp 00000000 00:00 0
4059e000-405a1000 ---p 00000000 00:00 0
405a1000-405bf000 rwxp 00000000 00:00 0
405c3000-405c6000 ---p 00000000 00:00 0
405c6000-405e4000 rwxp 00000000 00:00 0
405e4000-405e7000 ---p 00000000 00:00 0
405e7000-40605000 rwxp 00000000 00:00 0
40605000-40608000 ---p 00000000 00:00 0
40608000-40626000 rwxp 00000000 00:00 0
40626000-40629000 ---p 00000000 00:00 0
40629000-40647000 rwxp 00000000 00:00 0
40657000-4065a000 ---p 00000000 00:00 0
4065a000-40678000 rwxp 00000000 00:00 0
40678000-4067b000 ---p 00000000 00:00 0
4067b000-40699000 rwxp 00000000 00:00 0
40699000-4069c000 ---p 00000000 00:00 0
4069c000-406ba000 rwxp 00000000 00:00 0
406d7000-406da000 ---p 00000000 00:00 0
406da000-406f8000 rwxp 00000000 00:00 0
406f8000-406fb000 ---p 00000000 00:00 0
406fb000-40719000 rwxp 00000000 00:00 0
40719000-4071c000 ---p 00000000 00:00 0
4071c000-4073a000 rwxp 00000000 00:00 0
40740000-40743000 ---p 00000000 00:00 0
40743000-40761000 rwxp 00000000 00:00 0
40761000-40764000 ---p 00000000 00:00 0
40764000-40782000 rwxp 00000000 00:00 0
40796000-40799000 ---p 00000000 00:00 0
40799000-407b7000 rwxp 00000000 00:00 0
407c5000-407c6000 ---p 00000000 00:00 0
407c6000-408c6000 rwxp 00000000 00:00 0
408c6000-408c7000 ---p 00000000 00:00 0
408c7000-409c7000 rwxp 00000000 00:00 0
409c7000-409c8000 ---p 00000000 00:00 0
409c8000-40ac8000 rwxp 00000000 00:00 0
40ac8000-40acb000 ---p 00000000 00:00 0
40acb000-40bc9000 rwxp 00000000 00:00 0
40bc9000-40bcc000 ---p 00000000 00:00 0
40bcc000-40bea000 rwxp 00000000 00:00 0
40bea000-40bed000 ---p 00000000 00:00 0
40bed000-40c0b000 rwxp 00000000 00:00 0
40c0b000-40c0e000 ---p 00000000 00:00 0
40c0e000-40c2c000 rwxp 00000000 00:00 0
40c3a000-40c3b000 ---p 00000000 00:00 0
40c3b000-40d3b000 rwxp 00000000 00:00 0
40d3b000-40d3e000 ---p 00000000 00:00 0
40d3e000-40d5c000 rwxp 00000000 00:00 0
40d5c000-40d5f000 ---p 00000000 00:00 0
40d5f000-40d7d000 rwxp 00000000 00:00 0
40d7d000-40d80000 ---p 00000000 00:00 0
40d80000-40d9e000 rwxp 00000000 00:00 0
40d9e000-40da1000 ---p 00000000 00:00 0
40da1000-40dbf000 rwxp 00000000 00:00 0
40dbf000-40dc2000 ---p 00000000 00:00 0
40dc2000-40de0000 rwxp 00000000 00:00 0
40de0000-40de3000 ---p 00000000 00:00 0
40de3000-40e01000 rwxp 00000000 00:00 0
40e04000-40e05000 ---p 00000000 00:00 0
40e05000-40f05000 rwxp 00000000 00:00 0
40f08000-40f0b000 ---p 00000000 00:00 0
40f0b000-40f29000 rwxp 00000000 00:00 0
40f29000-40f2c000 ---p 00000000 00:00 0
40f2c000-40f4a000 rwxp 00000000 00:00 0
40f4a000-40f4d000 ---p 00000000 00:00 0
40f4d000-40f6b000 rwxp 00000000 00:00 0
40f6b000-40f6e000 ---p 00000000 00:00 0
40f6e000-40f8c000 rwxp 00000000 00:00 0
40f94000-40f95000 ---p 00000000 00:00 0
40f95000-41095000 rwxp 00000000 00:00 0
41095000-41096000 ---p 00000000 00:00 0
41096000-41196000 rwxp 00000000 00:00 0
41196000-41199000 ---p 00000000 00:00 0
41199000-411b7000 rwxp 00000000 00:00 0
411cd000-411d0000 ---p 00000000 00:00 0
411d0000-411ee000 rwxp 00000000 00:00 0
411ee000-411f1000 ---p 00000000 00:00 0
411f1000-4120f000 rwxp 00000000 00:00 0
4120f000-41212000 ---p 00000000 00:00 0
41212000-41230000 rwxp 00000000 00:00 0
41230000-41233000 ---p 00000000 00:00 0
41233000-41251000 rwxp 00000000 00:00 0
41251000-41254000 ---p 00000000 00:00 0
41254000-41272000 rwxp 00000000 00:00 0
41272000-41275000 ---p 00000000 00:00 0
41275000-41293000 rwxp 00000000 00:00 0
41293000-41296000 ---p 00000000 00:00 0
41296000-412b4000 rwxp 00000000 00:00 0
412b4000-412b7000 ---p 00000000 00:00 0
412b7000-412d5000 rwxp 00000000 00:00 0
412d5000-412d8000 ---p 00000000 00:00 0
412d8000-412f6000 rwxp 00000000 00:00 0
412f6000-412f9000 ---p 00000000 00:00 0
412f9000-41317000 rwxp 00000000 00:00 0
41317000-4131a000 ---p 00000000 00:00 0
4131a000-41338000 rwxp 00000000 00:00 0
41344000-41347000 ---p 00000000 00:00 0
41347000-41365000 rwxp 00000000 00:00 0
41365000-41368000 ---p 00000000 00:00 0
41368000-41386000 rwxp 00000000 00:00 0
41386000-41389000 ---p 00000000 00:00 0
41389000-413a7000 rwxp 00000000 00:00 0
413b2000-413b5000 ---p 00000000 00:00 0
413b5000-413d3000 rwxp 00000000 00:00 0
413f0000-413f3000 ---p 00000000 00:00 0
413f3000-41411000 rwxp 00000000 00:00 0
41411000-41414000 ---p 00000000 00:00 0
41414000-41432000 rwxp 00000000 00:00 0
41432000-41435000 ---p 00000000 00:00 0
41435000-41453000 rwxp 00000000 00:00 0
41458000-4145b000 ---p 00000000 00:00 0
4145b000-41479000 rwxp 00000000 00:00 0
41479000-4147c000 ---p 00000000 00:00 0
4147c000-4149a000 rwxp 00000000 00:00 0
414a1000-414a2000 ---p 00000000 00:00 0
414a2000-415a2000 rwxp 00000000 00:00 0
415a2000-415a5000 ---p 00000000 00:00 0
415a5000-415c3000 rwxp 00000000 00:00 0
415c3000-415c6000 ---p 00000000 00:00 0
415c6000-415e4000 rwxp 00000000 00:00 0
415e4000-415e7000 ---p 00000000 00:00 0
415e7000-41605000 rwxp 00000000 00:00 0
41605000-41608000 ---p 00000000 00:00 0
41608000-41626000 rwxp 00000000 00:00 0
41637000-416ef000 rwxp 00000000 00:00 0
[heap]
41702000-41703000 ---p 00000000 00:00 0
41703000-41803000 rwxp 00000000 00:00 0
41803000-41806000 ---p 00000000 00:00 0
41806000-41824000 rwxp 00000000 00:00 0
41824000-41827000 ---p 00000000 00:00 0
41827000-41845000 rwxp 00000000 00:00 0
4185a000-4185d000 ---p 00000000 00:00 0
4185d000-4195b000 rwxp 00000000 00:00 0
4195b000-4195e000 ---p 00000000 00:00 0
4195e000-4197c000 rwxp 00000000 00:00 0
41992000-41995000 ---p 00000000 00:00 0
41995000-419b3000 rwxp 00000000 00:00 0
419b3000-419b6000 ---p 00000000 00:00 0
419b6000-419d4000 rwxp 00000000 00:00 0
419d4000-419d7000 ---p 00000000 00:00 0
419d7000-419f5000 rwxp 00000000 00:00 0
419f5000-419f8000 ---p 00000000 00:00 0
419f8000-41a16000 rwxp 00000000 00:00 0
41a16000-41a19000 ---p 00000000 00:00 0
41a19000-41a37000 rwxp 00000000 00:00 0
41a37000-41a3a000 ---p 00000000 00:00 0
41a3a000-41a58000 rwxp 00000000 00:00 0
41a66000-41a69000 ---p 00000000 00:00 0
41a69000-41a87000 rwxp 00000000 00:00 0
41a95000-41a96000 ---p 00000000 00:00 0
41a96000-41b96000 rwxp 00000000 00:00 0
41b96000-41b99000 ---p 00000000 00:00 0
41b99000-41bb7000 rwxp 00000000 00:00 0
41bb7000-41bba000 ---p 00000000 00:00 0
41bba000-41bd8000 rwxp 00000000 00:00 0
41be9000-41bec000 ---p 00000000 00:00 0
41bec000-41c0a000 rwxp 00000000 00:00 0
41c0a000-41c0d000 ---p 00000000 00:00 0
41c0d000-41c2b000 rwxp 00000000 00:00 0
41c2b000-41c2e000 ---p 00000000 00:00 0
41c2e000-41c4c000 rwxp 00000000 00:00 0
41c52000-41c55000 ---p 00000000 00:00 0
41c55000-41c73000 rwxp 00000000 00:00 0
41c73000-41c76000 ---p 00000000 00:00 0
41c76000-41c94000 rwxp 00000000 00:00 0
41c94000-41c97000 ---p 00000000 00:00 0
41c97000-41cb5000 rwxp 00000000 00:00 0
41cd0000-41cd3000 ---p 00000000 00:00 0
41cd3000-41cf1000 rwxp 00000000 00:00 0
41cf1000-41cf4000 ---p 00000000 00:00 0
41cf4000-41d12000 rwxp 00000000 00:00 0
41d1d000-41d1e000 ---p 00000000 00:00 0
41d1e000-41e1e000 rwxp 00000000 00:00 0
41e1e000-41e21000 ---p 00000000 00:00 0
41e21000-41e3f000 rwxp 00000000 00:00 0
41e3f000-41e42000 ---p 00000000 00:00 0
41e42000-41e60000 rwxp 00000000 00:00 0
41e60000-41e63000 ---p 00000000 00:00 0
41e63000-41e81000 rwxp 00000000 00:00 0
41e81000-41e84000 ---p 00000000 00:00 0
41e84000-41ea2000 rwxp 00000000 00:00 0
41ea4000-41ea7000 ---p 00000000 00:00 0
41ea7000-41ec5000 rwxp 00000000 00:00 0
41ec5000-41ec8000 ---p 00000000 00:00 0
41ec8000-41ee6000 rwxp 00000000 00:00 0
41ee6000-41ee9000 ---p 00000000 00:00 0
41ee9000-41f07000 rwxp 00000000 00:00 0
41f18000-41f1b000 ---p 00000000 00:00 0
41f1b000-41f39000 rwxp 00000000 00:00 0
41f39000-41f3c000 ---p 00000000 00:00 0
41f3c000-41f5a000 rwxp 00000000 00:00 0
41f5a000-41f5d000 ---p 00000000 00:00 0
41f5d000-41f7b000 rwxp 00000000 00:00 0
41f7b000-41f7e000 ---p 00000000 00:00 0
41f7e000-41f9c000 rwxp 00000000 00:00 0
41f9c000-41f9f000 ---p 00000000 00:00 0
41f9f000-41fbd000 rwxp 00000000 00:00 0
41fbd000-41fc0000 ---p 00000000 00:00 0
41fc0000-41fde000 rwxp 00000000 00:00 0
41fde000-41fe1000 ---p 00000000 00:00 0
41fe1000-41fff000 rwxp 00000000 00:00 0
41fff000-42002000 ---p 00000000 00:00 0
42002000-42020000 rwxp 00000000 00:00 0
42020000-42023000 ---p 00000000 00:00 0
42023000-42041000 rwxp 00000000 00:00 0
42041000-42044000 ---p 00000000 00:00 0
42044000-42062000 rwxp 00000000 00:00 0
42062000-42065000 ---p 00000000 00:00 0
42065000-42083000 rwxp 00000000 00:00 0
42083000-42086000 ---p 00000000 00:00 0
42086000-420a4000 rwxp 00000000 00:00 0
420a4000-420a7000 ---p 00000000 00:00 0
420a7000-420c5000 rwxp 00000000 00:00 0
420c5000-420c8000 ---p 00000000 00:00 0
420c8000-420e6000 rwxp 00000000 00:00 0
420e6000-420e9000 ---p 00000000 00:00 0
420e9000-42107000 rwxp 00000000 00:00 0
42107000-4210a000 ---p 00000000 00:00 0
4210a000-42128000 rwxp 00000000 00:00 0
42128000-4212b000 ---p 00000000 00:00 0
4212b000-42149000 rwxp 00000000 00:00 0
42149000-4214c000 ---p 00000000 00:00 0
4214c000-4216a000 rwxp 00000000 00:00 0
4216a000-4216d000 ---p 00000000 00:00 0
4216d000-4218b000 rwxp 00000000 00:00 0
4218b000-4218e000 ---p 00000000 00:00 0
4218e000-421ac000 rwxp 00000000 00:00 0
421ac000-421af000 ---p 00000000 00:00 0
421af000-421cd000 rwxp 00000000 00:00 0
421cd000-421d0000 ---p 00000000 00:00 0
421d0000-421ee000 rwxp 00000000 00:00 0
421ee000-421f1000 ---p 00000000 00:00 0
421f1000-4220f000 rwxp 00000000 00:00 0
4220f000-42212000 ---p 00000000 00:00 0
42212000-42230000 rwxp 00000000 00:00 0
42230000-42233000 ---p 00000000 00:00 0
42233000-42251000 rwxp 00000000 00:00 0
42251000-42254000 ---p 00000000 00:00 0
42254000-42272000 rwxp 00000000 00:00 0
42272000-42275000 ---p 00000000 00:00 0
42275000-42293000 rwxp 00000000 00:00 0
42293000-42296000 ---p 00000000 00:00 0
42296000-422b4000 rwxp 00000000 00:00 0
422b4000-422b7000 ---p 00000000 00:00 0
422b7000-422d5000 rwxp 00000000 00:00 0
422d5000-422d8000 ---p 00000000 00:00 0
422d8000-422f6000 rwxp 00000000 00:00 0
422f6000-422f9000 ---p 00000000 00:00 0
422f9000-42317000 rwxp 00000000 00:00 0
42317000-4231a000 ---p 00000000 00:00 0
4231a000-42338000 rwxp 00000000 00:00 0
42338000-4233b000 ---p 00000000 00:00 0
4233b000-42359000 rwxp 00000000 00:00 0
42359000-4235c000 ---p 00000000 00:00 0
4235c000-4237a000 rwxp 00000000 00:00 0
4237a000-4237d000 ---p 00000000 00:00 0
4237d000-4239b000 rwxp 00000000 00:00 0
4239b000-4239e000 ---p 00000000 00:00 0
4239e000-423bc000 rwxp 00000000 00:00 0
423bc000-423bf000 ---p 00000000 00:00 0
423bf000-423dd000 rwxp 00000000 00:00 0
423dd000-423e0000 ---p 00000000 00:00 0
423e0000-423fe000 rwxp 00000000 00:00 0
423fe000-42401000 ---p 00000000 00:00 0
42401000-4241f000 rwxp 00000000 00:00 0
4241f000-42422000 ---p 00000000 00:00 0
42422000-42440000 rwxp 00000000 00:00 0
42440000-42443000 ---p 00000000 00:00 0
42443000-42461000 rwxp 00000000 00:00 0
42461000-42464000 ---p 00000000 00:00 0
42464000-42482000 rwxp 00000000 00:00 0
42482000-42485000 ---p 00000000 00:00 0
42485000-424a3000 rwxp 00000000 00:00 0
424a3000-424a6000 ---p 00000000 00:00 0
424a6000-424c4000 rwxp 00000000 00:00 0
424c4000-424c7000 ---p 00000000 00:00 0
424c7000-424e5000 rwxp 00000000 00:00 0
424e5000-424e8000 ---p 00000000 00:00 0
424e8000-42506000 rwxp 00000000 00:00 0
42506000-42509000 ---p 00000000 00:00 0
42509000-42527000 rwxp 00000000 00:00 0
42527000-4252a000 ---p 00000000 00:00 0
4252a000-42548000 rwxp 00000000 00:00 0
42548000-4254b000 ---p 00000000 00:00 0
4254b000-42569000 rwxp 00000000 00:00 0
42569000-4256c000 ---p 00000000 00:00 0
4256c000-4258a000 rwxp 00000000 00:00 0
4258a000-4258d000 ---p 00000000 00:00 0
4258d000-425ab000 rwxp 00000000 00:00 0
425ab000-425ae000 ---p 00000000 00:00 0
425ae000-425cc000 rwxp 00000000 00:00 0
425cc000-425cf000 ---p 00000000 00:00 0
425cf000-425ed000 rwxp 00000000 00:00 0
425ed000-425f0000 ---p 00000000 00:00 0
425f0000-4260e000 rwxp 00000000 00:00 0
4260e000-42611000 ---p 00000000 00:00 0
42611000-4262f000 rwxp 00000000 00:00 0
4262f000-42632000 ---p 00000000 00:00 0
42632000-42650000 rwxp 00000000 00:00 0
42650000-42653000 ---p 00000000 00:00 0
42653000-42671000 rwxp 00000000 00:00 0
42671000-42674000 ---p 00000000 00:00 0
42674000-42692000 rwxp 00000000 00:00 0
42692000-42695000 ---p 00000000 00:00 0
42695000-426b3000 rwxp 00000000 00:00 0
426b3000-426b6000 ---p 00000000 00:00 0
426b6000-426d4000 rwxp 00000000 00:00 0
426d4000-426d7000 ---p 00000000 00:00 0
426d7000-426f5000 rwxp 00000000 00:00 0
426f5000-426f8000 ---p 00000000 00:00 0
426f8000-42716000 rwxp 00000000 00:00 0
42716000-42719000 ---p 00000000 00:00 0
42719000-42737000 rwxp 00000000 00:00 0
42737000-4273a000 ---p 00000000 00:00 0
4273a000-42758000 rwxp 00000000 00:00 0
42779000-4277c000 ---p 00000000 00:00 0
4277c000-4279a000 rwxp 00000000 00:00 0
427bb000-427be000 ---p 00000000 00:00 0
427be000-427dc000 rwxp 00000000 00:00 0
427fd000-42800000 ---p 00000000 00:00 0
42800000-4281e000 rwxp 00000000 00:00 0
4281e000-42821000 ---p 00000000 00:00 0
42821000-4283f000 rwxp 00000000 00:00 0
42860000-42863000 ---p 00000000 00:00 0
42863000-42881000 rwxp 00000000 00:00 0
42881000-42884000 ---p 00000000 00:00 0
42884000-428a2000 rwxp 00000000 00:00 0
428a2000-428a5000 ---p 00000000 00:00 0
428a5000-428c3000 rwxp 00000000 00:00 0
428e4000-428e7000 ---p 00000000 00:00 0
428e7000-42905000 rwxp 00000000 00:00 0
42905000-42908000 ---p 00000000 00:00 0
42908000-42926000 rwxp 00000000 00:00 0
42926000-42929000 ---p 00000000 00:00 0
42929000-42947000 rwxp 00000000 00:00 0
42968000-4296b000 ---p 00000000 00:00 0
4296b000-42989000 rwxp 00000000 00:00 0
42989000-4298c000 ---p 00000000 00:00 0
4298c000-429aa000 rwxp 00000000 00:00 0
429aa000-429ad000 ---p 00000000 00:00 0
429ad000-429cb000 rwxp 00000000 00:00 0
429cb000-429ce000 ---p 00000000 00:00 0
429ce000-429ec000 rwxp 00000000 00:00 0
429ec000-429ef000 ---p 00000000 00:00 0
429ef000-42a0d000 rwxp 00000000 00:00 0
42a0d000-42a10000 ---p 00000000 00:00 0
42a10000-42a2e000 rwxp 00000000 00:00 0
42a4f000-42a52000 ---p 00000000 00:00 0
42a52000-42a70000 rwxp 00000000 00:00 0
42a70000-42a73000 ---p 00000000 00:00 0
42a73000-42a91000 rwxp 00000000 00:00 0
42a91000-42a94000 ---p 00000000 00:00 0
42a94000-42ab2000 rwxp 00000000 00:00 0
42ab2000-42ab5000 ---p 00000000 00:00 0
42ab5000-42ad3000 rwxp 00000000 00:00 0
42ad3000-42ad6000 ---p 00000000 00:00 0
42ad6000-42af4000 rwxp 00000000 00:00 0
42af4000-42af7000 ---p 00000000 00:00 0
42af7000-42b15000 rwxp 00000000 00:00 0
42b15000-42b18000 ---p 00000000 00:00 0
42b18000-42b36000 rwxp 00000000 00:00 0
42b36000-42b39000 ---p 00000000 00:00 0
42b39000-42b57000 rwxp 00000000 00:00 0
42b57000-42b5a000 ---p 00000000 00:00 0
42b5a000-42b78000 rwxp 00000000 00:00 0
42b78000-42b7b000 ---p 00000000 00:00 0
42b7b000-42b99000 rwxp 00000000 00:00 0
42b99000-42b9c000 ---p 00000000 00:00 0
42b9c000-42bba000 rwxp 00000000 00:00 0
42bba000-42bbd000 ---p 00000000 00:00 0
42bbd000-42bdb000 rwxp 00000000 00:00 0
42bfc000-42bff000 ---p 00000000 00:00 0
42bff000-42c1d000 rwxp 00000000 00:00 0
42c3e000-42c41000 ---p 00000000 00:00 0
42c41000-42c5f000 rwxp 00000000 00:00 0
42c5f000-42c62000 ---p 00000000 00:00 0
42c62000-42c80000 rwxp 00000000 00:00 0
42c80000-42c83000 ---p 00000000 00:00 0
42c83000-42ca1000 rwxp 00000000 00:00 0
42ca1000-42ca4000 ---p 00000000 00:00 0
42ca4000-42cc2000 rwxp 00000000 00:00 0
42cc2000-42cc5000 ---p 00000000 00:00 0
42cc5000-42ce3000 rwxp 00000000 00:00 0
42ce3000-42ce6000 ---p 00000000 00:00 0
42ce6000-42d04000 rwxp 00000000 00:00 0
42d04000-42d07000 ---p 00000000 00:00 0
42d07000-42d25000 rwxp 00000000 00:00 0
42d25000-42d28000 ---p 00000000 00:00 0
42d28000-42d46000 rwxp 00000000 00:00 0
42d46000-42d49000 ---p 00000000 00:00 0
42d49000-42d67000 rwxp 00000000 00:00 0
42d67000-42d6a000 ---p 00000000 00:00 0
42d6a000-42d88000 rwxp 00000000 00:00 0
42dca000-42dcd000 ---p 00000000 00:00 0
42dcd000-42deb000 rwxp 00000000 00:00 0
42e0c000-42e0f000 ---p 00000000 00:00 0
42e0f000-42e2d000 rwxp 00000000 00:00 0
42e2d000-42e30000 ---p 00000000 00:00 0
42e30000-42e4e000 rwxp 00000000 00:00 0
42e4e000-42e51000 ---p 00000000 00:00 0
42e51000-42e6f000 rwxp 00000000 00:00 0
42e6f000-42e72000 ---p 00000000 00:00 0
42e72000-42e90000 rwxp 00000000 00:00 0
42e90000-42e93000 ---p 00000000 00:00 0
42e93000-42eb1000 rwxp 00000000 00:00 0
42eb1000-42eb4000 ---p 00000000 00:00 0
42eb4000-42ed2000 rwxp 00000000 00:00 0
42ed2000-42ed5000 ---p 00000000 00:00 0
42ed5000-42ef3000 rwxp 00000000 00:00 0
42ef3000-42ef6000 ---p 00000000 00:00 0
42ef6000-42f14000 rwxp 00000000 00:00 0
42f14000-42f17000 ---p 00000000 00:00 0
42f17000-42f35000 rwxp 00000000 00:00 0
42f35000-42f38000 ---p 00000000 00:00 0
42f38000-42f56000 rwxp 00000000 00:00 0
42f56000-42f59000 ---p 00000000 00:00 0
42f59000-42f77000 rwxp 00000000 00:00 0
42f77000-42f7a000 ---p 00000000 00:00 0
42f7a000-42f98000 rwxp 00000000 00:00 0
42f98000-42f9b000 ---p 00000000 00:00 0
42f9b000-42fb9000 rwxp 00000000 00:00 0
42fda000-42fdd000 ---p 00000000 00:00 0
42fdd000-42ffb000 rwxp 00000000 00:00 0
42ffb000-42ffe000 ---p 00000000 00:00 0
42ffe000-4301c000 rwxp 00000000 00:00 0
4301c000-4301f000 ---p 00000000 00:00 0
4301f000-4303d000 rwxp 00000000 00:00 0
4303d000-43040000 ---p 00000000 00:00 0
43040000-4305e000 rwxp 00000000 00:00 0
4305e000-43061000 ---p 00000000 00:00 0
43061000-4307f000 rwxp 00000000 00:00 0
4307f000-43082000 ---p 00000000 00:00 0
43082000-430a0000 rwxp 00000000 00:00 0
430a0000-430a3000 ---p 00000000 00:00 0
430a3000-430c1000 rwxp 00000000 00:00 0
430c1000-430c4000 ---p 00000000 00:00 0
430c4000-430e2000 rwxp 00000000 00:00 0
430e2000-430e5000 ---p 00000000 00:00 0
430e5000-43103000 rwxp 00000000 00:00 0
43103000-43106000 ---p 00000000 00:00 0
43106000-43124000 rwxp 00000000 00:00 0
43124000-43127000 ---p 00000000 00:00 0
43127000-43145000 rwxp 00000000 00:00 0
43145000-43148000 ---p 00000000 00:00 0
43148000-43166000 rwxp 00000000 00:00 0
43166000-43169000 ---p 00000000 00:00 0
43169000-43187000 rwxp 00000000 00:00 0
43187000-4318a000 ---p 00000000 00:00 0
4318a000-431a8000 rwxp 00000000 00:00 0
431c9000-431cc000 ---p 00000000 00:00 0
431cc000-431ea000 rwxp 00000000 00:00 0
431ea000-431ed000 ---p 00000000 00:00 0
431ed000-4320b000 rwxp 00000000 00:00 0
4320b000-4320e000 ---p 00000000 00:00 0
4320e000-4322c000 rwxp 00000000 00:00 0
4322c000-4322f000 ---p 00000000 00:00 0
4322f000-4324d000 rwxp 00000000 00:00 0
4324d000-43250000 ---p 00000000 00:00 0
43250000-4326e000 rwxp 00000000 00:00 0
4326e000-43271000 ---p 00000000 00:00 0
43271000-4328f000 rwxp 00000000 00:00 0
4328f000-43292000 ---p 00000000 00:00 0
43292000-432b0000 rwxp 00000000 00:00 0
432b0000-432b3000 ---p 00000000 00:00 0
432b3000-432d1000 rwxp 00000000 00:00 0
432d1000-432d4000 ---p 00000000 00:00 0
432d4000-432f2000 rwxp 00000000 00:00 0
432f2000-432f5000 ---p 00000000 00:00 0
432f5000-43313000 rwxp 00000000 00:00 0
43334000-43337000 ---p 00000000 00:00 0
43337000-43355000 rwxp 00000000 00:00 0
43355000-43358000 ---p 00000000 00:00 0
43358000-43376000 rwxp 00000000 00:00 0
43376000-43379000 ---p 00000000 00:00 0
43379000-43397000 rwxp 00000000 00:00 0
43397000-4339a000 ---p 00000000 00:00 0
4339a000-433b8000 rwxp 00000000 00:00 0
433b8000-433bb000 ---p 00000000 00:00 0
433bb000-433d9000 rwxp 00000000 00:00 0
433d9000-433dc000 ---p 00000000 00:00 0
433dc000-433fa000 rwxp 00000000 00:00 0
433fa000-433fd000 ---p 00000000 00:00 0
433fd000-4341b000 rwxp 00000000 00:00 0
4341b000-4341e000 ---p 00000000 00:00 0
4341e000-4343c000 rwxp 00000000 00:00 0
4343c000-4343f000 ---p 00000000 00:00 0
4343f000-4345d000 rwxp 00000000 00:00 0
4345d000-43460000 ---p 00000000 00:00 0
43460000-4347e000 rwxp 00000000 00:00 0
4347e000-43481000 ---p 00000000 00:00 0
43481000-4349f000 rwxp 00000000 00:00 0
4349f000-434a2000 ---p 00000000 00:00 0
434a2000-434c0000 rwxp 00000000 00:00 0
434c0000-434c3000 ---p 00000000 00:00 0
434c3000-434e1000 rwxp 00000000 00:00 0
43523000-43526000 ---p 00000000 00:00 0
43526000-43544000 rwxp 00000000 00:00 0
43544000-43547000 ---p 00000000 00:00 0
43547000-43565000 rwxp 00000000 00:00 0
43586000-43589000 ---p 00000000 00:00 0
43589000-435a7000 rwxp 00000000 00:00 0
435a7000-435aa000 ---p 00000000 00:00 0
435aa000-435c8000 rwxp 00000000 00:00 0
435c8000-435cb000 ---p 00000000 00:00 0
435cb000-435e9000 rwxp 00000000 00:00 0
435e9000-435ec000 ---p 00000000 00:00 0
435ec000-4360a000 rwxp 00000000 00:00 0
4360a000-4360d000 ---p 00000000 00:00 0
4360d000-4362b000 rwxp 00000000 00:00 0
4362b000-4362e000 ---p 00000000 00:00 0
4362e000-4364c000 rwxp 00000000 00:00 0
4364c000-4364f000 ---p 00000000 00:00 0
4364f000-4366d000 rwxp 00000000 00:00 0
4366d000-43670000 ---p 00000000 00:00 0
43670000-4368e000 rwxp 00000000 00:00 0
4368e000-43691000 ---p 00000000 00:00 0
43691000-436af000 rwxp 00000000 00:00 0
436af000-436b2000 ---p 00000000 00:00 0
436b2000-436d0000 rwxp 00000000 00:00 0
436d0000-436d3000 ---p 00000000 00:00 0
436d3000-436f1000 rwxp 00000000 00:00 0
436f1000-436f4000 ---p 00000000 00:00 0
436f4000-43712000 rwxp 00000000 00:00 0
43712000-43715000 ---p 00000000 00:00 0
43715000-43733000 rwxp 00000000 00:00 0
43733000-43736000 ---p 00000000 00:00 0
43736000-43754000 rwxp 00000000 00:00 0
43754000-43757000 ---p 00000000 00:00 0
43757000-43775000 rwxp 00000000 00:00 0
43775000-43778000 ---p 00000000 00:00 0
43778000-43796000 rwxp 00000000 00:00 0
43796000-43799000 ---p 00000000 00:00 0
43799000-437b7000 rwxp 00000000 00:00 0
437b7000-437ba000 ---p 00000000 00:00 0
437ba000-437d8000 rwxp 00000000 00:00 0
437d8000-437db000 ---p 00000000 00:00 0
437db000-437f9000 rwxp 00000000 00:00 0
437f9000-437fc000 ---p 00000000 00:00 0
437fc000-4381a000 rwxp 00000000 00:00 0
4381a000-4381d000 ---p 00000000 00:00 0
4381d000-4383b000 rwxp 00000000 00:00 0
4383b000-4383e000 ---p 00000000 00:00 0
4383e000-4385c000 rwxp 00000000 00:00 0
4385c000-4385f000 ---p 00000000 00:00 0
4385f000-4387d000 rwxp 00000000 00:00 0
4387d000-43880000 ---p 00000000 00:00 0
43880000-4389e000 rwxp 00000000 00:00 0
4389e000-438a1000 ---p 00000000 00:00 0
438a1000-438bf000 rwxp 00000000 00:00 0
438bf000-438c2000 ---p 00000000 00:00 0
438c2000-438e0000 rwxp 00000000 00:00 0
438e0000-438e3000 ---p 00000000 00:00 0
438e3000-43901000 rwxp 00000000 00:00 0
43901000-43904000 ---p 00000000 00:00 0
43904000-43922000 rwxp 00000000 00:00 0
43922000-43925000 ---p 00000000 00:00 0
43925000-43943000 rwxp 00000000 00:00 0
43943000-43946000 ---p 00000000 00:00 0
43946000-43964000 rwxp 00000000 00:00 0
43964000-43967000 ---p 00000000 00:00 0
43967000-43985000 rwxp 00000000 00:00 0
43985000-43988000 ---p 00000000 00:00 0
43988000-439a6000 rwxp 00000000 00:00 0
439a6000-439a9000 ---p 00000000 00:00 0
439a9000-439c7000 rwxp 00000000 00:00 0
439c7000-439ca000 ---p 00000000 00:00 0
439ca000-439e8000 rwxp 00000000 00:00 0
439e8000-439eb000 ---p 00000000 00:00 0
439eb000-43a09000 rwxp 00000000 00:00 0
43a09000-43a0c000 ---p 00000000 00:00 0
43a0c000-43a2a000 rwxp 00000000 00:00 0
43a2a000-43a2d000 ---p 00000000 00:00 0
43a2d000-43a4b000 rwxp 00000000 00:00 0
43a4b000-43a4e000 ---p 00000000 00:00 0
43a4e000-43a6c000 rwxp 00000000 00:00 0
43a6c000-43a6f000 ---p 00000000 00:00 0
43a6f000-43a8d000 rwxp 00000000 00:00 0
43a8d000-43a90000 ---p 00000000 00:00 0
43a90000-43aae000 rwxp 00000000 00:00 0
43aae000-43ab1000 ---p 00000000 00:00 0
43ab1000-43acf000 rwxp 00000000 00:00 0
43acf000-43ad2000 ---p 00000000 00:00 0
43ad2000-43af0000 rwxp 00000000 00:00 0
43af0000-43af3000 ---p 00000000 00:00 0
43af3000-43b11000 rwxp 00000000 00:00 0
43b11000-43b14000 ---p 00000000 00:00 0
43b14000-43b32000 rwxp 00000000 00:00 0
43b32000-43b35000 ---p 00000000 00:00 0
43b35000-43b53000 rwxp 00000000 00:00 0
43b53000-43b56000 ---p 00000000 00:00 0
43b56000-43b74000 rwxp 00000000 00:00 0
43b74000-43b77000 ---p 00000000 00:00 0
43b77000-43b95000 rwxp 00000000 00:00 0
43b95000-43b98000 ---p 00000000 00:00 0
43b98000-43bb6000 rwxp 00000000 00:00 0
43bb6000-43bb9000 ---p 00000000 00:00 0
43bb9000-43bd7000 rwxp 00000000 00:00 0
43bd7000-43bda000 ---p 00000000 00:00 0
43bda000-43bf8000 rwxp 00000000 00:00 0
43bf8000-43bfb000 ---p 00000000 00:00 0
43bfb000-43c19000 rwxp 00000000 00:00 0
43c19000-43c1c000 ---p 00000000 00:00 0
43c1c000-43c3a000 rwxp 00000000 00:00 0
43c3a000-43c3d000 ---p 00000000 00:00 0
43c3d000-43c5b000 rwxp 00000000 00:00 0
43c5b000-43c5e000 ---p 00000000 00:00 0
43c5e000-43c7c000 rwxp 00000000 00:00 0
43c7c000-43c7f000 ---p 00000000 00:00 0
43c7f000-43c9d000 rwxp 00000000 00:00 0
43c9d000-43ca0000 ---p 00000000 00:00 0
43ca0000-43cbe000 rwxp 00000000 00:00 0
43cbe000-43cc1000 ---p 00000000 00:00 0
43cc1000-43cdf000 rwxp 00000000 00:00 0
43cdf000-43ce2000 ---p 00000000 00:00 0
43ce2000-43d00000 rwxp 00000000 00:00 0
43d00000-43d03000 ---p 00000000 00:00 0
43d03000-43d21000 rwxp 00000000 00:00 0
43d21000-43d24000 ---p 00000000 00:00 0
43d24000-43d42000 rwxp 00000000 00:00 0
43d42000-43d45000 ---p 00000000 00:00 0
43d45000-43d63000 rwxp 00000000 00:00 0
43d63000-43d66000 ---p 00000000 00:00 0
43d66000-43d84000 rwxp 00000000 00:00 0
43d84000-43d87000 ---p 00000000 00:00 0
43d87000-43da5000 rwxp 00000000 00:00 0
43da5000-43da8000 ---p 00000000 00:00 0
43da8000-43dc6000 rwxp 00000000 00:00 0
43dc6000-43dc9000 ---p 00000000 00:00 0
43dc9000-43de7000 rwxp 00000000 00:00 0
43e29000-43e2c000 ---p 00000000 00:00 0
43e2c000-43e4a000 rwxp 00000000 00:00 0
43e4a000-43e4d000 ---p 00000000 00:00 0
43e4d000-43e6b000 rwxp 00000000 00:00 0
43e6b000-43e6e000 ---p 00000000 00:00 0
43e6e000-43e8c000 rwxp 00000000 00:00 0
43e8c000-43e8f000 ---p 00000000 00:00 0
43e8f000-43ead000 rwxp 00000000 00:00 0
43ead000-43eb0000 ---p 00000000 00:00 0
43eb0000-43ece000 rwxp 00000000 00:00 0
43ece000-43ed1000 ---p 00000000 00:00 0
43ed1000-43eef000 rwxp 00000000 00:00 0
43eef000-43ef2000 ---p 00000000 00:00 0
43ef2000-43f10000 rwxp 00000000 00:00 0
43f10000-43f13000 ---p 00000000 00:00 0
43f13000-43f31000 rwxp 00000000 00:00 0
43f31000-43f34000 ---p 00000000 00:00 0
43f34000-43f52000 rwxp 00000000 00:00 0
43f52000-43f55000 ---p 00000000 00:00 0
43f55000-43f73000 rwxp 00000000 00:00 0
43f73000-43f76000 ---p 00000000 00:00 0
43f76000-43f94000 rwxp 00000000 00:00 0
43f94000-43f97000 ---p 00000000 00:00 0
43f97000-43fb5000 rwxp 00000000 00:00 0
43fd6000-43fd9000 ---p 00000000 00:00 0
43fd9000-43ff7000 rwxp 00000000 00:00 0
43ff7000-43ffa000 ---p 00000000 00:00 0
43ffa000-44018000 rwxp 00000000 00:00 0
44018000-4401b000 ---p 00000000 00:00 0
4401b000-44039000 rwxp 00000000 00:00 0
44039000-4403c000 ---p 00000000 00:00 0
4403c000-4405a000 rwxp 00000000 00:00 0
4407b000-4407e000 ---p 00000000 00:00 0
4407e000-4409c000 rwxp 00000000 00:00 0
4409c000-4409f000 ---p 00000000 00:00 0
4409f000-440bd000 rwxp 00000000 00:00 0
440bd000-440c0000 ---p 00000000 00:00 0
440c0000-440de000 rwxp 00000000 00:00 0
440de000-440e1000 ---p 00000000 00:00 0
440e1000-440ff000 rwxp 00000000 00:00 0
440ff000-44102000 ---p 00000000 00:00 0
44102000-44120000 rwxp 00000000 00:00 0
44120000-44123000 ---p 00000000 00:00 0
44123000-44141000 rwxp 00000000 00:00 0
44141000-44144000 ---p 00000000 00:00 0
44144000-44162000 rwxp 00000000 00:00 0
44183000-44186000 ---p 00000000 00:00 0
44186000-441a4000 rwxp 00000000 00:00 0
441a4000-441a7000 ---p 00000000 00:00 0
441a7000-441c5000 rwxp 00000000 00:00 0
441c5000-441c8000 ---p 00000000 00:00 0
441c8000-441e6000 rwxp 00000000 00:00 0
441e6000-441e9000 ---p 00000000 00:00 0
441e9000-44207000 rwxp 00000000 00:00 0
44207000-4420a000 ---p 00000000 00:00 0
4420a000-44228000 rwxp 00000000 00:00 0
44228000-4422b000 ---p 00000000 00:00 0
4422b000-44249000 rwxp 00000000 00:00 0
44249000-4424c000 ---p 00000000 00:00 0
4424c000-4426a000 rwxp 00000000 00:00 0
4426a000-4426d000 ---p 00000000 00:00 0
4426d000-4428b000 rwxp 00000000 00:00 0
4428b000-4428e000 ---p 00000000 00:00 0
4428e000-442ac000 rwxp 00000000 00:00 0
442ac000-442af000 ---p 00000000 00:00 0
442af000-442cd000 rwxp 00000000 00:00 0
442cd000-442d0000 ---p 00000000 00:00 0
442d0000-442ee000 rwxp 00000000 00:00 0
4430f000-44312000 ---p 00000000 00:00 0
44312000-44330000 rwxp 00000000 00:00 0
44351000-44354000 ---p 00000000 00:00 0
44354000-44372000 rwxp 00000000 00:00 0
44372000-44375000 ---p 00000000 00:00 0
44375000-44393000 rwxp 00000000 00:00 0
44393000-44396000 ---p 00000000 00:00 0
44396000-443b4000 rwxp 00000000 00:00 0
443b4000-443b7000 ---p 00000000 00:00 0
443b7000-443d5000 rwxp 00000000 00:00 0
443d5000-443d8000 ---p 00000000 00:00 0
443d8000-443f6000 rwxp 00000000 00:00 0
443f6000-443f9000 ---p 00000000 00:00 0
443f9000-44417000 rwxp 00000000 00:00 0
44417000-4441a000 ---p 00000000 00:00 0
4441a000-44438000 rwxp 00000000 00:00 0
44438000-4443b000 ---p 00000000 00:00 0
4443b000-44459000 rwxp 00000000 00:00 0
44459000-4445c000 ---p 00000000 00:00 0
4445c000-4447a000 rwxp 00000000 00:00 0
4449b000-4449e000 ---p 00000000 00:00 0
4449e000-444bc000 rwxp 00000000 00:00 0
444dd000-444e0000 ---p 00000000 00:00 0
444e0000-444fe000 rwxp 00000000 00:00 0
444fe000-44501000 ---p 00000000 00:00 0
44501000-4451f000 rwxp 00000000 00:00 0
4451f000-44522000 ---p 00000000 00:00 0
44522000-44540000 rwxp 00000000 00:00 0
44540000-44543000 ---p 00000000 00:00 0
44543000-44561000 rwxp 00000000 00:00 0
44561000-44564000 ---p 00000000 00:00 0
44564000-44582000 rwxp 00000000 00:00 0
445c4000-445c7000 ---p 00000000 00:00 0
445c7000-445e5000 rwxp 00000000 00:00 0
445e5000-445e8000 ---p 00000000 00:00 0
445e8000-44606000 rwxp 00000000 00:00 0
44606000-44609000 ---p 00000000 00:00 0
44609000-44627000 rwxp 00000000 00:00 0
44627000-4462a000 ---p 00000000 00:00 0
4462a000-44648000 rwxp 00000000 00:00 0
44648000-4464b000 ---p 00000000 00:00 0
4464b000-44669000 rwxp 00000000 00:00 0
44669000-4466c000 ---p 00000000 00:00 0
4466c000-4468a000 rwxp 00000000 00:00 0
4468a000-4468d000 ---p 00000000 00:00 0
4468d000-446ab000 rwxp 00000000 00:00 0
446ab000-446ae000 ---p 00000000 00:00 0
446ae000-446cc000 rwxp 00000000 00:00 0
446ed000-446f0000 ---p 00000000 00:00 0
446f0000-4470e000 rwxp 00000000 00:00 0
4470e000-44711000 ---p 00000000 00:00 0
44711000-4472f000 rwxp 00000000 00:00 0
4472f000-44732000 ---p 00000000 00:00 0
44732000-44750000 rwxp 00000000 00:00 0
44750000-44753000 ---p 00000000 00:00 0
44753000-44771000 rwxp 00000000 00:00 0
44771000-44774000 ---p 00000000 00:00 0
44774000-44792000 rwxp 00000000 00:00 0
44792000-44795000 ---p 00000000 00:00 0
44795000-447b3000 rwxp 00000000 00:00 0
447b3000-447b6000 ---p 00000000 00:00 0
447b6000-447d4000 rwxp 00000000 00:00 0
447d4000-447d7000 ---p 00000000 00:00 0
447d7000-447f5000 rwxp 00000000 00:00 0
447f5000-447f8000 ---p 00000000 00:00 0
447f8000-44816000 rwxp 00000000 00:00 0
44816000-44819000 ---p 00000000 00:00 0
44819000-44837000 rwxp 00000000 00:00 0
44837000-4483a000 ---p 00000000 00:00 0
4483a000-44858000 rwxp 00000000 00:00 0
44858000-4485b000 ---p 00000000 00:00 0
4485b000-44879000 rwxp 00000000 00:00 0
44879000-4487c000 ---p 00000000 00:00 0
4487c000-4489a000 rwxp 00000000 00:00 0
4489a000-4489d000 ---p 00000000 00:00 0
4489d000-448bb000 rwxp 00000000 00:00 0
448bb000-448be000 ---p 00000000 00:00 0
448be000-448dc000 rwxp 00000000 00:00 0
448fd000-44900000 ---p 00000000 00:00 0
44900000-4491e000 rwxp 00000000 00:00 0
4491e000-44921000 ---p 00000000 00:00 0
44921000-4493f000 rwxp 00000000 00:00 0
4493f000-44942000 ---p 00000000 00:00 0
44942000-44960000 rwxp 00000000 00:00 0
44960000-44963000 ---p 00000000 00:00 0
44963000-44981000 rwxp 00000000 00:00 0
44981000-44984000 ---p 00000000 00:00 0
44984000-449a2000 rwxp 00000000 00:00 0
449a2000-449a5000 ---p 00000000 00:00 0
449a5000-449c3000 rwxp 00000000 00:00 0
449c3000-449c6000 ---p 00000000 00:00 0
449c6000-449e4000 rwxp 00000000 00:00 0
449e4000-449e7000 ---p 00000000 00:00 0
449e7000-44a05000 rwxp 00000000 00:00 0
44a05000-44a08000 ---p 00000000 00:00 0
44a08000-44a26000 rwxp 00000000 00:00 0
44a26000-44a29000 ---p 00000000 00:00 0
44a29000-44a47000 rwxp 00000000 00:00 0
44a47000-44a4a000 ---p 00000000 00:00 0
44a4a000-44a68000 rwxp 00000000 00:00 0
44a68000-44a6b000 ---p 00000000 00:00 0
44a6b000-44a89000 rwxp 00000000 00:00 0
44a89000-44a8c000 ---p 00000000 00:00 0
44a8c000-44aaa000 rwxp 00000000 00:00 0
44aaa000-44aad000 ---p 00000000 00:00 0
44aad000-44acb000 rwxp 00000000 00:00 0
44acb000-44ace000 ---p 00000000 00:00 0
44ace000-44aec000 rwxp 00000000 00:00 0
44aec000-44aef000 ---p 00000000 00:00 0
44aef000-44b0d000 rwxp 00000000 00:00 0
44b0d000-44b10000 ---p 00000000 00:00 0
44b10000-44b2e000 rwxp 00000000 00:00 0
44b2e000-44b31000 ---p 00000000 00:00 0
44b31000-44b4f000 rwxp 00000000 00:00 0
44b4f000-44b52000 ---p 00000000 00:00 0
44b52000-44b70000 rwxp 00000000 00:00 0
44b70000-44b73000 ---p 00000000 00:00 0
44b73000-44b91000 rwxp 00000000 00:00 0
44b91000-44b94000 ---p 00000000 00:00 0
44b94000-44bb2000 rwxp 00000000 00:00 0
44bb2000-44bb5000 ---p 00000000 00:00 0
44bb5000-44bd3000 rwxp 00000000 00:00 0
44bd3000-44bd6000 ---p 00000000 00:00 0
44bd6000-44bf4000 rwxp 00000000 00:00 0
44c15000-44c18000 ---p 00000000 00:00 0
44c18000-44c36000 rwxp 00000000 00:00 0
44c36000-44c39000 ---p 00000000 00:00 0
44c39000-44c57000 rwxp 00000000 00:00 0
44c57000-44c5a000 ---p 00000000 00:00 0
44c5a000-44c78000 rwxp 00000000 00:00 0
44c78000-44c7b000 ---p 00000000 00:00 0
44c7b000-44c99000 rwxp 00000000 00:00 0
44c99000-44c9c000 ---p 00000000 00:00 0
44c9c000-44cba000 rwxp 00000000 00:00 0
44cba000-44cbd000 ---p 00000000 00:00 0
44cbd000-44cdb000 rwxp 00000000 00:00 0
44cdb000-44cde000 ---p 00000000 00:00 0
44cde000-44cfc000 rwxp 00000000 00:00 0
44cfc000-44cff000 ---p 00000000 00:00 0
44cff000-44d1d000 rwxp 00000000 00:00 0
44d1d000-44d20000 ---p 00000000 00:00 0
44d20000-44d3e000 rwxp 00000000 00:00 0
44d3e000-44d41000 ---p 00000000 00:00 0
44d41000-44d5f000 rwxp 00000000 00:00 0
44d5f000-44d62000 ---p 00000000 00:00 0
44d62000-44d80000 rwxp 00000000 00:00 0
44d80000-44d83000 ---p 00000000 00:00 0
44d83000-44da1000 rwxp 00000000 00:00 0
44da1000-44da4000 ---p 00000000 00:00 0
44da4000-44dc2000 rwxp 00000000 00:00 0
44dc2000-44dc5000 ---p 00000000 00:00 0
44dc5000-44de3000 rwxp 00000000 00:00 0
44de3000-44de6000 ---p 00000000 00:00 0
44de6000-44e04000 rwxp 00000000 00:00 0
44e04000-44e07000 ---p 00000000 00:00 0
44e07000-44e25000 rwxp 00000000 00:00 0
44e25000-44e28000 ---p 00000000 00:00 0
44e28000-44e46000 rwxp 00000000 00:00 0
44e46000-44e49000 ---p 00000000 00:00 0
44e49000-44e67000 rwxp 00000000 00:00 0
44e67000-44e6a000 ---p 00000000 00:00 0
44e6a000-44e88000 rwxp 00000000 00:00 0
44e88000-44e8b000 ---p 00000000 00:00 0
44e8b000-44ea9000 rwxp 00000000 00:00 0
44ea9000-44eac000 ---p 00000000 00:00 0
44eac000-44eca000 rwxp 00000000 00:00 0
44eca000-44ecd000 ---p 00000000 00:00 0
44ecd000-44eeb000 rwxp 00000000 00:00 0
44eeb000-44eee000 ---p 00000000 00:00 0
44eee000-44f0c000 rwxp 00000000 00:00 0
44f0c000-44f0f000 ---p 00000000 00:00 0
44f0f000-44f2d000 rwxp 00000000 00:00 0
44f2d000-44f30000 ---p 00000000 00:00 0
44f30000-44f4e000 rwxp 00000000 00:00 0
44f4e000-44f51000 ---p 00000000 00:00 0
44f51000-44f6f000 rwxp 00000000 00:00 0
44f6f000-44f72000 ---p 00000000 00:00 0
44f72000-44f90000 rwxp 00000000 00:00 0
44f90000-44f93000 ---p 00000000 00:00 0
44f93000-44fb1000 rwxp 00000000 00:00 0
44fd2000-44fd5000 ---p 00000000 00:00 0
44fd5000-44ff3000 rwxp 00000000 00:00 0
44ff3000-44ff6000 ---p 00000000 00:00 0
44ff6000-45014000 rwxp 00000000 00:00 0
45014000-45017000 ---p 00000000 00:00 0
45017000-45035000 rwxp 00000000 00:00 0
45035000-45038000 ---p 00000000 00:00 0
45038000-45056000 rwxp 00000000 00:00 0
45056000-45059000 ---p 00000000 00:00 0
45059000-45077000 rwxp 00000000 00:00 0
45077000-4507a000 ---p 00000000 00:00 0
4507a000-45098000 rwxp 00000000 00:00 0
450b9000-450bc000 ---p 00000000 00:00 0
450bc000-450da000 rwxp 00000000 00:00 0
450da000-450dd000 ---p 00000000 00:00 0
450dd000-450fb000 rwxp 00000000 00:00 0
450fb000-450fe000 ---p 00000000 00:00 0
450fe000-4511c000 rwxp 00000000 00:00 0
4513d000-45140000 ---p 00000000 00:00 0
45140000-4515e000 rwxp 00000000 00:00 0
4517f000-45182000 ---p 00000000 00:00 0
45182000-451a0000 rwxp 00000000 00:00 0
451a0000-451a3000 ---p 00000000 00:00 0
451a3000-451c1000 rwxp 00000000 00:00 0
451c1000-451c4000 ---p 00000000 00:00 0
451c4000-451e2000 rwxp 00000000 00:00 0
451e2000-451e5000 ---p 00000000 00:00 0
451e5000-45203000 rwxp 00000000 00:00 0
45203000-45206000 ---p 00000000 00:00 0
45206000-45224000 rwxp 00000000 00:00 0
45224000-45227000 ---p 00000000 00:00 0
45227000-45245000 rwxp 00000000 00:00 0
45266000-45269000 ---p 00000000 00:00 0
45269000-45287000 rwxp 00000000 00:00 0
45287000-4528a000 ---p 00000000 00:00 0
4528a000-452a8000 rwxp 00000000 00:00 0
452a8000-452ab000 ---p 00000000 00:00 0
452ab000-452c9000 rwxp 00000000 00:00 0
452c9000-452cc000 ---p 00000000 00:00 0
452cc000-452ea000 rwxp 00000000 00:00 0
452ea000-452ed000 ---p 00000000 00:00 0
452ed000-4530b000 rwxp 00000000 00:00 0
4530b000-4530e000 ---p 00000000 00:00 0
4530e000-4532c000 rwxp 00000000 00:00 0
4532c000-4532f000 ---p 00000000 00:00 0
4532f000-4534d000 rwxp 00000000 00:00 0
4538f000-45392000 ---p 00000000 00:00 0
45392000-453b0000 rwxp 00000000 00:00 0
453b0000-453b3000 ---p 00000000 00:00 0
453b3000-453d1000 rwxp 00000000 00:00 0
453d1000-453d4000 ---p 00000000 00:00 0
453d4000-453f2000 rwxp 00000000 00:00 0
453f2000-453f5000 ---p 00000000 00:00 0
453f5000-45413000 rwxp 00000000 00:00 0
45413000-45416000 ---p 00000000 00:00 0
45416000-45434000 rwxp 00000000 00:00 0
45434000-45437000 ---p 00000000 00:00 0
45437000-45455000 rwxp 00000000 00:00 0
45455000-45458000 ---p 00000000 00:00 0
45458000-45476000 rwxp 00000000 00:00 0
45476000-45479000 ---p 00000000 00:00 0
45479000-45497000 rwxp 00000000 00:00 0
45497000-4549a000 ---p 00000000 00:00 0
4549a000-454b8000 rwxp 00000000 00:00 0
454b8000-454bb000 ---p 00000000 00:00 0
454bb000-454d9000 rwxp 00000000 00:00 0
454d9000-454dc000 ---p 00000000 00:00 0
454dc000-454fa000 rwxp 00000000 00:00 0
454fa000-454fd000 ---p 00000000 00:00 0
454fd000-4551b000 rwxp 00000000 00:00 0
4551b000-4551e000 ---p 00000000 00:00 0
4551e000-4553c000 rwxp 00000000 00:00 0
4553c000-4553f000 ---p 00000000 00:00 0
4553f000-4555d000 rwxp 00000000 00:00 0
4555d000-45560000 ---p 00000000 00:00 0
45560000-4557e000 rwxp 00000000 00:00 0
4557e000-45581000 ---p 00000000 00:00 0
45581000-4559f000 rwxp 00000000 00:00 0
4559f000-455a2000 ---p 00000000 00:00 0
455a2000-455c0000 rwxp 00000000 00:00 0
455c0000-455c3000 ---p 00000000 00:00 0
455c3000-455e1000 rwxp 00000000 00:00 0
455e1000-455e4000 ---p 00000000 00:00 0
455e4000-45602000 rwxp 00000000 00:00 0
45602000-45605000 ---p 00000000 00:00 0
45605000-45623000 rwxp 00000000 00:00 0
45623000-45626000 ---p 00000000 00:00 0
45626000-45644000 rwxp 00000000 00:00 0
45644000-45647000 ---p 00000000 00:00 0
45647000-45665000 rwxp 00000000 00:00 0
45665000-45668000 ---p 00000000 00:00 0
45668000-45686000 rwxp 00000000 00:00 0
45686000-45689000 ---p 00000000 00:00 0
45689000-456a7000 rwxp 00000000 00:00 0
456a7000-456aa000 ---p 00000000 00:00 0
456aa000-456c8000 rwxp 00000000 00:00 0
456c8000-456cb000 ---p 00000000 00:00 0
456cb000-456e9000 rwxp 00000000 00:00 0
456e9000-456ec000 ---p 00000000 00:00 0
456ec000-4570a000 rwxp 00000000 00:00 0
4570a000-4570d000 ---p 00000000 00:00 0
4570d000-4572b000 rwxp 00000000 00:00 0
4572b000-4572e000 ---p 00000000 00:00 0
4572e000-4574c000 rwxp 00000000 00:00 0
4574c000-4574f000 ---p 00000000 00:00 0
4574f000-4576d000 rwxp 00000000 00:00 0
4576d000-45770000 ---p 00000000 00:00 0
45770000-4578e000 rwxp 00000000 00:00 0
4578e000-45791000 ---p 00000000 00:00 0
45791000-457af000 rwxp 00000000 00:00 0
457af000-457b2000 ---p 00000000 00:00 0
457b2000-457d0000 rwxp 00000000 00:00 0
457d0000-457d3000 ---p 00000000 00:00 0
457d3000-457f1000 rwxp 00000000 00:00 0
457f1000-457f4000 ---p 00000000 00:00 0
457f4000-45812000 rwxp 00000000 00:00 0
45812000-45815000 ---p 00000000 00:00 0
45815000-45833000 rwxp 00000000 00:00 0
45833000-45836000 ---p 00000000 00:00 0
45836000-45854000 rwxp 00000000 00:00 0
45854000-45857000 ---p 00000000 00:00 0
45857000-45875000 rwxp 00000000 00:00 0
45875000-45878000 ---p 00000000 00:00 0
45878000-45896000 rwxp 00000000 00:00 0
45896000-45899000 ---p 00000000 00:00 0
45899000-458b7000 rwxp 00000000 00:00 0
458b7000-458ba000 ---p 00000000 00:00 0
458ba000-458d8000 rwxp 00000000 00:00 0
458d8000-458db000 ---p 00000000 00:00 0
458db000-458f9000 rwxp 00000000 00:00 0
458f9000-458fc000 ---p 00000000 00:00 0
458fc000-4591a000 rwxp 00000000 00:00 0
4591a000-4591d000 ---p 00000000 00:00 0
4591d000-4593b000 rwxp 00000000 00:00 0
4593b000-4593e000 ---p 00000000 00:00 0
4593e000-4595c000 rwxp 00000000 00:00 0
4595c000-4595f000 ---p 00000000 00:00 0
4595f000-4597d000 rwxp 00000000 00:00 0
4597d000-45980000 ---p 00000000 00:00 0
45980000-4599e000 rwxp 00000000 00:00 0
4599e000-459a1000 ---p 00000000 00:00 0
459a1000-459bf000 rwxp 00000000 00:00 0
459bf000-459c2000 ---p 00000000 00:00 0
459c2000-459e0000 rwxp 00000000 00:00 0
459e0000-459e3000 ---p 00000000 00:00 0
459e3000-45a01000 rwxp 00000000 00:00 0
45a01000-45a04000 ---p 00000000 00:00 0
45a04000-45a22000 rwxp 00000000 00:00 0
45a22000-45a25000 ---p 00000000 00:00 0
45a25000-45a43000 rwxp 00000000 00:00 0
45a43000-45a46000 ---p 00000000 00:00 0
45a46000-45a64000 rwxp 00000000 00:00 0
45a64000-45a67000 ---p 00000000 00:00 0
45a67000-45a85000 rwxp 00000000 00:00 0
45a85000-45a88000 ---p 00000000 00:00 0
45a88000-45aa6000 rwxp 00000000 00:00 0
45aa6000-45aa9000 ---p 00000000 00:00 0
45aa9000-45ac7000 rwxp 00000000 00:00 0
45ac7000-45aca000 ---p 00000000 00:00 0
45aca000-45ae8000 rwxp 00000000 00:00 0
45ae8000-45aeb000 ---p 00000000 00:00 0
45aeb000-45b09000 rwxp 00000000 00:00 0
45b09000-45b0c000 ---p 00000000 00:00 0
45b0c000-45b2a000 rwxp 00000000 00:00 0
45b2a000-45b2d000 ---p 00000000 00:00 0
45b2d000-45b4b000 rwxp 00000000 00:00 0
45b4b000-45b4e000 ---p 00000000 00:00 0
45b4e000-45b6c000 rwxp 00000000 00:00 0
45b6c000-45b6f000 ---p 00000000 00:00 0
45b6f000-45b8d000 rwxp 00000000 00:00 0
45b8d000-45b90000 ---p 00000000 00:00 0
45b90000-45bae000 rwxp 00000000 00:00 0
45bae000-45bb1000 ---p 00000000 00:00 0
45bb1000-45bcf000 rwxp 00000000 00:00 0
45bcf000-45bd2000 ---p 00000000 00:00 0
45bd2000-45bf0000 rwxp 00000000 00:00 0
45bf0000-45bf3000 ---p 00000000 00:00 0
45bf3000-45c11000 rwxp 00000000 00:00 0
45c32000-45c35000 ---p 00000000 00:00 0
45c35000-45c53000 rwxp 00000000 00:00 0
45c53000-45c56000 ---p 00000000 00:00 0
45c56000-45c74000 rwxp 00000000 00:00 0
45c74000-45c77000 ---p 00000000 00:00 0
45c77000-45c95000 rwxp 00000000 00:00 0
45c95000-45c98000 ---p 00000000 00:00 0
45c98000-45cb6000 rwxp 00000000 00:00 0
45cb6000-45cb9000 ---p 00000000 00:00 0
45cb9000-45cd7000 rwxp 00000000 00:00 0
45cd7000-45cda000 ---p 00000000 00:00 0
45cda000-45cf8000 rwxp 00000000 00:00 0
45cf8000-45cfb000 ---p 00000000 00:00 0
45cfb000-45d19000 rwxp 00000000 00:00 0
45d19000-45d1c000 ---p 00000000 00:00 0
45d1c000-45d3a000 rwxp 00000000 00:00 0
45d3a000-45d3d000 ---p 00000000 00:00 0
45d3d000-45d5b000 rwxp 00000000 00:00 0
45d5b000-45d5e000 ---p 00000000 00:00 0
45d5e000-45d7c000 rwxp 00000000 00:00 0
45d9d000-45da0000 ---p 00000000 00:00 0
45da0000-45dbe000 rwxp 00000000 00:00 0
45ddf000-45de2000 ---p 00000000 00:00 0
45de2000-45e00000 rwxp 00000000 00:00 0
45e00000-45e03000 ---p 00000000 00:00 0
45e03000-45e21000 rwxp 00000000 00:00 0
45e21000-45e24000 ---p 00000000 00:00 0
45e24000-45e42000 rwxp 00000000 00:00 0
45e42000-45e45000 ---p 00000000 00:00 0
45e45000-45e63000 rwxp 00000000 00:00 0
45e63000-45e66000 ---p 00000000 00:00 0
45e66000-45e84000 rwxp 00000000 00:00 0
45e84000-45e87000 ---p 00000000 00:00 0
45e87000-45ea5000 rwxp 00000000 00:00 0
45ea5000-45ea8000 ---p 00000000 00:00 0
45ea8000-45ec6000 rwxp 00000000 00:00 0
45ec6000-45ec9000 ---p 00000000 00:00 0
45ec9000-45ee7000 rwxp 00000000 00:00 0
45ee7000-45eea000 ---p 00000000 00:00 0
45eea000-45f08000 rwxp 00000000 00:00 0
45f08000-45f0b000 ---p 00000000 00:00 0
45f0b000-45f29000 rwxp 00000000 00:00 0
45f29000-45f2c000 ---p 00000000 00:00 0
45f2c000-45f4a000 rwxp 00000000 00:00 0
45f4a000-45f4d000 ---p 00000000 00:00 0
45f4d000-45f6b000 rwxp 00000000 00:00 0
45f6b000-45f6e000 ---p 00000000 00:00 0
45f6e000-45f8c000 rwxp 00000000 00:00 0
45f8c000-45f8f000 ---p 00000000 00:00 0
45f8f000-45fad000 rwxp 00000000 00:00 0
45fad000-45fb0000 ---p 00000000 00:00 0
45fb0000-45fce000 rwxp 00000000 00:00 0
45fce000-45fd1000 ---p 00000000 00:00 0
45fd1000-45fef000 rwxp 00000000 00:00 0
45fef000-45ff2000 ---p 00000000 00:00 0
45ff2000-46010000 rwxp 00000000 00:00 0
46010000-46013000 ---p 00000000 00:00 0
46013000-46031000 rwxp 00000000 00:00 0
46031000-46034000 ---p 00000000 00:00 0
46034000-46052000 rwxp 00000000 00:00 0
46052000-46055000 ---p 00000000 00:00 0
46055000-46073000 rwxp 00000000 00:00 0
46073000-46076000 ---p 00000000 00:00 0
46076000-46094000 rwxp 00000000 00:00 0
46094000-46097000 ---p 00000000 00:00 0
46097000-460b5000 rwxp 00000000 00:00 0
460b5000-460b8000 ---p 00000000 00:00 0
460b8000-460d6000 rwxp 00000000 00:00 0
460d6000-460d9000 ---p 00000000 00:00 0
460d9000-460f7000 rwxp 00000000 00:00 0
460f7000-460fa000 ---p 00000000 00:00 0
460fa000-46118000 rwxp 00000000 00:00 0
46118000-4611b000 ---p 00000000 00:00 0
4611b000-46139000 rwxp 00000000 00:00 0
46139000-4613c000 ---p 00000000 00:00 0
4613c000-4615a000 rwxp 00000000 00:00 0
4615a000-4615d000 ---p 00000000 00:00 0
4615d000-4617b000 rwxp 00000000 00:00 0
4617b000-4617e000 ---p 00000000 00:00 0
4617e000-4619c000 rwxp 00000000 00:00 0
461de000-461e1000 ---p 00000000 00:00 0
461e1000-461ff000 rwxp 00000000 00:00 0
461ff000-46202000 ---p 00000000 00:00 0
46202000-46220000 rwxp 00000000 00:00 0
46220000-46223000 ---p 00000000 00:00 0
46223000-46241000 rwxp 00000000 00:00 0
46241000-46244000 ---p 00000000 00:00 0
46244000-46262000 rwxp 00000000 00:00 0
46262000-46265000 ---p 00000000 00:00 0
46265000-46283000 rwxp 00000000 00:00 0
46283000-46286000 ---p 00000000 00:00 0
46286000-462a4000 rwxp 00000000 00:00 0
462a4000-462a7000 ---p 00000000 00:00 0
462a7000-462c5000 rwxp 00000000 00:00 0
462e6000-462e9000 ---p 00000000 00:00 0
462e9000-46307000 rwxp 00000000 00:00 0
46307000-4630a000 ---p 00000000 00:00 0
4630a000-46328000 rwxp 00000000 00:00 0
46328000-4632b000 ---p 00000000 00:00 0
4632b000-46349000 rwxp 00000000 00:00 0
46349000-4634c000 ---p 00000000 00:00 0
4634c000-4636a000 rwxp 00000000 00:00 0
463ac000-463af000 ---p 00000000 00:00 0
463af000-463cd000 rwxp 00000000 00:00 0
463ee000-463f1000 ---p 00000000 00:00 0
463f1000-4640f000 rwxp 00000000 00:00 0
4640f000-46412000 ---p 00000000 00:00 0
46412000-46430000 rwxp 00000000 00:00 0
46430000-46433000 ---p 00000000 00:00 0
46433000-46451000 rwxp 00000000 00:00 0
46472000-46475000 ---p 00000000 00:00 0
46475000-46493000 rwxp 00000000 00:00 0
46493000-46496000 ---p 00000000 00:00 0
46496000-464b4000 rwxp 00000000 00:00 0
464b4000-464b7000 ---p 00000000 00:00 0
464b7000-464d5000 rwxp 00000000 00:00 0
464d5000-464d8000 ---p 00000000 00:00 0
464d8000-464f6000 rwxp 00000000 00:00 0
464f6000-464f9000 ---p 00000000 00:00 0
464f9000-46517000 rwxp 00000000 00:00 0
46517000-4651a000 ---p 00000000 00:00 0
4651a000-46538000 rwxp 00000000 00:00 0
46538000-4653b000 ---p 00000000 00:00 0
4653b000-46559000 rwxp 00000000 00:00 0
46559000-4655c000 ---p 00000000 00:00 0
4655c000-4657a000 rwxp 00000000 00:00 0
4659b000-4659e000 ---p 00000000 00:00 0
4659e000-465bc000 rwxp 00000000 00:00 0
465dd000-465e0000 ---p 00000000 00:00 0
465e0000-465fe000 rwxp 00000000 00:00 0
465fe000-46601000 ---p 00000000 00:00 0
46601000-4661f000 rwxp 00000000 00:00 0
4661f000-46622000 ---p 00000000 00:00 0
46622000-46640000 rwxp 00000000 00:00 0
46640000-46643000 ---p 00000000 00:00 0
46643000-46661000 rwxp 00000000 00:00 0
46661000-46664000 ---p 00000000 00:00 0
46664000-46682000 rwxp 00000000 00:00 0
46682000-46685000 ---p 00000000 00:00 0
46685000-466a3000 rwxp 00000000 00:00 0
466a3000-466a6000 ---p 00000000 00:00 0
466a6000-466c4000 rwxp 00000000 00:00 0
466c4000-466c7000 ---p 00000000 00:00 0
466c7000-466e5000 rwxp 00000000 00:00 0
466e5000-466e8000 ---p 00000000 00:00 0
466e8000-46706000 rwxp 00000000 00:00 0
46706000-46709000 ---p 00000000 00:00 0
46709000-46727000 rwxp 00000000 00:00 0
46727000-4672a000 ---p 00000000 00:00 0
4672a000-46748000 rwxp 00000000 00:00 0
46748000-4674b000 ---p 00000000 00:00 0
4674b000-46769000 rwxp 00000000 00:00 0
46769000-4676c000 ---p 00000000 00:00 0
4676c000-4678a000 rwxp 00000000 00:00 0
4678a000-4678d000 ---p 00000000 00:00 0
4678d000-467ab000 rwxp 00000000 00:00 0
467ab000-467ae000 ---p 00000000 00:00 0
467ae000-467cc000 rwxp 00000000 00:00 0
467cc000-467cf000 ---p 00000000 00:00 0
467cf000-467ed000 rwxp 00000000 00:00 0
467ed000-467f0000 ---p 00000000 00:00 0
467f0000-4680e000 rwxp 00000000 00:00 0
4680e000-46811000 ---p 00000000 00:00 0
46811000-4682f000 rwxp 00000000 00:00 0
4682f000-46832000 ---p 00000000 00:00 0
46832000-46850000 rwxp 00000000 00:00 0
46850000-46853000 ---p 00000000 00:00 0
46853000-46871000 rwxp 00000000 00:00 0
46871000-46874000 ---p 00000000 00:00 0
46874000-46892000 rwxp 00000000 00:00 0
46892000-46895000 ---p 00000000 00:00 0
46895000-468b3000 rwxp 00000000 00:00 0
468b3000-468b6000 ---p 00000000 00:00 0
468b6000-468d4000 rwxp 00000000 00:00 0
468d4000-468d7000 ---p 00000000 00:00 0
468d7000-468f5000 rwxp 00000000 00:00 0
468f5000-468f8000 ---p 00000000 00:00 0
468f8000-46916000 rwxp 00000000 00:00 0
46916000-46919000 ---p 00000000 00:00 0
46919000-46937000 rwxp 00000000 00:00 0
46937000-4693a000 ---p 00000000 00:00 0
4693a000-46958000 rwxp 00000000 00:00 0
46958000-4695b000 ---p 00000000 00:00 0
4695b000-46979000 rwxp 00000000 00:00 0
46979000-4697c000 ---p 00000000 00:00 0
4697c000-4699a000 rwxp 00000000 00:00 0
4699a000-4699d000 ---p 00000000 00:00 0
4699d000-469bb000 rwxp 00000000 00:00 0
469bb000-469be000 ---p 00000000 00:00 0
469be000-469dc000 rwxp 00000000 00:00 0
469dc000-469df000 ---p 00000000 00:00 0
469df000-469fd000 rwxp 00000000 00:00 0
469fd000-46a00000 ---p 00000000 00:00 0
46a00000-46a1e000 rwxp 00000000 00:00 0
46a1e000-46a21000 ---p 00000000 00:00 0
46a21000-46a3f000 rwxp 00000000 00:00 0
46a3f000-46a42000 ---p 00000000 00:00 0
46a42000-46a60000 rwxp 00000000 00:00 0
46a60000-46a63000 ---p 00000000 00:00 0
46a63000-46a81000 rwxp 00000000 00:00 0
46a81000-46a84000 ---p 00000000 00:00 0
46a84000-46aa2000 rwxp 00000000 00:00 0
46aa2000-46aa5000 ---p 00000000 00:00 0
46aa5000-46ac3000 rwxp 00000000 00:00 0
46ac3000-46ac6000 ---p 00000000 00:00 0
46ac6000-46ae4000 rwxp 00000000 00:00 0
46b05000-46b08000 ---p 00000000 00:00 0
46b08000-46b26000 rwxp 00000000 00:00 0
46b47000-46b4a000 ---p 00000000 00:00 0
46b4a000-46b68000 rwxp 00000000 00:00 0
46b68000-46b6b000 ---p 00000000 00:00 0
46b6b000-46b89000 rwxp 00000000 00:00 0
46b89000-46b8c000 ---p 00000000 00:00 0
46b8c000-46baa000 rwxp 00000000 00:00 0
46bcb000-46bce000 ---p 00000000 00:00 0
46bce000-46bec000 rwxp 00000000 00:00 0
46bec000-46bef000 ---p 00000000 00:00 0
46bef000-46c0d000 rwxp 00000000 00:00 0
46c2e000-46c31000 ---p 00000000 00:00 0
46c31000-46c4f000 rwxp 00000000 00:00 0
46c70000-46c73000 ---p 00000000 00:00 0
46c73000-46c91000 rwxp 00000000 00:00 0
46c91000-46c94000 ---p 00000000 00:00 0
46c94000-46cb2000 rwxp 00000000 00:00 0
46cd3000-46cd6000 ---p 00000000 00:00 0
46cd6000-46cf4000 rwxp 00000000 00:00 0
46cf4000-46cf7000 ---p 00000000 00:00 0
46cf7000-46d15000 rwxp 00000000 00:00 0
46d15000-46d18000 ---p 00000000 00:00 0
46d18000-46d36000 rwxp 00000000 00:00 0
46d36000-46d39000 ---p 00000000 00:00 0
46d39000-46d57000 rwxp 00000000 00:00 0
46d99000-46d9c000 ---p 00000000 00:00 0
46d9c000-46dba000 rwxp 00000000 00:00 0
46dba000-46dbd000 ---p 00000000 00:00 0
46dbd000-46ddb000 rwxp 00000000 00:00 0
46dfc000-46dff000 ---p 00000000 00:00 0
46dff000-46e1d000 rwxp 00000000 00:00 0
46e1d000-46e20000 ---p 00000000 00:00 0
46e20000-46e3e000 rwxp 00000000 00:00 0
46e3e000-46e41000 ---p 00000000 00:00 0
46e41000-46e5f000 rwxp 00000000 00:00 0
46e5f000-46e62000 ---p 00000000 00:00 0
46e62000-46e80000 rwxp 00000000 00:00 0
46e80000-46e83000 ---p 00000000 00:00 0
46e83000-46ea1000 rwxp 00000000 00:00 0
46ea1000-46ea4000 ---p 00000000 00:00 0
46ea4000-46ec2000 rwxp 00000000 00:00 0
46ec2000-46ec5000 ---p 00000000 00:00 0
46ec5000-46ee3000 rwxp 00000000 00:00 0
46ee3000-46ee6000 ---p 00000000 00:00 0
46ee6000-46f04000 rwxp 00000000 00:00 0
46f04000-46f07000 ---p 00000000 00:00 0
46f07000-46f25000 rwxp 00000000 00:00 0
46f25000-46f28000 ---p 00000000 00:00 0
46f28000-46f46000 rwxp 00000000 00:00 0
46f46000-46f49000 ---p 00000000 00:00 0
46f49000-46f67000 rwxp 00000000 00:00 0
46f67000-46f6a000 ---p 00000000 00:00 0
46f6a000-46f88000 rwxp 00000000 00:00 0
46f88000-46f8b000 ---p 00000000 00:00 0
46f8b000-46fa9000 rwxp 00000000 00:00 0
46fa9000-46fac000 ---p 00000000 00:00 0
46fac000-46fca000 rwxp 00000000 00:00 0
46fca000-46fcd000 ---p 00000000 00:00 0
46fcd000-46feb000 rwxp 00000000 00:00 0
46feb000-46fee000 ---p 00000000 00:00 0
46fee000-4700c000 rwxp 00000000 00:00 0
4700c000-4700f000 ---p 00000000 00:00 0
4700f000-4702d000 rwxp 00000000 00:00 0
4702d000-47030000 ---p 00000000 00:00 0
47030000-4704e000 rwxp 00000000 00:00 0
4704e000-47051000 ---p 00000000 00:00 0
47051000-4706f000 rwxp 00000000 00:00 0
4706f000-47072000 ---p 00000000 00:00 0
47072000-47090000 rwxp 00000000 00:00 0
47090000-47093000 ---p 00000000 00:00 0
47093000-470b1000 rwxp 00000000 00:00 0
470b1000-470b4000 ---p 00000000 00:00 0
470b4000-470d2000 rwxp 00000000 00:00 0
470d2000-470d5000 ---p 00000000 00:00 0
470d5000-470f3000 rwxp 00000000 00:00 0
47114000-47117000 ---p 00000000 00:00 0
47117000-47135000 rwxp 00000000 00:00 0
47135000-47138000 ---p 00000000 00:00 0
47138000-47156000 rwxp 00000000 00:00 0
47156000-47159000 ---p 00000000 00:00 0
47159000-47177000 rwxp 00000000 00:00 0
47177000-4717a000 ---p 00000000 00:00 0
4717a000-47198000 rwxp 00000000 00:00 0
47198000-4719b000 ---p 00000000 00:00 0
4719b000-471b9000 rwxp 00000000 00:00 0
471da000-471dd000 ---p 00000000 00:00 0
471dd000-471fb000 rwxp 00000000 00:00 0
471fb000-471fe000 ---p 00000000 00:00 0
471fe000-4721c000 rwxp 00000000 00:00 0
4721c000-4721f000 ---p 00000000 00:00 0
4721f000-4723d000 rwxp 00000000 00:00 0
4723d000-47240000 ---p 00000000 00:00 0
47240000-4725e000 rwxp 00000000 00:00 0
4725e000-47261000 ---p 00000000 00:00 0
47261000-4727f000 rwxp 00000000 00:00 0
4727f000-47282000 ---p 00000000 00:00 0
47282000-472a0000 rwxp 00000000 00:00 0
472a0000-472a3000 ---p 00000000 00:00 0
472a3000-472c1000 rwxp 00000000 00:00 0
472e2000-472e5000 ---p 00000000 00:00 0
472e5000-47303000 rwxp 00000000 00:00 0
47324000-47327000 ---p 00000000 00:00 0
47327000-47345000 rwxp 00000000 00:00 0
47345000-47348000 ---p 00000000 00:00 0
47348000-47366000 rwxp 00000000 00:00 0
473a8000-473ab000 ---p 00000000 00:00 0
473ab000-473c9000 rwxp 00000000 00:00 0
473c9000-473cc000 ---p 00000000 00:00 0
473cc000-473ea000 rwxp 00000000 00:00 0
473ea000-473ed000 ---p 00000000 00:00 0
473ed000-4740b000 rwxp 00000000 00:00 0
4740b000-4740e000 ---p 00000000 00:00 0
4740e000-4742c000 rwxp 00000000 00:00 0
4744d000-47450000 ---p 00000000 00:00 0
47450000-4746e000 rwxp 00000000 00:00 0
4746e000-47471000 ---p 00000000 00:00 0
47471000-4748f000 rwxp 00000000 00:00 0
4748f000-47492000 ---p 00000000 00:00 0
47492000-474b0000 rwxp 00000000 00:00 0
474b0000-474b3000 ---p 00000000 00:00 0
474b3000-474d1000 rwxp 00000000 00:00 0
474d1000-474d4000 ---p 00000000 00:00 0
474d4000-474f2000 rwxp 00000000 00:00 0
474f2000-474f5000 ---p 00000000 00:00 0
474f5000-47513000 rwxp 00000000 00:00 0
47513000-47516000 ---p 00000000 00:00 0
47516000-47534000 rwxp 00000000 00:00 0
47534000-47537000 ---p 00000000 00:00 0
47537000-47555000 rwxp 00000000 00:00 0
47555000-47558000 ---p 00000000 00:00 0
47558000-47576000 rwxp 00000000 00:00 0
47576000-47579000 ---p 00000000 00:00 0
47579000-47597000 rwxp 00000000 00:00 0
47597000-4759a000 ---p 00000000 00:00 0
4759a000-475b8000 rwxp 00000000 00:00 0
475b8000-475bb000 ---p 00000000 00:00 0
475bb000-475d9000 rwxp 00000000 00:00 0
475d9000-475dc000 ---p 00000000 00:00 0
475dc000-475fa000 rwxp 00000000 00:00 0
475fa000-475fd000 ---p 00000000 00:00 0
475fd000-4761b000 rwxp 00000000 00:00 0
4761b000-4761e000 ---p 00000000 00:00 0
4761e000-4763c000 rwxp 00000000 00:00 0
4763c000-4763f000 ---p 00000000 00:00 0
4763f000-4765d000 rwxp 00000000 00:00 0
4765d000-47660000 ---p 00000000 00:00 0
47660000-4767e000 rwxp 00000000 00:00 0
4767e000-47681000 ---p 00000000 00:00 0
47681000-4769f000 rwxp 00000000 00:00 0
4769f000-476a2000 ---p 00000000 00:00 0
476a2000-476c0000 rwxp 00000000 00:00 0
476c0000-476c3000 ---p 00000000 00:00 0
476c3000-476e1000 rwxp 00000000 00:00 0
476e1000-476e4000 ---p 00000000 00:00 0
476e4000-47702000 rwxp 00000000 00:00 0
47702000-47705000 ---p 00000000 00:00 0
47705000-47723000 rwxp 00000000 00:00 0
47723000-47726000 ---p 00000000 00:00 0
47726000-47744000 rwxp 00000000 00:00 0
47744000-47747000 ---p 00000000 00:00 0
47747000-47765000 rwxp 00000000 00:00 0
47765000-47768000 ---p 00000000 00:00 0
47768000-47786000 rwxp 00000000 00:00 0
47786000-47789000 ---p 00000000 00:00 0
47789000-477a7000 rwxp 00000000 00:00 0
477a7000-477aa000 ---p 00000000 00:00 0
477aa000-477c8000 rwxp 00000000 00:00 0
477c8000-477cb000 ---p 00000000 00:00 0
477cb000-477e9000 rwxp 00000000 00:00 0
477e9000-477ec000 ---p 00000000 00:00 0
477ec000-4780a000 rwxp 00000000 00:00 0
4780a000-4780d000 ---p 00000000 00:00 0
4780d000-4782b000 rwxp 00000000 00:00 0
4782b000-4782e000 ---p 00000000 00:00 0
4782e000-4784c000 rwxp 00000000 00:00 0
4784c000-4784f000 ---p 00000000 00:00 0
4784f000-4786d000 rwxp 00000000 00:00 0
4786d000-47870000 ---p 00000000 00:00 0
47870000-4788e000 rwxp 00000000 00:00 0
4788e000-47891000 ---p 00000000 00:00 0
47891000-478af000 rwxp 00000000 00:00 0
478af000-478b2000 ---p 00000000 00:00 0
478b2000-478d0000 rwxp 00000000 00:00 0
478d0000-478d3000 ---p 00000000 00:00 0
478d3000-478f1000 rwxp 00000000 00:00 0
478f1000-478f4000 ---p 00000000 00:00 0
478f4000-47912000 rwxp 00000000 00:00 0
47912000-47915000 ---p 00000000 00:00 0
47915000-47933000 rwxp 00000000 00:00 0
47933000-47936000 ---p 00000000 00:00 0
47936000-47954000 rwxp 00000000 00:00 0
47954000-47957000 ---p 00000000 00:00 0
47957000-47975000 rwxp 00000000 00:00 0
47975000-47978000 ---p 00000000 00:00 0
47978000-47996000 rwxp 00000000 00:00 0
47996000-47999000 ---p 00000000 00:00 0
47999000-479b7000 rwxp 00000000 00:00 0
479b7000-479ba000 ---p 00000000 00:00 0
479ba000-479d8000 rwxp 00000000 00:00 0
479d8000-479db000 ---p 00000000 00:00 0
479db000-479f9000 rwxp 00000000 00:00 0
479f9000-479fc000 ---p 00000000 00:00 0
479fc000-47a1a000 rwxp 00000000 00:00 0
47a1a000-47a1d000 ---p 00000000 00:00 0
47a1d000-47a3b000 rwxp 00000000 00:00 0
47a3b000-47a3e000 ---p 00000000 00:00 0
47a3e000-47a5c000 rwxp 00000000 00:00 0
47a5c000-47a5f000 ---p 00000000 00:00 0
47a5f000-47a7d000 rwxp 00000000 00:00 0
47a7d000-47a80000 ---p 00000000 00:00 0
47a80000-47a9e000 rwxp 00000000 00:00 0
47a9e000-47aa1000 ---p 00000000 00:00 0
47aa1000-47abf000 rwxp 00000000 00:00 0
47abf000-47ac2000 ---p 00000000 00:00 0
47ac2000-47ae0000 rwxp 00000000 00:00 0
47ae0000-47ae3000 ---p 00000000 00:00 0
47ae3000-47b01000 rwxp 00000000 00:00 0
47b01000-47b04000 ---p 00000000 00:00 0
47b04000-47b22000 rwxp 00000000 00:00 0
47b22000-47b25000 ---p 00000000 00:00 0
47b25000-47b43000 rwxp 00000000 00:00 0
47b43000-47b46000 ---p 00000000 00:00 0
47b46000-47b64000 rwxp 00000000 00:00 0
47b64000-47b67000 ---p 00000000 00:00 0
47b67000-47b85000 rwxp 00000000 00:00 0
47b85000-47b88000 ---p 00000000 00:00 0
47b88000-47ba6000 rwxp 00000000 00:00 0
47ba6000-47ba9000 ---p 00000000 00:00 0
47ba9000-47bc7000 rwxp 00000000 00:00 0
47bc7000-47bca000 ---p 00000000 00:00 0
47bca000-47be8000 rwxp 00000000 00:00 0
47be8000-47beb000 ---p 00000000 00:00 0
47beb000-47c09000 rwxp 00000000 00:00 0
47c09000-47c0c000 ---p 00000000 00:00 0
47c0c000-47c2a000 rwxp 00000000 00:00 0
47c2a000-47c2d000 ---p 00000000 00:00 0
47c2d000-47c4b000 rwxp 00000000 00:00 0
47c4b000-47c4e000 ---p 00000000 00:00 0
47c4e000-47c6c000 rwxp 00000000 00:00 0
47c6c000-47c6f000 ---p 00000000 00:00 0
47c6f000-47c8d000 rwxp 00000000 00:00 0
47c8d000-47c90000 ---p 00000000 00:00 0
47c90000-47cae000 rwxp 00000000 00:00 0
47cae000-47cb1000 ---p 00000000 00:00 0
47cb1000-47ccf000 rwxp 00000000 00:00 0
47ccf000-47cd2000 ---p 00000000 00:00 0
47cd2000-47cf0000 rwxp 00000000 00:00 0
47cf0000-47cf3000 ---p 00000000 00:00 0
47cf3000-47d11000 rwxp 00000000 00:00 0
47d11000-47d14000 ---p 00000000 00:00 0
47d14000-47d32000 rwxp 00000000 00:00 0
47d32000-47d35000 ---p 00000000 00:00 0
47d35000-47d53000 rwxp 00000000 00:00 0
47d53000-47d56000 ---p 00000000 00:00 0
47d56000-47d74000 rwxp 00000000 00:00 0
47d74000-47d77000 ---p 00000000 00:00 0
47d77000-47d95000 rwxp 00000000 00:00 0
47d95000-47d98000 ---p 00000000 00:00 0
47d98000-47db6000 rwxp 00000000 00:00 0
47db6000-47db9000 ---p 00000000 00:00 0
47db9000-47dd7000 rwxp 00000000 00:00 0
47dd7000-47dda000 ---p 00000000 00:00 0
47dda000-47df8000 rwxp 00000000 00:00 0
47df8000-47dfb000 ---p 00000000 00:00 0
47dfb000-47e19000 rwxp 00000000 00:00 0
47e19000-47e1c000 ---p 00000000 00:00 0
47e1c000-47e3a000 rwxp 00000000 00:00 0
47e3a000-47e3d000 ---p 00000000 00:00 0
47e3d000-47e5b000 rwxp 00000000 00:00 0
47e5b000-47e5e000 ---p 00000000 00:00 0
47e5e000-47e7c000 rwxp 00000000 00:00 0
47e7c000-47e7f000 ---p 00000000 00:00 0
47e7f000-47e9d000 rwxp 00000000 00:00 0
47e9d000-47ea0000 ---p 00000000 00:00 0
47ea0000-47ebe000 rwxp 00000000 00:00 0
47ebe000-47ec1000 ---p 00000000 00:00 0
47ec1000-47edf000 rwxp 00000000 00:00 0
47edf000-47ee2000 ---p 00000000 00:00 0
47ee2000-47f00000 rwxp 00000000 00:00 0
47f00000-47f03000 ---p 00000000 00:00 0
47f03000-47f21000 rwxp 00000000 00:00 0
47f21000-47f24000 ---p 00000000 00:00 0
47f24000-47f42000 rwxp 00000000 00:00 0
47f42000-47f45000 ---p 00000000 00:00 0
47f45000-47f63000 rwxp 00000000 00:00 0
47f63000-47f66000 ---p 00000000 00:00 0
47f66000-47f84000 rwxp 00000000 00:00 0
47f84000-47f87000 ---p 00000000 00:00 0
47f87000-47fa5000 rwxp 00000000 00:00 0
47fa5000-47fa8000 ---p 00000000 00:00 0
47fa8000-47fc6000 rwxp 00000000 00:00 0
47fc6000-47fc9000 ---p 00000000 00:00 0
47fc9000-47fe7000 rwxp 00000000 00:00 0
47fe7000-47fea000 ---p 00000000 00:00 0
47fea000-48008000 rwxp 00000000 00:00 0
48008000-4800b000 ---p 00000000 00:00 0
4800b000-48029000 rwxp 00000000 00:00 0
48029000-4802c000 ---p 00000000 00:00 0
4802c000-4804a000 rwxp 00000000 00:00 0
4804a000-4804d000 ---p 00000000 00:00 0
4804d000-4806b000 rwxp 00000000 00:00 0
4806b000-4806e000 ---p 00000000 00:00 0
4806e000-4808c000 rwxp 00000000 00:00 0
4808c000-4808f000 ---p 00000000 00:00 0
4808f000-480ad000 rwxp 00000000 00:00 0
480ad000-480b0000 ---p 00000000 00:00 0
480b0000-480ce000 rwxp 00000000 00:00 0
480ce000-480d1000 ---p 00000000 00:00 0
480d1000-480ef000 rwxp 00000000 00:00 0
480ef000-480f2000 ---p 00000000 00:00 0
480f2000-48110000 rwxp 00000000 00:00 0
48110000-48113000 ---p 00000000 00:00 0
48113000-48131000 rwxp 00000000 00:00 0
48131000-48134000 ---p 00000000 00:00 0
48134000-48152000 rwxp 00000000 00:00 0
48152000-48155000 ---p 00000000 00:00 0
48155000-48173000 rwxp 00000000 00:00 0
48173000-48176000 ---p 00000000 00:00 0
48176000-48194000 rwxp 00000000 00:00 0
48194000-48197000 ---p 00000000 00:00 0
48197000-481b5000 rwxp 00000000 00:00 0
481b5000-481b8000 ---p 00000000 00:00 0
481b8000-481d6000 rwxp 00000000 00:00 0
481d6000-481d9000 ---p 00000000 00:00 0
481d9000-481f7000 rwxp 00000000 00:00 0
481f7000-481fa000 ---p 00000000 00:00 0
481fa000-48218000 rwxp 00000000 00:00 0
48218000-4821b000 ---p 00000000 00:00 0
4821b000-48239000 rwxp 00000000 00:00 0
48239000-4823c000 ---p 00000000 00:00 0
4823c000-4825a000 rwxp 00000000 00:00 0
4825a000-4825d000 ---p 00000000 00:00 0
4825d000-4827b000 rwxp 00000000 00:00 0
4829c000-4829f000 ---p 00000000 00:00 0
4829f000-482bd000 rwxp 00000000 00:00 0
482de000-482e1000 ---p 00000000 00:00 0
482e1000-482ff000 rwxp 00000000 00:00 0
482ff000-48302000 ---p 00000000 00:00 0
48302000-48320000 rwxp 00000000 00:00 0
48320000-48323000 ---p 00000000 00:00 0
48323000-48341000 rwxp 00000000 00:00 0
48341000-48344000 ---p 00000000 00:00 0
48344000-48362000 rwxp 00000000 00:00 0
48362000-48365000 ---p 00000000 00:00 0
48365000-48383000 rwxp 00000000 00:00 0
483a4000-483a7000 ---p 00000000 00:00 0
483a7000-483c5000 rwxp 00000000 00:00 0
48407000-4840a000 ---p 00000000 00:00 0
4840a000-48428000 rwxp 00000000 00:00 0
48428000-4842b000 ---p 00000000 00:00 0
4842b000-48449000 rwxp 00000000 00:00 0
48449000-4844c000 ---p 00000000 00:00 0
4844c000-4846a000 rwxp 00000000 00:00 0
4848b000-4848e000 ---p 00000000 00:00 0
4848e000-484ac000 rwxp 00000000 00:00 0
484ac000-484af000 ---p 00000000 00:00 0
484af000-484cd000 rwxp 00000000 00:00 0
484ee000-484f1000 ---p 00000000 00:00 0
484f1000-4850f000 rwxp 00000000 00:00 0
4850f000-48512000 ---p 00000000 00:00 0
48512000-48530000 rwxp 00000000 00:00 0
48530000-48533000 ---p 00000000 00:00 0
48533000-48551000 rwxp 00000000 00:00 0
48551000-48554000 ---p 00000000 00:00 0
48554000-48572000 rwxp 00000000 00:00 0
48593000-48596000 ---p 00000000 00:00 0
48596000-485b4000 rwxp 00000000 00:00 0
485b4000-485b7000 ---p 00000000 00:00 0
485b7000-485d5000 rwxp 00000000 00:00 0
485d5000-485d8000 ---p 00000000 00:00 0
485d8000-485f6000 rwxp 00000000 00:00 0
48638000-4863b000 ---p 00000000 00:00 0
4863b000-48659000 rwxp 00000000 00:00 0
48659000-4865c000 ---p 00000000 00:00 0
4865c000-4867a000 rwxp 00000000 00:00 0
4867a000-4867d000 ---p 00000000 00:00 0
4867d000-4869b000 rwxp 00000000 00:00 0
4869b000-4869e000 ---p 00000000 00:00 0
4869e000-486bc000 rwxp 00000000 00:00 0
486bc000-486bf000 ---p 00000000 00:00 0
486bf000-486dd000 rwxp 00000000 00:00 0
486dd000-486e0000 ---p 00000000 00:00 0
486e0000-486fe000 rwxp 00000000 00:00 0
486fe000-48701000 ---p 00000000 00:00 0
48701000-4871f000 rwxp 00000000 00:00 0
4871f000-48722000 ---p 00000000 00:00 0
48722000-48740000 rwxp 00000000 00:00 0
48740000-48743000 ---p 00000000 00:00 0
48743000-48761000 rwxp 00000000 00:00 0
48761000-48764000 ---p 00000000 00:00 0
48764000-48782000 rwxp 00000000 00:00 0
48782000-48785000 ---p 00000000 00:00 0
48785000-487a3000 rwxp 00000000 00:00 0
487a3000-487a6000 ---p 00000000 00:00 0
487a6000-487c4000 rwxp 00000000 00:00 0
487c4000-487c7000 ---p 00000000 00:00 0
487c7000-487e5000 rwxp 00000000 00:00 0
487e5000-487e8000 ---p 00000000 00:00 0
487e8000-48806000 rwxp 00000000 00:00 0
48806000-48809000 ---p 00000000 00:00 0
48809000-48827000 rwxp 00000000 00:00 0
48827000-4882a000 ---p 00000000 00:00 0
4882a000-48848000 rwxp 00000000 00:00 0
48848000-4884b000 ---p 00000000 00:00 0
4884b000-48869000 rwxp 00000000 00:00 0
48869000-4886c000 ---p 00000000 00:00 0
4886c000-4888a000 rwxp 00000000 00:00 0
4888a000-4888d000 ---p 00000000 00:00 0
4888d000-488ab000 rwxp 00000000 00:00 0
488ab000-488ae000 ---p 00000000 00:00 0
488ae000-488cc000 rwxp 00000000 00:00 0
488cc000-488cf000 ---p 00000000 00:00 0
488cf000-488ed000 rwxp 00000000 00:00 0
488ed000-488f0000 ---p 00000000 00:00 0
488f0000-4890e000 rwxp 00000000 00:00 0
4890e000-48911000 ---p 00000000 00:00 0
48911000-4892f000 rwxp 00000000 00:00 0
4892f000-48932000 ---p 00000000 00:00 0
48932000-48950000 rwxp 00000000 00:00 0
48950000-48953000 ---p 00000000 00:00 0
48953000-48971000 rwxp 00000000 00:00 0
48971000-48974000 ---p 00000000 00:00 0
48974000-48992000 rwxp 00000000 00:00 0
48992000-48995000 ---p 00000000 00:00 0
48995000-489b3000 rwxp 00000000 00:00 0
489b3000-489b6000 ---p 00000000 00:00 0
489b6000-489d4000 rwxp 00000000 00:00 0
489d4000-489d7000 ---p 00000000 00:00 0
489d7000-489f5000 rwxp 00000000 00:00 0
489f5000-489f8000 ---p 00000000 00:00 0
489f8000-48a16000 rwxp 00000000 00:00 0
48a16000-48a19000 ---p 00000000 00:00 0
48a19000-48a37000 rwxp 00000000 00:00 0
48a37000-48a3a000 ---p 00000000 00:00 0
48a3a000-48a58000 rwxp 00000000 00:00 0
48a58000-48a5b000 ---p 00000000 00:00 0
48a5b000-48a79000 rwxp 00000000 00:00 0
48a79000-48a7c000 ---p 00000000 00:00 0
48a7c000-48a9a000 rwxp 00000000 00:00 0
48abb000-48abe000 ---p 00000000 00:00 0
48abe000-48adc000 rwxp 00000000 00:00 0
48afd000-48b00000 ---p 00000000 00:00 0
48b00000-48b1e000 rwxp 00000000 00:00 0
48b1e000-48b21000 ---p 00000000 00:00 0
48b21000-48b3f000 rwxp 00000000 00:00 0
48b3f000-48b42000 ---p 00000000 00:00 0
48b42000-48b60000 rwxp 00000000 00:00 0
48b60000-48b63000 ---p 00000000 00:00 0
48b63000-48b81000 rwxp 00000000 00:00 0
48ba2000-48ba5000 ---p 00000000 00:00 0
48ba5000-48bc3000 rwxp 00000000 00:00 0
48bc3000-48bc6000 ---p 00000000 00:00 0
48bc6000-48be4000 rwxp 00000000 00:00 0
48be4000-48be7000 ---p 00000000 00:00 0
48be7000-48c05000 rwxp 00000000 00:00 0
48c05000-48c08000 ---p 00000000 00:00 0
48c08000-48c26000 rwxp 00000000 00:00 0
48c26000-48c29000 ---p 00000000 00:00 0
48c29000-48c47000 rwxp 00000000 00:00 0
48c68000-48c6b000 ---p 00000000 00:00 0
48c6b000-48c89000 rwxp 00000000 00:00 0
48c89000-48c8c000 ---p 00000000 00:00 0
48c8c000-48caa000 rwxp 00000000 00:00 0
48caa000-48cad000 ---p 00000000 00:00 0
48cad000-48ccb000 rwxp 00000000 00:00 0
48ccb000-48cce000 ---p 00000000 00:00 0
48cce000-48cec000 rwxp 00000000 00:00 0
48cec000-48cef000 ---p 00000000 00:00 0
48cef000-48d0d000 rwxp 00000000 00:00 0
48d0d000-48d10000 ---p 00000000 00:00 0
48d10000-48d2e000 rwxp 00000000 00:00 0
48d2e000-48d31000 ---p 00000000 00:00 0
48d31000-48d4f000 rwxp 00000000 00:00 0
48d4f000-48d52000 ---p 00000000 00:00 0
48d52000-48d70000 rwxp 00000000 00:00 0
48d70000-48d73000 ---p 00000000 00:00 0
48d73000-48d91000 rwxp 00000000 00:00 0
48d91000-48d94000 ---p 00000000 00:00 0
48d94000-48db2000 rwxp 00000000 00:00 0
48db2000-48db5000 ---p 00000000 00:00 0
48db5000-48dd3000 rwxp 00000000 00:00 0
48e15000-48e18000 ---p 00000000 00:00 0
48e18000-48e36000 rwxp 00000000 00:00 0
48e36000-48e39000 ---p 00000000 00:00 0
48e39000-48e57000 rwxp 00000000 00:00 0
48e57000-48e5a000 ---p 00000000 00:00 0
48e5a000-48e78000 rwxp 00000000 00:00 0
48e78000-48e7b000 ---p 00000000 00:00 0
48e7b000-48e99000 rwxp 00000000 00:00 0
48e99000-48e9c000 ---p 00000000 00:00 0
48e9c000-48eba000 rwxp 00000000 00:00 0
48eba000-48ebd000 ---p 00000000 00:00 0
48ebd000-48edb000 rwxp 00000000 00:00 0
48edb000-48ede000 ---p 00000000 00:00 0
48ede000-48efc000 rwxp 00000000 00:00 0
48efc000-48eff000 ---p 00000000 00:00 0
48eff000-48f1d000 rwxp 00000000 00:00 0
48f1d000-48f20000 ---p 00000000 00:00 0
48f20000-48f3e000 rwxp 00000000 00:00 0
48f3e000-48f41000 ---p 00000000 00:00 0
48f41000-48f5f000 rwxp 00000000 00:00 0
48f5f000-48f62000 ---p 00000000 00:00 0
48f62000-48f80000 rwxp 00000000 00:00 0
48f80000-48f83000 ---p 00000000 00:00 0
48f83000-48fa1000 rwxp 00000000 00:00 0
48fa1000-48fa4000 ---p 00000000 00:00 0
48fa4000-48fc2000 rwxp 00000000 00:00 0
48fc2000-48fc5000 ---p 00000000 00:00 0
48fc5000-48fe3000 rwxp 00000000 00:00 0
48fe3000-48fe6000 ---p 00000000 00:00 0
48fe6000-49004000 rwxp 00000000 00:00 0
49004000-49007000 ---p 00000000 00:00 0
49007000-49025000 rwxp 00000000 00:00 0
49025000-49028000 ---p 00000000 00:00 0
49028000-49046000 rwxp 00000000 00:00 0
49046000-49049000 ---p 00000000 00:00 0
49049000-49067000 rwxp 00000000 00:00 0
49088000-4908b000 ---p 00000000 00:00 0
4908b000-490a9000 rwxp 00000000 00:00 0
490a9000-490ac000 ---p 00000000 00:00 0
490ac000-490ca000 rwxp 00000000 00:00 0
490eb000-490ee000 ---p 00000000 00:00 0
490ee000-4910c000 rwxp 00000000 00:00 0
4910c000-4910f000 ---p 00000000 00:00 0
4910f000-4912d000 rwxp 00000000 00:00 0
4912d000-49130000 ---p 00000000 00:00 0
49130000-4914e000 rwxp 00000000 00:00 0
4914e000-49151000 ---p 00000000 00:00 0
49151000-4916f000 rwxp 00000000 00:00 0
4916f000-49172000 ---p 00000000 00:00 0
49172000-49190000 rwxp 00000000 00:00 0
49190000-49193000 ---p 00000000 00:00 0
49193000-491b1000 rwxp 00000000 00:00 0
491b1000-491b4000 ---p 00000000 00:00 0
491b4000-491d2000 rwxp 00000000 00:00 0
491d2000-491d5000 ---p 00000000 00:00 0
491d5000-491f3000 rwxp 00000000 00:00 0
491f3000-491f6000 ---p 00000000 00:00 0
491f6000-49214000 rwxp 00000000 00:00 0
49214000-49217000 ---p 00000000 00:00 0
49217000-49235000 rwxp 00000000 00:00 0
49235000-49238000 ---p 00000000 00:00 0
49238000-49256000 rwxp 00000000 00:00 0
49256000-49259000 ---p 00000000 00:00 0
49259000-49277000 rwxp 00000000 00:00 0
49277000-4927a000 ---p 00000000 00:00 0
4927a000-49298000 rwxp 00000000 00:00 0
49298000-4929b000 ---p 00000000 00:00 0
4929b000-492b9000 rwxp 00000000 00:00 0
492b9000-492bc000 ---p 00000000 00:00 0
492bc000-492da000 rwxp 00000000 00:00 0
492da000-492dd000 ---p 00000000 00:00 0
492dd000-492fb000 rwxp 00000000 00:00 0
492fb000-492fe000 ---p 00000000 00:00 0
492fe000-4931c000 rwxp 00000000 00:00 0
4931c000-4931f000 ---p 00000000 00:00 0
4931f000-4933d000 rwxp 00000000 00:00 0
4933d000-49340000 ---p 00000000 00:00 0
49340000-4935e000 rwxp 00000000 00:00 0
4935e000-49361000 ---p 00000000 00:00 0
49361000-4937f000 rwxp 00000000 00:00 0
4937f000-49382000 ---p 00000000 00:00 0
49382000-493a0000 rwxp 00000000 00:00 0
493a0000-493a3000 ---p 00000000 00:00 0
493a3000-493c1000 rwxp 00000000 00:00 0
493c1000-493c4000 ---p 00000000 00:00 0
493c4000-493e2000 rwxp 00000000 00:00 0
493e2000-493e5000 ---p 00000000 00:00 0
493e5000-49403000 rwxp 00000000 00:00 0
49403000-49406000 ---p 00000000 00:00 0
49406000-49424000 rwxp 00000000 00:00 0
49424000-49427000 ---p 00000000 00:00 0
49427000-49445000 rwxp 00000000 00:00 0
49445000-49448000 ---p 00000000 00:00 0
49448000-49466000 rwxp 00000000 00:00 0
49466000-49469000 ---p 00000000 00:00 0
49469000-49487000 rwxp 00000000 00:00 0
49487000-4948a000 ---p 00000000 00:00 0
4948a000-494a8000 rwxp 00000000 00:00 0
494a8000-494ab000 ---p 00000000 00:00 0
494ab000-494c9000 rwxp 00000000 00:00 0
494c9000-494cc000 ---p 00000000 00:00 0
494cc000-494ea000 rwxp 00000000 00:00 0
494ea000-494ed000 ---p 00000000 00:00 0
494ed000-4950b000 rwxp 00000000 00:00 0
4950b000-4950e000 ---p 00000000 00:00 0
4950e000-4952c000 rwxp 00000000 00:00 0
4952c000-4952f000 ---p 00000000 00:00 0
4952f000-4954d000 rwxp 00000000 00:00 0
4954d000-49550000 ---p 00000000 00:00 0
49550000-4956e000 rwxp 00000000 00:00 0
4956e000-49571000 ---p 00000000 00:00 0
49571000-4958f000 rwxp 00000000 00:00 0
4958f000-49592000 ---p 00000000 00:00 0
49592000-495b0000 rwxp 00000000 00:00 0
495b0000-495b3000 ---p 00000000 00:00 0
495b3000-495d1000 rwxp 00000000 00:00 0
495d1000-495d4000 ---p 00000000 00:00 0
495d4000-495f2000 rwxp 00000000 00:00 0
495f2000-495f5000 ---p 00000000 00:00 0
495f5000-49613000 rwxp 00000000 00:00 0
49613000-49616000 ---p 00000000 00:00 0
49616000-49634000 rwxp 00000000 00:00 0
49634000-49637000 ---p 00000000 00:00 0
49637000-49655000 rwxp 00000000 00:00 0
49655000-49658000 ---p 00000000 00:00 0
49658000-49676000 rwxp 00000000 00:00 0
49676000-49679000 ---p 00000000 00:00 0
49679000-49697000 rwxp 00000000 00:00 0
49697000-4969a000 ---p 00000000 00:00 0
4969a000-496b8000 rwxp 00000000 00:00 0
496b8000-496bb000 ---p 00000000 00:00 0
496bb000-496d9000 rwxp 00000000 00:00 0
496d9000-496dc000 ---p 00000000 00:00 0
496dc000-496fa000 rwxp 00000000 00:00 0
496fa000-496fd000 ---p 00000000 00:00 0
496fd000-4971b000 rwxp 00000000 00:00 0
4971b000-4971e000 ---p 00000000 00:00 0
4971e000-4973c000 rwxp 00000000 00:00 0
4973c000-4973f000 ---p 00000000 00:00 0
4973f000-4975d000 rwxp 00000000 00:00 0
4975d000-49760000 ---p 00000000 00:00 0
49760000-4977e000 rwxp 00000000 00:00 0
4979f000-497a2000 ---p 00000000 00:00 0
497a2000-497c0000 rwxp 00000000 00:00 0
497c0000-497c3000 ---p 00000000 00:00 0
497c3000-497e1000 rwxp 00000000 00:00 0
497e1000-497e4000 ---p 00000000 00:00 0
497e4000-49802000 rwxp 00000000 00:00 0
49802000-49805000 ---p 00000000 00:00 0
49805000-49823000 rwxp 00000000 00:00 0
49823000-49826000 ---p 00000000 00:00 0
49826000-49844000 rwxp 00000000 00:00 0
49844000-49847000 ---p 00000000 00:00 0
49847000-49865000 rwxp 00000000 00:00 0
49865000-49868000 ---p 00000000 00:00 0
49868000-49886000 rwxp 00000000 00:00 0
49886000-49889000 ---p 00000000 00:00 0
49889000-498a7000 rwxp 00000000 00:00 0
498a7000-498aa000 ---p 00000000 00:00 0
498aa000-498c8000 rwxp 00000000 00:00 0
498c8000-498cb000 ---p 00000000 00:00 0
498cb000-498e9000 rwxp 00000000 00:00 0
498e9000-498ec000 ---p 00000000 00:00 0
498ec000-4990a000 rwxp 00000000 00:00 0
4990a000-4990d000 ---p 00000000 00:00 0
4990d000-4992b000 rwxp 00000000 00:00 0
4992b000-4992e000 ---p 00000000 00:00 0
4992e000-4994c000 rwxp 00000000 00:00 0
4994c000-4994f000 ---p 00000000 00:00 0
4994f000-4996d000 rwxp 00000000 00:00 0
4996d000-49970000 ---p 00000000 00:00 0
49970000-4998e000 rwxp 00000000 00:00 0
4998e000-49991000 ---p 00000000 00:00 0
49991000-499af000 rwxp 00000000 00:00 0
499af000-499b2000 ---p 00000000 00:00 0
499b2000-499d0000 rwxp 00000000 00:00 0
499d0000-499d3000 ---p 00000000 00:00 0
499d3000-499f1000 rwxp 00000000 00:00 0
499f1000-499f4000 ---p 00000000 00:00 0
499f4000-49a12000 rwxp 00000000 00:00 0
49a12000-49a15000 ---p 00000000 00:00 0
49a15000-49a33000 rwxp 00000000 00:00 0
49a33000-49a36000 ---p 00000000 00:00 0
49a36000-49a54000 rwxp 00000000 00:00 0
49a54000-49a57000 ---p 00000000 00:00 0
49a57000-49a75000 rwxp 00000000 00:00 0
49a75000-49a78000 ---p 00000000 00:00 0
49a78000-49a96000 rwxp 00000000 00:00 0
49a96000-49a99000 ---p 00000000 00:00 0
49a99000-49ab7000 rwxp 00000000 00:00 0
49ab7000-49aba000 ---p 00000000 00:00 0
49aba000-49ad8000 rwxp 00000000 00:00 0
49ad8000-49adb000 ---p 00000000 00:00 0
49adb000-49af9000 rwxp 00000000 00:00 0
49af9000-49afc000 ---p 00000000 00:00 0
49afc000-49b1a000 rwxp 00000000 00:00 0
49b1a000-49b1d000 ---p 00000000 00:00 0
49b1d000-49b3b000 rwxp 00000000 00:00 0
49b3b000-49b3e000 ---p 00000000 00:00 0
49b3e000-49b5c000 rwxp 00000000 00:00 0
49b5c000-49b5f000 ---p 00000000 00:00 0
49b5f000-49b7d000 rwxp 00000000 00:00 0
49b7d000-49b80000 ---p 00000000 00:00 0
49b80000-49b9e000 rwxp 00000000 00:00 0
49b9e000-49ba1000 ---p 00000000 00:00 0
49ba1000-49bbf000 rwxp 00000000 00:00 0
49bbf000-49bc2000 ---p 00000000 00:00 0
49bc2000-49be0000 rwxp 00000000 00:00 0
49be0000-49be3000 ---p 00000000 00:00 0
49be3000-49c01000 rwxp 00000000 00:00 0
49c01000-49c04000 ---p 00000000 00:00 0
49c04000-49c22000 rwxp 00000000 00:00 0
49c43000-49c46000 ---p 00000000 00:00 0
49c46000-49c64000 rwxp 00000000 00:00 0
49c64000-49c67000 ---p 00000000 00:00 0
49c67000-49c85000 rwxp 00000000 00:00 0
49c85000-49c88000 ---p 00000000 00:00 0
49c88000-49ca6000 rwxp 00000000 00:00 0
49ca6000-49ca9000 ---p 00000000 00:00 0
49ca9000-49cc7000 rwxp 00000000 00:00 0
49cc7000-49cca000 ---p 00000000 00:00 0
49cca000-49ce8000 rwxp 00000000 00:00 0
49ce8000-49ceb000 ---p 00000000 00:00 0
49ceb000-49d09000 rwxp 00000000 00:00 0
49d09000-49d0c000 ---p 00000000 00:00 0
49d0c000-49d2a000 rwxp 00000000 00:00 0
49d2a000-49d2d000 ---p 00000000 00:00 0
49d2d000-49d4b000 rwxp 00000000 00:00 0
49d4b000-49d4e000 ---p 00000000 00:00 0
49d4e000-49d6c000 rwxp 00000000 00:00 0
49d6c000-49d6f000 ---p 00000000 00:00 0
49d6f000-49d8d000 rwxp 00000000 00:00 0
49d8d000-49d90000 ---p 00000000 00:00 0
49d90000-49dae000 rwxp 00000000 00:00 0
49dae000-49db1000 ---p 00000000 00:00 0
49db1000-49dcf000 rwxp 00000000 00:00 0
49dcf000-49dd2000 ---p 00000000 00:00 0
49dd2000-49df0000 rwxp 00000000 00:00 0
49df0000-49df3000 ---p 00000000 00:00 0
49df3000-49e11000 rwxp 00000000 00:00 0
49e11000-49e14000 ---p 00000000 00:00 0
49e14000-49e32000 rwxp 00000000 00:00 0
49e32000-49e35000 ---p 00000000 00:00 0
49e35000-49e53000 rwxp 00000000 00:00 0
49e53000-49e56000 ---p 00000000 00:00 0
49e56000-49e74000 rwxp 00000000 00:00 0
49e74000-49e77000 ---p 00000000 00:00 0
49e77000-49e95000 rwxp 00000000 00:00 0
49e95000-49e98000 ---p 00000000 00:00 0
49e98000-49eb6000 rwxp 00000000 00:00 0
49eb6000-49eb9000 ---p 00000000 00:00 0
49eb9000-49ed7000 rwxp 00000000 00:00 0
49ed7000-49eda000 ---p 00000000 00:00 0
49eda000-49ef8000 rwxp 00000000 00:00 0
49ef8000-49efb000 ---p 00000000 00:00 0
49efb000-49f19000 rwxp 00000000 00:00 0
49f19000-49f1c000 ---p 00000000 00:00 0
49f1c000-49f3a000 rwxp 00000000 00:00 0
49f3a000-49f3d000 ---p 00000000 00:00 0
49f3d000-49f5b000 rwxp 00000000 00:00 0
49f5b000-49f5e000 ---p 00000000 00:00 0
49f5e000-49f7c000 rwxp 00000000 00:00 0
49f7c000-49f7f000 ---p 00000000 00:00 0
49f7f000-49f9d000 rwxp 00000000 00:00 0
49f9d000-49fa0000 ---p 00000000 00:00 0
49fa0000-49fbe000 rwxp 00000000 00:00 0
49fbe000-49fc1000 ---p 00000000 00:00 0
49fc1000-49fdf000 rwxp 00000000 00:00 0
49fdf000-49fe2000 ---p 00000000 00:00 0
49fe2000-4a000000 rwxp 00000000 00:00 0
4a000000-4a003000 ---p 00000000 00:00 0
4a003000-4a021000 rwxp 00000000 00:00 0
4a021000-4a024000 ---p 00000000 00:00 0
4a024000-4a042000 rwxp 00000000 00:00 0
4a042000-4a045000 ---p 00000000 00:00 0
4a045000-4a063000 rwxp 00000000 00:00 0
4a063000-4a066000 ---p 00000000 00:00 0
4a066000-4a084000 rwxp 00000000 00:00 0
4a084000-4a087000 ---p 00000000 00:00 0
4a087000-4a0a5000 rwxp 00000000 00:00 0
4a0a5000-4a0a8000 ---p 00000000 00:00 0
4a0a8000-4a0c6000 rwxp 00000000 00:00 0
4a0c6000-4a0c9000 ---p 00000000 00:00 0
4a0c9000-4a0e7000 rwxp 00000000 00:00 0
4a0e7000-4a0ea000 ---p 00000000 00:00 0
4a0ea000-4a108000 rwxp 00000000 00:00 0
4a108000-4a10b000 ---p 00000000 00:00 0
4a10b000-4a129000 rwxp 00000000 00:00 0
4a129000-4a12c000 ---p 00000000 00:00 0
4a12c000-4a14a000 rwxp 00000000 00:00 0
4a14a000-4a14d000 ---p 00000000 00:00 0
4a14d000-4a16b000 rwxp 00000000 00:00 0
4a16b000-4a16e000 ---p 00000000 00:00 0
4a16e000-4a18c000 rwxp 00000000 00:00 0
4a18c000-4a18f000 ---p 00000000 00:00 0
4a18f000-4a1ad000 rwxp 00000000 00:00 0
4a1ad000-4a1b0000 ---p 00000000 00:00 0
4a1b0000-4a1ce000 rwxp 00000000 00:00 0
4a1ce000-4a1d1000 ---p 00000000 00:00 0
4a1d1000-4a1ef000 rwxp 00000000 00:00 0
4a1ef000-4a1f2000 ---p 00000000 00:00 0
4a1f2000-4a210000 rwxp 00000000 00:00 0
4a210000-4a213000 ---p 00000000 00:00 0
4a213000-4a231000 rwxp 00000000 00:00 0
4a231000-4a234000 ---p 00000000 00:00 0
4a234000-4a252000 rwxp 00000000 00:00 0
4a252000-4a255000 ---p 00000000 00:00 0
4a255000-4a273000 rwxp 00000000 00:00 0
4a273000-4a276000 ---p 00000000 00:00 0
4a276000-4a294000 rwxp 00000000 00:00 0
4a294000-4a297000 ---p 00000000 00:00 0
4a297000-4a2b5000 rwxp 00000000 00:00 0
4a2b5000-4a2b8000 ---p 00000000 00:00 0
4a2b8000-4a2d6000 rwxp 00000000 00:00 0
4a2d6000-4a2d9000 ---p 00000000 00:00 0
4a2d9000-4a2f7000 rwxp 00000000 00:00 0
4a2f7000-4a2fa000 ---p 00000000 00:00 0
4a2fa000-4a318000 rwxp 00000000 00:00 0
4a318000-4a31b000 ---p 00000000 00:00 0
4a31b000-4a339000 rwxp 00000000 00:00 0
4a339000-4a33c000 ---p 00000000 00:00 0
4a33c000-4a35a000 rwxp 00000000 00:00 0
4a35a000-4a35d000 ---p 00000000 00:00 0
4a35d000-4a37b000 rwxp 00000000 00:00 0
4a37b000-4a37e000 ---p 00000000 00:00 0
4a37e000-4a39c000 rwxp 00000000 00:00 0
4a39c000-4a39f000 ---p 00000000 00:00 0
4a39f000-4a3bd000 rwxp 00000000 00:00 0
4a3bd000-4a3c0000 ---p 00000000 00:00 0
4a3c0000-4a3de000 rwxp 00000000 00:00 0
4a3de000-4a3e1000 ---p 00000000 00:00 0
4a3e1000-4a3ff000 rwxp 00000000 00:00 0
4a3ff000-4a402000 ---p 00000000 00:00 0
4a402000-4a420000 rwxp 00000000 00:00 0
4a420000-4a423000 ---p 00000000 00:00 0
4a423000-4a441000 rwxp 00000000 00:00 0
4a441000-4a444000 ---p 00000000 00:00 0
4a444000-4a462000 rwxp 00000000 00:00 0
4a462000-4a465000 ---p 00000000 00:00 0
4a465000-4a483000 rwxp 00000000 00:00 0
4a483000-4a486000 ---p 00000000 00:00 0
4a486000-4a4a4000 rwxp 00000000 00:00 0
4a4a4000-4a4a7000 ---p 00000000 00:00 0
4a4a7000-4a4c5000 rwxp 00000000 00:00 0
4a4c5000-4a4c8000 ---p 00000000 00:00 0
4a4c8000-4a4e6000 rwxp 00000000 00:00 0
4a4e6000-4a4e9000 ---p 00000000 00:00 0
4a4e9000-4a507000 rwxp 00000000 00:00 0
4a507000-4a50a000 ---p 00000000 00:00 0
4a50a000-4a528000 rwxp 00000000 00:00 0
4a528000-4a52b000 ---p 00000000 00:00 0
4a52b000-4a549000 rwxp 00000000 00:00 0
4a549000-4a54c000 ---p 00000000 00:00 0
4a54c000-4a56a000 rwxp 00000000 00:00 0
4a56a000-4a56d000 ---p 00000000 00:00 0
4a56d000-4a58b000 rwxp 00000000 00:00 0
4a58b000-4a58e000 ---p 00000000 00:00 0
4a58e000-4a5ac000 rwxp 00000000 00:00 0
4a5ac000-4a5af000 ---p 00000000 00:00 0
4a5af000-4a5cd000 rwxp 00000000 00:00 0
4a5cd000-4a5d0000 ---p 00000000 00:00 0
4a5d0000-4a5ee000 rwxp 00000000 00:00 0
4a5ee000-4a5f1000 ---p 00000000 00:00 0
4a5f1000-4a60f000 rwxp 00000000 00:00 0
4a60f000-4a612000 ---p 00000000 00:00 0
4a612000-4a630000 rwxp 00000000 00:00 0
4a630000-4a633000 ---p 00000000 00:00 0
4a633000-4a651000 rwxp 00000000 00:00 0
4a651000-4a654000 ---p 00000000 00:00 0
4a654000-4a672000 rwxp 00000000 00:00 0
4a672000-4a675000 ---p 00000000 00:00 0
4a675000-4a693000 rwxp 00000000 00:00 0
4a693000-4a696000 ---p 00000000 00:00 0
4a696000-4a6b4000 rwxp 00000000 00:00 0
4a6b4000-4a6b7000 ---p 00000000 00:00 0
4a6b7000-4a6d5000 rwxp 00000000 00:00 0
4a6d5000-4a6d8000 ---p 00000000 00:00 0
4a6d8000-4a6f6000 rwxp 00000000 00:00 0
4a6f6000-4a6f9000 ---p 00000000 00:00 0
4a6f9000-4a717000 rwxp 00000000 00:00 0
4a717000-4a71a000 ---p 00000000 00:00 0
4a71a000-4a738000 rwxp 00000000 00:00 0
4a738000-4a73b000 ---p 00000000 00:00 0
4a73b000-4a759000 rwxp 00000000 00:00 0
4a759000-4a75c000 ---p 00000000 00:00 0
4a75c000-4a77a000 rwxp 00000000 00:00 0
4a77a000-4a77d000 ---p 00000000 00:00 0
4a77d000-4a79b000 rwxp 00000000 00:00 0
4a79b000-4a79e000 ---p 00000000 00:00 0
4a79e000-4a7bc000 rwxp 00000000 00:00 0
4a7bc000-4a7bf000 ---p 00000000 00:00 0
4a7bf000-4a7dd000 rwxp 00000000 00:00 0
4a7dd000-4a7e0000 ---p 00000000 00:00 0
4a7e0000-4a7fe000 rwxp 00000000 00:00 0
4a7fe000-4a801000 ---p 00000000 00:00 0
4a801000-4a81f000 rwxp 00000000 00:00 0
4a81f000-4a822000 ---p 00000000 00:00 0
4a822000-4a840000 rwxp 00000000 00:00 0
4a840000-4a843000 ---p 00000000 00:00 0
4a843000-4a861000 rwxp 00000000 00:00 0
4a861000-4a864000 ---p 00000000 00:00 0
4a864000-4a882000 rwxp 00000000 00:00 0
4a882000-4a885000 ---p 00000000 00:00 0
4a885000-4a8a3000 rwxp 00000000 00:00 0
4a8a3000-4a8a6000 ---p 00000000 00:00 0
4a8a6000-4a8c4000 rwxp 00000000 00:00 0
4a8c4000-4a8c7000 ---p 00000000 00:00 0
4a8c7000-4a8e5000 rwxp 00000000 00:00 0
4a8e5000-4a8e8000 ---p 00000000 00:00 0
4a8e8000-4a906000 rwxp 00000000 00:00 0
4a906000-4a909000 ---p 00000000 00:00 0
4a909000-4a927000 rwxp 00000000 00:00 0
4a927000-4a92a000 ---p 00000000 00:00 0
4a92a000-4a948000 rwxp 00000000 00:00 0
4a948000-4a94b000 ---p 00000000 00:00 0
4a94b000-4a969000 rwxp 00000000 00:00 0
4a969000-4a96c000 ---p 00000000 00:00 0
4a96c000-4a98a000 rwxp 00000000 00:00 0
4a98a000-4a98d000 ---p 00000000 00:00 0
4a98d000-4a9ab000 rwxp 00000000 00:00 0
4a9ab000-4a9ae000 ---p 00000000 00:00 0
4a9ae000-4a9cc000 rwxp 00000000 00:00 0
4a9cc000-4a9cf000 ---p 00000000 00:00 0
4a9cf000-4a9ed000 rwxp 00000000 00:00 0
4a9ed000-4a9f0000 ---p 00000000 00:00 0
4a9f0000-4aa0e000 rwxp 00000000 00:00 0
4aa0e000-4aa11000 ---p 00000000 00:00 0
4aa11000-4aa2f000 rwxp 00000000 00:00 0
4aa2f000-4aa32000 ---p 00000000 00:00 0
4aa32000-4aa50000 rwxp 00000000 00:00 0
4aa50000-4aa53000 ---p 00000000 00:00 0
4aa53000-4aa71000 rwxp 00000000 00:00 0
4aa71000-4aa74000 ---p 00000000 00:00 0
4aa74000-4aa92000 rwxp 00000000 00:00 0
4aa92000-4aa95000 ---p 00000000 00:00 0
4aa95000-4aab3000 rwxp 00000000 00:00 0
4aab3000-4aab6000 ---p 00000000 00:00 0
4aab6000-4aad4000 rwxp 00000000 00:00 0
4aad4000-4aad7000 ---p 00000000 00:00 0
4aad7000-4aaf5000 rwxp 00000000 00:00 0
4aaf5000-4aaf8000 ---p 00000000 00:00 0
4aaf8000-4ab16000 rwxp 00000000 00:00 0
4ab16000-4ab19000 ---p 00000000 00:00 0
4ab19000-4ab37000 rwxp 00000000 00:00 0
4ab37000-4ab3a000 ---p 00000000 00:00 0
4ab3a000-4ab58000 rwxp 00000000 00:00 0
4ab58000-4ab5b000 ---p 00000000 00:00 0
4ab5b000-4ab79000 rwxp 00000000 00:00 0
4ab79000-4ab7c000 ---p 00000000 00:00 0
4ab7c000-4ab9a000 rwxp 00000000 00:00 0
4ab9a000-4ab9d000 ---p 00000000 00:00 0
4ab9d000-4abbb000 rwxp 00000000 00:00 0
4abbb000-4abbe000 ---p 00000000 00:00 0
4abbe000-4abdc000 rwxp 00000000 00:00 0
4abdc000-4abdf000 ---p 00000000 00:00 0
4abdf000-4abfd000 rwxp 00000000 00:00 0
4abfd000-4ac00000 ---p 00000000 00:00 0
4ac00000-4ac1e000 rwxp 00000000 00:00 0
4ac1e000-4ac21000 ---p 00000000 00:00 0
4ac21000-4ac3f000 rwxp 00000000 00:00 0
4ac3f000-4ac42000 ---p 00000000 00:00 0
4ac42000-4ac60000 rwxp 00000000 00:00 0
4ac60000-4ac63000 ---p 00000000 00:00 0
4ac63000-4ac81000 rwxp 00000000 00:00 0
4ac81000-4ac84000 ---p 00000000 00:00 0
4ac84000-4aca2000 rwxp 00000000 00:00 0
4aca2000-4aca5000 ---p 00000000 00:00 0
4aca5000-4acc3000 rwxp 00000000 00:00 0
4acc3000-4acc6000 ---p 00000000 00:00 0
4acc6000-4ace4000 rwxp 00000000 00:00 0
4ace4000-4ace7000 ---p 00000000 00:00 0
4ace7000-4ad05000 rwxp 00000000 00:00 0
4ad05000-4ad08000 ---p 00000000 00:00 0
4ad08000-4ad26000 rwxp 00000000 00:00 0
4ad26000-4ad29000 ---p 00000000 00:00 0
4ad29000-4ad47000 rwxp 00000000 00:00 0
4ad47000-4ad4a000 ---p 00000000 00:00 0
4ad4a000-4ad68000 rwxp 00000000 00:00 0
4ad68000-4ad6b000 ---p 00000000 00:00 0
4ad6b000-4ad89000 rwxp 00000000 00:00 0
4ad89000-4ad8c000 ---p 00000000 00:00 0
4ad8c000-4adaa000 rwxp 00000000 00:00 0
4adaa000-4adad000 ---p 00000000 00:00 0
4adad000-4adcb000 rwxp 00000000 00:00 0
4adcb000-4adce000 ---p 00000000 00:00 0
4adce000-4adec000 rwxp 00000000 00:00 0
4adec000-4adef000 ---p 00000000 00:00 0
4adef000-4ae0d000 rwxp 00000000 00:00 0
4ae0d000-4ae10000 ---p 00000000 00:00 0
4ae10000-4ae2e000 rwxp 00000000 00:00 0
4ae2e000-4ae31000 ---p 00000000 00:00 0
4ae31000-4ae4f000 rwxp 00000000 00:00 0
4ae4f000-4ae52000 ---p 00000000 00:00 0
4ae52000-4ae70000 rwxp 00000000 00:00 0
4ae70000-4ae73000 ---p 00000000 00:00 0
4ae73000-4ae91000 rwxp 00000000 00:00 0
4ae91000-4ae94000 ---p 00000000 00:00 0
4ae94000-4aeb2000 rwxp 00000000 00:00 0
4aeb2000-4aeb5000 ---p 00000000 00:00 0
4aeb5000-4aed3000 rwxp 00000000 00:00 0
4aed3000-4aed6000 ---p 00000000 00:00 0
4aed6000-4aef4000 rwxp 00000000 00:00 0
4aef4000-4aef7000 ---p 00000000 00:00 0
4aef7000-4af15000 rwxp 00000000 00:00 0
4af15000-4af18000 ---p 00000000 00:00 0
4af18000-4af36000 rwxp 00000000 00:00 0
4af36000-4af39000 ---p 00000000 00:00 0
4af39000-4af57000 rwxp 00000000 00:00 0
4af57000-4af5a000 ---p 00000000 00:00 0
4af5a000-4af78000 rwxp 00000000 00:00 0
4af78000-4af7b000 ---p 00000000 00:00 0
4af7b000-4af99000 rwxp 00000000 00:00 0
4af99000-4af9c000 ---p 00000000 00:00 0
4af9c000-4afba000 rwxp 00000000 00:00 0
4afba000-4afbd000 ---p 00000000 00:00 0
4afbd000-4afdb000 rwxp 00000000 00:00 0
4afdb000-4afde000 ---p 00000000 00:00 0
4afde000-4affc000 rwxp 00000000 00:00 0
4affc000-4afff000 ---p 00000000 00:00 0
4afff000-4b01d000 rwxp 00000000 00:00 0
4b01d000-4b020000 ---p 00000000 00:00 0
4b020000-4b03e000 rwxp 00000000 00:00 0
4b03e000-4b041000 ---p 00000000 00:00 0
4b041000-4b05f000 rwxp 00000000 00:00 0
4b05f000-4b062000 ---p 00000000 00:00 0
4b062000-4b080000 rwxp 00000000 00:00 0
4b080000-4b083000 ---p 00000000 00:00 0
4b083000-4b0a1000 rwxp 00000000 00:00 0
4b0a1000-4b0a4000 ---p 00000000 00:00 0
4b0a4000-4b0c2000 rwxp 00000000 00:00 0
4b0c2000-4b0c5000 ---p 00000000 00:00 0
4b0c5000-4b0e3000 rwxp 00000000 00:00 0
4b0e3000-4b0e6000 ---p 00000000 00:00 0
4b0e6000-4b104000 rwxp 00000000 00:00 0
4b104000-4b107000 ---p 00000000 00:00 0
4b107000-4b125000 rwxp 00000000 00:00 0
4b146000-4b149000 ---p 00000000 00:00 0
4b149000-4b167000 rwxp 00000000 00:00 0
4b167000-4b16a000 ---p 00000000 00:00 0
4b16a000-4b188000 rwxp 00000000 00:00 0
4b188000-4b18b000 ---p 00000000 00:00 0
4b18b000-4b1a9000 rwxp 00000000 00:00 0
4b1a9000-4b1ac000 ---p 00000000 00:00 0
4b1ac000-4b1ca000 rwxp 00000000 00:00 0
4b1ca000-4b1cd000 ---p 00000000 00:00 0
4b1cd000-4b1eb000 rwxp 00000000 00:00 0
4b1eb000-4b1ee000 ---p 00000000 00:00 0
4b1ee000-4b20c000 rwxp 00000000 00:00 0
4b20c000-4b20f000 ---p 00000000 00:00 0
4b20f000-4b22d000 rwxp 00000000 00:00 0
4b22d000-4b230000 ---p 00000000 00:00 0
4b230000-4b24e000 rwxp 00000000 00:00 0
4b24e000-4b251000 ---p 00000000 00:00 0
4b251000-4b26f000 rwxp 00000000 00:00 0
4b26f000-4b272000 ---p 00000000 00:00 0
4b272000-4b290000 rwxp 00000000 00:00 0
4b290000-4b293000 ---p 00000000 00:00 0
4b293000-4b2b1000 rwxp 00000000 00:00 0
4b2b1000-4b2b4000 ---p 00000000 00:00 0
4b2b4000-4b2d2000 rwxp 00000000 00:00 0
4b2d2000-4b2d5000 ---p 00000000 00:00 0
4b2d5000-4b2f3000 rwxp 00000000 00:00 0
4b2f3000-4b2f6000 ---p 00000000 00:00 0
4b2f6000-4b314000 rwxp 00000000 00:00 0
4b314000-4b317000 ---p 00000000 00:00 0
4b317000-4b335000 rwxp 00000000 00:00 0
4b335000-4b338000 ---p 00000000 00:00 0
4b338000-4b356000 rwxp 00000000 00:00 0
4b356000-4b359000 ---p 00000000 00:00 0
4b359000-4b377000 rwxp 00000000 00:00 0
4b377000-4b37a000 ---p 00000000 00:00 0
4b37a000-4b398000 rwxp 00000000 00:00 0
4b398000-4b39b000 ---p 00000000 00:00 0
4b39b000-4b3b9000 rwxp 00000000 00:00 0
4b3b9000-4b3bc000 ---p 00000000 00:00 0
4b3bc000-4b3da000 rwxp 00000000 00:00 0
4b3da000-4b3dd000 ---p 00000000 00:00 0
4b3dd000-4b3fb000 rwxp 00000000 00:00 0
4b3fb000-4b3fe000 ---p 00000000 00:00 0
4b3fe000-4b41c000 rwxp 00000000 00:00 0
4b41c000-4b41f000 ---p 00000000 00:00 0
4b41f000-4b43d000 rwxp 00000000 00:00 0
4b43d000-4b440000 ---p 00000000 00:00 0
4b440000-4b45e000 rwxp 00000000 00:00 0
4b45e000-4b461000 ---p 00000000 00:00 0
4b461000-4b47f000 rwxp 00000000 00:00 0
4b47f000-4b482000 ---p 00000000 00:00 0
4b482000-4b4a0000 rwxp 00000000 00:00 0
4b4a0000-4b4a3000 ---p 00000000 00:00 0
4b4a3000-4b4c1000 rwxp 00000000 00:00 0
4b4c1000-4b4c4000 ---p 00000000 00:00 0
4b4c4000-4b4e2000 rwxp 00000000 00:00 0
4b4e2000-4b4e5000 ---p 00000000 00:00 0
4b4e5000-4b503000 rwxp 00000000 00:00 0
4b503000-4b506000 ---p 00000000 00:00 0
4b506000-4b524000 rwxp 00000000 00:00 0
4b524000-4b527000 ---p 00000000 00:00 0
4b527000-4b545000 rwxp 00000000 00:00 0
4b545000-4b548000 ---p 00000000 00:00 0
4b548000-4b566000 rwxp 00000000 00:00 0
4b566000-4b569000 ---p 00000000 00:00 0
4b569000-4b587000 rwxp 00000000 00:00 0
4b587000-4b58a000 ---p 00000000 00:00 0
4b58a000-4b5a8000 rwxp 00000000 00:00 0
4b5a8000-4b5ab000 ---p 00000000 00:00 0
4b5ab000-4b5c9000 rwxp 00000000 00:00 0
4b5c9000-4b5cc000 ---p 00000000 00:00 0
4b5cc000-4b5ea000 rwxp 00000000 00:00 0
4b5ea000-4b5ed000 ---p 00000000 00:00 0
4b5ed000-4b60b000 rwxp 00000000 00:00 0
4b60b000-4b60e000 ---p 00000000 00:00 0
4b60e000-4b62c000 rwxp 00000000 00:00 0
4b62c000-4b62f000 ---p 00000000 00:00 0
4b62f000-4b64d000 rwxp 00000000 00:00 0
4b64d000-4b650000 ---p 00000000 00:00 0
4b650000-4b66e000 rwxp 00000000 00:00 0
4b66e000-4b671000 ---p 00000000 00:00 0
4b671000-4b68f000 rwxp 00000000 00:00 0
4b68f000-4b692000 ---p 00000000 00:00 0
4b692000-4b6b0000 rwxp 00000000 00:00 0
4b6b0000-4b6b3000 ---p 00000000 00:00 0
4b6b3000-4b6d1000 rwxp 00000000 00:00 0
4b6d1000-4b6d4000 ---p 00000000 00:00 0
4b6d4000-4b6f2000 rwxp 00000000 00:00 0
4b6f2000-4b6f5000 ---p 00000000 00:00 0
4b6f5000-4b713000 rwxp 00000000 00:00 0
4b713000-4b716000 ---p 00000000 00:00 0
4b716000-4b734000 rwxp 00000000 00:00 0
4b734000-4b737000 ---p 00000000 00:00 0
4b737000-4b755000 rwxp 00000000 00:00 0
4b755000-4b758000 ---p 00000000 00:00 0
4b758000-4b776000 rwxp 00000000 00:00 0
4b776000-4b779000 ---p 00000000 00:00 0
4b779000-4b797000 rwxp 00000000 00:00 0
4b797000-4b79a000 ---p 00000000 00:00 0
4b79a000-4b7b8000 rwxp 00000000 00:00 0
4b7b8000-4b7bb000 ---p 00000000 00:00 0
4b7bb000-4b7d9000 rwxp 00000000 00:00 0
4b7d9000-4b7dc000 ---p 00000000 00:00 0
4b7dc000-4b7fa000 rwxp 00000000 00:00 0
4b7fa000-4b7fd000 ---p 00000000 00:00 0
4b7fd000-4b81b000 rwxp 00000000 00:00 0
4b81b000-4b81e000 ---p 00000000 00:00 0
4b81e000-4b83c000 rwxp 00000000 00:00 0
4b83c000-4b83f000 ---p 00000000 00:00 0
4b83f000-4b85d000 rwxp 00000000 00:00 0
4b85d000-4b860000 ---p 00000000 00:00 0
4b860000-4b87e000 rwxp 00000000 00:00 0
4b87e000-4b881000 ---p 00000000 00:00 0
4b881000-4b89f000 rwxp 00000000 00:00 0
4b89f000-4b8a2000 ---p 00000000 00:00 0
4b8a2000-4b8c0000 rwxp 00000000 00:00 0
4b8c0000-4b8c3000 ---p 00000000 00:00 0
4b8c3000-4b8e1000 rwxp 00000000 00:00 0
4b8e1000-4b8e4000 ---p 00000000 00:00 0
4b8e4000-4b902000 rwxp 00000000 00:00 0
4b902000-4b905000 ---p 00000000 00:00 0
4b905000-4b923000 rwxp 00000000 00:00 0
4b923000-4b926000 ---p 00000000 00:00 0
4b926000-4b944000 rwxp 00000000 00:00 0
4b944000-4b947000 ---p 00000000 00:00 0
4b947000-4b965000 rwxp 00000000 00:00 0
4b965000-4b968000 ---p 00000000 00:00 0
4b968000-4b986000 rwxp 00000000 00:00 0
4b986000-4b989000 ---p 00000000 00:00 0
4b989000-4b9a7000 rwxp 00000000 00:00 0
4b9a7000-4b9aa000 ---p 00000000 00:00 0
4b9aa000-4b9c8000 rwxp 00000000 00:00 0
4b9c8000-4b9cb000 ---p 00000000 00:00 0
4b9cb000-4b9e9000 rwxp 00000000 00:00 0
4b9e9000-4b9ec000 ---p 00000000 00:00 0
4b9ec000-4ba0a000 rwxp 00000000 00:00 0
4ba0a000-4ba0d000 ---p 00000000 00:00 0
4ba0d000-4ba2b000 rwxp 00000000 00:00 0
4ba2b000-4ba2e000 ---p 00000000 00:00 0
4ba2e000-4ba4c000 rwxp 00000000 00:00 0
4ba4c000-4ba4f000 ---p 00000000 00:00 0
4ba4f000-4ba6d000 rwxp 00000000 00:00 0
4ba6d000-4ba70000 ---p 00000000 00:00 0
4ba70000-4ba8e000 rwxp 00000000 00:00 0
4ba8e000-4ba91000 ---p 00000000 00:00 0
4ba91000-4baaf000 rwxp 00000000 00:00 0
4baaf000-4bab2000 ---p 00000000 00:00 0
4bab2000-4bad0000 rwxp 00000000 00:00 0
4bad0000-4bad3000 ---p 00000000 00:00 0
4bad3000-4baf1000 rwxp 00000000 00:00 0
4baf1000-4baf4000 ---p 00000000 00:00 0
4baf4000-4bb12000 rwxp 00000000 00:00 0
4bb12000-4bb15000 ---p 00000000 00:00 0
4bb15000-4bb33000 rwxp 00000000 00:00 0
4bb33000-4bb36000 ---p 00000000 00:00 0
4bb36000-4bb54000 rwxp 00000000 00:00 0
4bb54000-4bb57000 ---p 00000000 00:00 0
4bb57000-4bb75000 rwxp 00000000 00:00 0
4bb75000-4bb78000 ---p 00000000 00:00 0
4bb78000-4bb96000 rwxp 00000000 00:00 0
4bb96000-4bb99000 ---p 00000000 00:00 0
4bb99000-4bbb7000 rwxp 00000000 00:00 0
4bbb7000-4bbba000 ---p 00000000 00:00 0
4bbba000-4bbd8000 rwxp 00000000 00:00 0
4bbd8000-4bbdb000 ---p 00000000 00:00 0
4bbdb000-4bbf9000 rwxp 00000000 00:00 0
4bbf9000-4bbfc000 ---p 00000000 00:00 0
4bbfc000-4bc1a000 rwxp 00000000 00:00 0
4bc3b000-4bc3e000 ---p 00000000 00:00 0
4bc3e000-4bc5c000 rwxp 00000000 00:00 0
4bc5c000-4bc5f000 ---p 00000000 00:00 0
4bc5f000-4bc7d000 rwxp 00000000 00:00 0
4bc7d000-4bc80000 ---p 00000000 00:00 0
4bc80000-4bc9e000 rwxp 00000000 00:00 0
4bc9e000-4bca1000 ---p 00000000 00:00 0
4bca1000-4bcbf000 rwxp 00000000 00:00 0
4bcbf000-4bcc2000 ---p 00000000 00:00 0
4bcc2000-4bce0000 rwxp 00000000 00:00 0
4bce0000-4bce3000 ---p 00000000 00:00 0
4bce3000-4bd01000 rwxp 00000000 00:00 0
4bd01000-4bd04000 ---p 00000000 00:00 0
4bd04000-4bd22000 rwxp 00000000 00:00 0
4bd22000-4bd25000 ---p 00000000 00:00 0
4bd25000-4bd43000 rwxp 00000000 00:00 0
4bd43000-4bd46000 ---p 00000000 00:00 0
4bd46000-4bd64000 rwxp 00000000 00:00 0
4bd64000-4bd67000 ---p 00000000 00:00 0
4bd67000-4bd85000 rwxp 00000000 00:00 0
4bd85000-4bd88000 ---p 00000000 00:00 0
4bd88000-4bda6000 rwxp 00000000 00:00 0
4bda6000-4bda9000 ---p 00000000 00:00 0
4bda9000-4bdc7000 rwxp 00000000 00:00 0
4bdc7000-4bdca000 ---p 00000000 00:00 0
4bdca000-4bde8000 rwxp 00000000 00:00 0
4bde8000-4bdeb000 ---p 00000000 00:00 0
4bdeb000-4be09000 rwxp 00000000 00:00 0
4be09000-4be0c000 ---p 00000000 00:00 0
4be0c000-4be2a000 rwxp 00000000 00:00 0
4be2a000-4be2d000 ---p 00000000 00:00 0
4be2d000-4be4b000 rwxp 00000000 00:00 0
4be4b000-4be4e000 ---p 00000000 00:00 0
4be4e000-4be6c000 rwxp 00000000 00:00 0
4be6c000-4be6f000 ---p 00000000 00:00 0
4be6f000-4be8d000 rwxp 00000000 00:00 0
4be8d000-4be90000 ---p 00000000 00:00 0
4be90000-4beae000 rwxp 00000000 00:00 0
4beae000-4beb1000 ---p 00000000 00:00 0
4beb1000-4becf000 rwxp 00000000 00:00 0
4becf000-4bed2000 ---p 00000000 00:00 0
4bed2000-4bef0000 rwxp 00000000 00:00 0
4bef0000-4bef3000 ---p 00000000 00:00 0
4bef3000-4bf11000 rwxp 00000000 00:00 0
4bf11000-4bf14000 ---p 00000000 00:00 0
4bf14000-4bf32000 rwxp 00000000 00:00 0
4bf32000-4bf35000 ---p 00000000 00:00 0
4bf35000-4bf53000 rwxp 00000000 00:00 0
4bf53000-4bf56000 ---p 00000000 00:00 0
4bf56000-4bf74000 rwxp 00000000 00:00 0
4bf74000-4bf77000 ---p 00000000 00:00 0
4bf77000-4bf95000 rwxp 00000000 00:00 0
4bf95000-4bf98000 ---p 00000000 00:00 0
4bf98000-4bfb6000 rwxp 00000000 00:00 0
4bfb6000-4bfb9000 ---p 00000000 00:00 0
4bfb9000-4bfd7000 rwxp 00000000 00:00 0
4bfd7000-4bfda000 ---p 00000000 00:00 0
4bfda000-4bff8000 rwxp 00000000 00:00 0
4bff8000-4bffb000 ---p 00000000 00:00 0
4bffb000-4c019000 rwxp 00000000 00:00 0
4c019000-4c01c000 ---p 00000000 00:00 0
4c01c000-4c03a000 rwxp 00000000 00:00 0
4c03a000-4c03d000 ---p 00000000 00:00 0
4c03d000-4c05b000 rwxp 00000000 00:00 0
4c05b000-4c05e000 ---p 00000000 00:00 0
4c05e000-4c07c000 rwxp 00000000 00:00 0
4c07c000-4c07f000 ---p 00000000 00:00 0
4c07f000-4c09d000 rwxp 00000000 00:00 0
4c09d000-4c0a0000 ---p 00000000 00:00 0
4c0a0000-4c0be000 rwxp 00000000 00:00 0
4c0be000-4c0c1000 ---p 00000000 00:00 0
4c0c1000-4c0df000 rwxp 00000000 00:00 0
4c0df000-4c0e2000 ---p 00000000 00:00 0
4c0e2000-4c100000 rwxp 00000000 00:00 0
4c100000-4c103000 ---p 00000000 00:00 0
4c103000-4c121000 rwxp 00000000 00:00 0
4c121000-4c124000 ---p 00000000 00:00 0
4c124000-4c142000 rwxp 00000000 00:00 0
4c142000-4c145000 ---p 00000000 00:00 0
4c145000-4c163000 rwxp 00000000 00:00 0
4c163000-4c166000 ---p 00000000 00:00 0
4c166000-4c184000 rwxp 00000000 00:00 0
4c184000-4c187000 ---p 00000000 00:00 0
4c187000-4c1a5000 rwxp 00000000 00:00 0
4c1a5000-4c1a8000 ---p 00000000 00:00 0
4c1a8000-4c1c6000 rwxp 00000000 00:00 0
4c1c6000-4c1c9000 ---p 00000000 00:00 0
4c1c9000-4c1e7000 rwxp 00000000 00:00 0
4c1e7000-4c1ea000 ---p 00000000 00:00 0
4c1ea000-4c208000 rwxp 00000000 00:00 0
4c208000-4c20b000 ---p 00000000 00:00 0
4c20b000-4c229000 rwxp 00000000 00:00 0
4c229000-4c22c000 ---p 00000000 00:00 0
4c22c000-4c24a000 rwxp 00000000 00:00 0
4c24a000-4c24d000 ---p 00000000 00:00 0
4c24d000-4c26b000 rwxp 00000000 00:00 0
4c26b000-4c26e000 ---p 00000000 00:00 0
4c26e000-4c28c000 rwxp 00000000 00:00 0
4c28c000-4c28f000 ---p 00000000 00:00 0
4c28f000-4c2ad000 rwxp 00000000 00:00 0
4c2ad000-4c2b0000 ---p 00000000 00:00 0
4c2b0000-4c2ce000 rwxp 00000000 00:00 0
4c2ce000-4c2d1000 ---p 00000000 00:00 0
4c2d1000-4c2ef000 rwxp 00000000 00:00 0
4c2ef000-4c2f2000 ---p 00000000 00:00 0
4c2f2000-4c310000 rwxp 00000000 00:00 0
4c310000-4c313000 ---p 00000000 00:00 0
4c313000-4c331000 rwxp 00000000 00:00 0
4c331000-4c334000 ---p 00000000 00:00 0
4c334000-4c352000 rwxp 00000000 00:00 0
4c352000-4c355000 ---p 00000000 00:00 0
4c355000-4c373000 rwxp 00000000 00:00 0
4c373000-4c376000 ---p 00000000 00:00 0
4c376000-4c394000 rwxp 00000000 00:00 0
4c394000-4c397000 ---p 00000000 00:00 0
4c397000-4c3b5000 rwxp 00000000 00:00 0
4c3b5000-4c3b8000 ---p 00000000 00:00 0
4c3b8000-4c3d6000 rwxp 00000000 00:00 0
4c3d6000-4c3d9000 ---p 00000000 00:00 0
4c3d9000-4c3f7000 rwxp 00000000 00:00 0
4c3f7000-4c3fa000 ---p 00000000 00:00 0
4c3fa000-4c418000 rwxp 00000000 00:00 0
4c418000-4c41b000 ---p 00000000 00:00 0
4c41b000-4c439000 rwxp 00000000 00:00 0
4c439000-4c43c000 ---p 00000000 00:00 0
4c43c000-4c45a000 rwxp 00000000 00:00 0
4c45a000-4c45d000 ---p 00000000 00:00 0
4c45d000-4c47b000 rwxp 00000000 00:00 0
4c47b000-4c47e000 ---p 00000000 00:00 0
4c47e000-4c49c000 rwxp 00000000 00:00 0
4c49c000-4c49f000 ---p 00000000 00:00 0
4c49f000-4c4bd000 rwxp 00000000 00:00 0
4c4bd000-4c4c0000 ---p 00000000 00:00 0
4c4c0000-4c4de000 rwxp 00000000 00:00 0
4c4de000-4c4e1000 ---p 00000000 00:00 0
4c4e1000-4c4ff000 rwxp 00000000 00:00 0
4c4ff000-4c502000 ---p 00000000 00:00 0
4c502000-4c520000 rwxp 00000000 00:00 0
4c520000-4c523000 ---p 00000000 00:00 0
4c523000-4c541000 rwxp 00000000 00:00 0
4c541000-4c544000 ---p 00000000 00:00 0
4c544000-4c562000 rwxp 00000000 00:00 0
4c562000-4c565000 ---p 00000000 00:00 0
4c565000-4c583000 rwxp 00000000 00:00 0
4c583000-4c586000 ---p 00000000 00:00 0
4c586000-4c5a4000 rwxp 00000000 00:00 0
4c5a4000-4c5a7000 ---p 00000000 00:00 0
4c5a7000-4c5c5000 rwxp 00000000 00:00 0
4c5c5000-4c5c8000 ---p 00000000 00:00 0
4c5c8000-4c5e6000 rwxp 00000000 00:00 0
4c5e6000-4c5e9000 ---p 00000000 00:00 0
4c5e9000-4c607000 rwxp 00000000 00:00 0
4c607000-4c60a000 ---p 00000000 00:00 0
4c60a000-4c628000 rwxp 00000000 00:00 0
4c628000-4c62b000 ---p 00000000 00:00 0
4c62b000-4c649000 rwxp 00000000 00:00 0
4c649000-4c64c000 ---p 00000000 00:00 0
4c64c000-4c66a000 rwxp 00000000 00:00 0
4c66a000-4c66d000 ---p 00000000 00:00 0
4c66d000-4c68b000 rwxp 00000000 00:00 0
4c68b000-4c68e000 ---p 00000000 00:00 0
4c68e000-4c6ac000 rwxp 00000000 00:00 0
4c6ac000-4c6af000 ---p 00000000 00:00 0
4c6af000-4c6cd000 rwxp 00000000 00:00 0
4c6cd000-4c6d0000 ---p 00000000 00:00 0
4c6d0000-4c6ee000 rwxp 00000000 00:00 0
4c6ee000-4c6f1000 ---p 00000000 00:00 0
4c6f1000-4c70f000 rwxp 00000000 00:00 0
4c70f000-4c712000 ---p 00000000 00:00 0
4c712000-4c730000 rwxp 00000000 00:00 0
4c730000-4c733000 ---p 00000000 00:00 0
4c733000-4c751000 rwxp 00000000 00:00 0
4c751000-4c754000 ---p 00000000 00:00 0
4c754000-4c772000 rwxp 00000000 00:00 0
4c772000-4c775000 ---p 00000000 00:00 0
4c775000-4c793000 rwxp 00000000 00:00 0
4c793000-4c796000 ---p 00000000 00:00 0
4c796000-4c7b4000 rwxp 00000000 00:00 0
4c7b4000-4c7b7000 ---p 00000000 00:00 0
4c7b7000-4c7d5000 rwxp 00000000 00:00 0
4c7d5000-4c7d8000 ---p 00000000 00:00 0
4c7d8000-4c7f6000 rwxp 00000000 00:00 0
4c7f6000-4c7f9000 ---p 00000000 00:00 0
4c7f9000-4c817000 rwxp 00000000 00:00 0
4c817000-4c81a000 ---p 00000000 00:00 0
4c81a000-4c838000 rwxp 00000000 00:00 0
4c838000-4c83b000 ---p 00000000 00:00 0
4c83b000-4c859000 rwxp 00000000 00:00 0
4c859000-4c85c000 ---p 00000000 00:00 0
4c85c000-4c87a000 rwxp 00000000 00:00 0
4c87a000-4c87d000 ---p 00000000 00:00 0
4c87d000-4c89b000 rwxp 00000000 00:00 0
4c89b000-4c89e000 ---p 00000000 00:00 0
4c89e000-4c8bc000 rwxp 00000000 00:00 0
4c8bc000-4c8bf000 ---p 00000000 00:00 0
4c8bf000-4c8dd000 rwxp 00000000 00:00 0
4c8dd000-4c8e0000 ---p 00000000 00:00 0
4c8e0000-4c8fe000 rwxp 00000000 00:00 0
4c8fe000-4c901000 ---p 00000000 00:00 0
4c901000-4c91f000 rwxp 00000000 00:00 0
4c91f000-4c922000 ---p 00000000 00:00 0
4c922000-4c940000 rwxp 00000000 00:00 0
4c940000-4c943000 ---p 00000000 00:00 0
4c943000-4c961000 rwxp 00000000 00:00 0
4c961000-4c964000 ---p 00000000 00:00 0
4c964000-4c982000 rwxp 00000000 00:00 0
4c982000-4c985000 ---p 00000000 00:00 0
4c985000-4c9a3000 rwxp 00000000 00:00 0
4c9a3000-4c9a6000 ---p 00000000 00:00 0
4c9a6000-4c9c4000 rwxp 00000000 00:00 0
4c9c4000-4c9c7000 ---p 00000000 00:00 0
4c9c7000-4c9e5000 rwxp 00000000 00:00 0
4c9e5000-4c9e8000 ---p 00000000 00:00 0
4c9e8000-4ca06000 rwxp 00000000 00:00 0
4ca06000-4ca09000 ---p 00000000 00:00 0
4ca09000-4ca27000 rwxp 00000000 00:00 0
4ca27000-4ca2a000 ---p 00000000 00:00 0
4ca2a000-4ca48000 rwxp 00000000 00:00 0
4ca48000-4ca4b000 ---p 00000000 00:00 0
4ca4b000-4ca69000 rwxp 00000000 00:00 0
4ca69000-4ca6c000 ---p 00000000 00:00 0
4ca6c000-4ca8a000 rwxp 00000000 00:00 0
4ca8a000-4ca8d000 ---p 00000000 00:00 0
4ca8d000-4caab000 rwxp 00000000 00:00 0
4caab000-4caae000 ---p 00000000 00:00 0
4caae000-4cacc000 rwxp 00000000 00:00 0
4cacc000-4cacf000 ---p 00000000 00:00 0
4cacf000-4caed000 rwxp 00000000 00:00 0
4caed000-4caf0000 ---p 00000000 00:00 0
4caf0000-4cb0e000 rwxp 00000000 00:00 0
4cb0e000-4cb11000 ---p 00000000 00:00 0
4cb11000-4cb2f000 rwxp 00000000 00:00 0
4cb2f000-4cb32000 ---p 00000000 00:00 0
4cb32000-4cb50000 rwxp 00000000 00:00 0
4cb50000-4cb53000 ---p 00000000 00:00 0
4cb53000-4cb71000 rwxp 00000000 00:00 0
4cb71000-4cb74000 ---p 00000000 00:00 0
4cb74000-4cb92000 rwxp 00000000 00:00 0
4cb92000-4cb95000 ---p 00000000 00:00 0
4cb95000-4cbb3000 rwxp 00000000 00:00 0
4cbb3000-4cbb6000 ---p 00000000 00:00 0
4cbb6000-4cbd4000 rwxp 00000000 00:00 0
4cbd4000-4cbd7000 ---p 00000000 00:00 0
4cbd7000-4cbf5000 rwxp 00000000 00:00 0
4cbf5000-4cbf8000 ---p 00000000 00:00 0
4cbf8000-4cc16000 rwxp 00000000 00:00 0
4cc16000-4cc19000 ---p 00000000 00:00 0
4cc19000-4cc37000 rwxp 00000000 00:00 0
4cc37000-4cc3a000 ---p 00000000 00:00 0
4cc3a000-4cc58000 rwxp 00000000 00:00 0
4cc58000-4cc5b000 ---p 00000000 00:00 0
4cc5b000-4cc79000 rwxp 00000000 00:00 0
4cc79000-4cc7c000 ---p 00000000 00:00 0
4cc7c000-4cc9a000 rwxp 00000000 00:00 0
4cc9a000-4cc9d000 ---p 00000000 00:00 0
4cc9d000-4ccbb000 rwxp 00000000 00:00 0
4ccbb000-4ccbe000 ---p 00000000 00:00 0
4ccbe000-4ccdc000 rwxp 00000000 00:00 0
4ccdc000-4ccdf000 ---p 00000000 00:00 0
4ccdf000-4ccfd000 rwxp 00000000 00:00 0
4ccfd000-4cd00000 ---p 00000000 00:00 0
4cd00000-4cd1e000 rwxp 00000000 00:00 0
4cd1e000-4cd21000 ---p 00000000 00:00 0
4cd21000-4cd3f000 rwxp 00000000 00:00 0
4cd3f000-4cd42000 ---p 00000000 00:00 0
4cd42000-4cd60000 rwxp 00000000 00:00 0
4cd60000-4cd63000 ---p 00000000 00:00 0
4cd63000-4cd81000 rwxp 00000000 00:00 0
4cd81000-4cd84000 ---p 00000000 00:00 0
4cd84000-4cda2000 rwxp 00000000 00:00 0
4cda2000-4cda5000 ---p 00000000 00:00 0
4cda5000-4cdc3000 rwxp 00000000 00:00 0
4cdc3000-4cdc6000 ---p 00000000 00:00 0
4cdc6000-4cde4000 rwxp 00000000 00:00 0
4cde4000-4cde7000 ---p 00000000 00:00 0
4cde7000-4ce05000 rwxp 00000000 00:00 0
4ce05000-4ce08000 ---p 00000000 00:00 0
4ce08000-4ce26000 rwxp 00000000 00:00 0
4ce26000-4ce29000 ---p 00000000 00:00 0
4ce29000-4ce47000 rwxp 00000000 00:00 0
4ce47000-4ce4a000 ---p 00000000 00:00 0
4ce4a000-4ce68000 rwxp 00000000 00:00 0
4ce68000-4ce6b000 ---p 00000000 00:00 0
4ce6b000-4ce89000 rwxp 00000000 00:00 0
4ce89000-4ce8c000 ---p 00000000 00:00 0
4ce8c000-4ceaa000 rwxp 00000000 00:00 0
4ceaa000-4cead000 ---p 00000000 00:00 0
4cead000-4cecb000 rwxp 00000000 00:00 0
4cecb000-4cece000 ---p 00000000 00:00 0
4cece000-4ceec000 rwxp 00000000 00:00 0
4ceec000-4ceef000 ---p 00000000 00:00 0
4ceef000-4cf0d000 rwxp 00000000 00:00 0
4cf0d000-4cf10000 ---p 00000000 00:00 0
4cf10000-4cf2e000 rwxp 00000000 00:00 0
4cf2e000-4cf31000 ---p 00000000 00:00 0
4cf31000-4cf4f000 rwxp 00000000 00:00 0
4cf4f000-4cf52000 ---p 00000000 00:00 0
4cf52000-4cf70000 rwxp 00000000 00:00 0
4cf70000-4cf73000 ---p 00000000 00:00 0
4cf73000-4cf91000 rwxp 00000000 00:00 0
4cf91000-4cf94000 ---p 00000000 00:00 0
4cf94000-4cfb2000 rwxp 00000000 00:00 0
4cfb2000-4cfb5000 ---p 00000000 00:00 0
4cfb5000-4cfd3000 rwxp 00000000 00:00 0
4cfd3000-4cfd6000 ---p 00000000 00:00 0
4cfd6000-4cff4000 rwxp 00000000 00:00 0
4cff4000-4cff7000 ---p 00000000 00:00 0
4cff7000-4d015000 rwxp 00000000 00:00 0
4d015000-4d018000 ---p 00000000 00:00 0
4d018000-4d036000 rwxp 00000000 00:00 0
4d036000-4d039000 ---p 00000000 00:00 0
4d039000-4d057000 rwxp 00000000 00:00 0
4d057000-4d05a000 ---p 00000000 00:00 0
4d05a000-4d078000 rwxp 00000000 00:00 0
4d078000-4d07b000 ---p 00000000 00:00 0
4d07b000-4d099000 rwxp 00000000 00:00 0
4d099000-4d09c000 ---p 00000000 00:00 0
4d09c000-4d0ba000 rwxp 00000000 00:00 0
4d0ba000-4d0bd000 ---p 00000000 00:00 0
4d0bd000-4d0db000 rwxp 00000000 00:00 0
4d0db000-4d0de000 ---p 00000000 00:00 0
4d0de000-4d0fc000 rwxp 00000000 00:00 0
4d0fc000-4d0ff000 ---p 00000000 00:00 0
4d0ff000-4d11d000 rwxp 00000000 00:00 0
4d11d000-4d120000 ---p 00000000 00:00 0
4d120000-4d13e000 rwxp 00000000 00:00 0
4d13e000-4d141000 ---p 00000000 00:00 0
4d141000-4d15f000 rwxp 00000000 00:00 0
4d15f000-4d162000 ---p 00000000 00:00 0
4d162000-4d180000 rwxp 00000000 00:00 0
4d180000-4d183000 ---p 00000000 00:00 0
4d183000-4d1a1000 rwxp 00000000 00:00 0
4d1a1000-4d1a4000 ---p 00000000 00:00 0
4d1a4000-4d1c2000 rwxp 00000000 00:00 0
4d1c2000-4d1c5000 ---p 00000000 00:00 0
4d1c5000-4d1e3000 rwxp 00000000 00:00 0
4d1e3000-4d1e6000 ---p 00000000 00:00 0
4d1e6000-4d204000 rwxp 00000000 00:00 0
4d204000-4d207000 ---p 00000000 00:00 0
4d207000-4d225000 rwxp 00000000 00:00 0
4d225000-4d228000 ---p 00000000 00:00 0
4d228000-4d246000 rwxp 00000000 00:00 0
4d246000-4d249000 ---p 00000000 00:00 0
4d249000-4d267000 rwxp 00000000 00:00 0
4d2a9000-4d2ac000 ---p 00000000 00:00 0
4d2ac000-4d2ca000 rwxp 00000000 00:00 0
4d2ca000-4d2cd000 ---p 00000000 00:00 0
4d2cd000-4d2eb000 rwxp 00000000 00:00 0
4d2eb000-4d2ee000 ---p 00000000 00:00 0
4d2ee000-4d30c000 rwxp 00000000 00:00 0
4d30c000-4d30f000 ---p 00000000 00:00 0
4d30f000-4d32d000 rwxp 00000000 00:00 0
4d32d000-4d330000 ---p 00000000 00:00 0
4d330000-4d34e000 rwxp 00000000 00:00 0
4d34e000-4d351000 ---p 00000000 00:00 0
4d351000-4d36f000 rwxp 00000000 00:00 0
4d36f000-4d372000 ---p 00000000 00:00 0
4d372000-4d390000 rwxp 00000000 00:00 0
4d3b1000-4d3b4000 ---p 00000000 00:00 0
4d3b4000-4d3d2000 rwxp 00000000 00:00 0
4d3d2000-4d3d5000 ---p 00000000 00:00 0
4d3d5000-4d3f3000 rwxp 00000000 00:00 0
4d3f3000-4d3f6000 ---p 00000000 00:00 0
4d3f6000-4d414000 rwxp 00000000 00:00 0
4d414000-4d417000 ---p 00000000 00:00 0
4d417000-4d435000 rwxp 00000000 00:00 0
4d435000-4d438000 ---p 00000000 00:00 0
4d438000-4d456000 rwxp 00000000 00:00 0
4d456000-4d459000 ---p 00000000 00:00 0
4d459000-4d477000 rwxp 00000000 00:00 0
4d477000-4d47a000 ---p 00000000 00:00 0
4d47a000-4d498000 rwxp 00000000 00:00 0
4d498000-4d49b000 ---p 00000000 00:00 0
4d49b000-4d4b9000 rwxp 00000000 00:00 0
4d4b9000-4d4bc000 ---p 00000000 00:00 0
4d4bc000-4d4da000 rwxp 00000000 00:00 0
4d4fb000-4d4fe000 ---p 00000000 00:00 0
4d4fe000-4d51c000 rwxp 00000000 00:00 0
4d51c000-4d51f000 ---p 00000000 00:00 0
4d51f000-4d53d000 rwxp 00000000 00:00 0
4d55e000-4d561000 ---p 00000000 00:00 0
4d561000-4d57f000 rwxp 00000000 00:00 0
4d57f000-4d582000 ---p 00000000 00:00 0
4d582000-4d5a0000 rwxp 00000000 00:00 0
4d5a0000-4d5a3000 ---p 00000000 00:00 0
4d5a3000-4d5c1000 rwxp 00000000 00:00 0
4d5c1000-4d5c4000 ---p 00000000 00:00 0
4d5c4000-4d5e2000 rwxp 00000000 00:00 0
4d603000-4d606000 ---p 00000000 00:00 0
4d606000-4d624000 rwxp 00000000 00:00 0
4d624000-4d627000 ---p 00000000 00:00 0
4d627000-4d645000 rwxp 00000000 00:00 0
4d645000-4d648000 ---p 00000000 00:00 0
4d648000-4d666000 rwxp 00000000 00:00 0
4d666000-4d669000 ---p 00000000 00:00 0
4d669000-4d687000 rwxp 00000000 00:00 0
4d687000-4d68a000 ---p 00000000 00:00 0
4d68a000-4d6a8000 rwxp 00000000 00:00 0
4d6ea000-4d6ed000 ---p 00000000 00:00 0
4d6ed000-4d70b000 rwxp 00000000 00:00 0
4d70b000-4d70e000 ---p 00000000 00:00 0
4d70e000-4d72c000 rwxp 00000000 00:00 0
4d72c000-4d72f000 ---p 00000000 00:00 0
4d72f000-4d74d000 rwxp 00000000 00:00 0
4d74d000-4d750000 ---p 00000000 00:00 0
4d750000-4d76e000 rwxp 00000000 00:00 0
4d78f000-4d792000 ---p 00000000 00:00 0
4d792000-4d7b0000 rwxp 00000000 00:00 0
4d7b0000-4d7b3000 ---p 00000000 00:00 0
4d7b3000-4d7d1000 rwxp 00000000 00:00 0
4d7d1000-4d7d4000 ---p 00000000 00:00 0
4d7d4000-4d7f2000 rwxp 00000000 00:00 0
4d7f2000-4d7f5000 ---p 00000000 00:00 0
4d7f5000-4d813000 rwxp 00000000 00:00 0
4d813000-4d816000 ---p 00000000 00:00 0
4d816000-4d834000 rwxp 00000000 00:00 0
4d834000-4d837000 ---p 00000000 00:00 0
4d837000-4d855000 rwxp 00000000 00:00 0
4d855000-4d858000 ---p 00000000 00:00 0
4d858000-4d876000 rwxp 00000000 00:00 0
4d876000-4d879000 ---p 00000000 00:00 0
4d879000-4d897000 rwxp 00000000 00:00 0
4d897000-4d89a000 ---p 00000000 00:00 0
4d89a000-4d8b8000 rwxp 00000000 00:00 0
4d8b8000-4d8bb000 ---p 00000000 00:00 0
4d8bb000-4d8d9000 rwxp 00000000 00:00 0
4d8d9000-4d8dc000 ---p 00000000 00:00 0
4d8dc000-4d8fa000 rwxp 00000000 00:00 0
4d8fa000-4d8fd000 ---p 00000000 00:00 0
4d8fd000-4d91b000 rwxp 00000000 00:00 0
4d91b000-4d91e000 ---p 00000000 00:00 0
4d91e000-4d93c000 rwxp 00000000 00:00 0
4d93c000-4d93f000 ---p 00000000 00:00 0
4d93f000-4d95d000 rwxp 00000000 00:00 0
4d95d000-4d960000 ---p 00000000 00:00 0
4d960000-4d97e000 rwxp 00000000 00:00 0
4d97e000-4d981000 ---p 00000000 00:00 0
4d981000-4d99f000 rwxp 00000000 00:00 0
4d9c0000-4d9c3000 ---p 00000000 00:00 0
4d9c3000-4d9e1000 rwxp 00000000 00:00 0
4d9e1000-4d9e4000 ---p 00000000 00:00 0
4d9e4000-4da02000 rwxp 00000000 00:00 0
4da02000-4da05000 ---p 00000000 00:00 0
4da05000-4da23000 rwxp 00000000 00:00 0
4da23000-4da26000 ---p 00000000 00:00 0
4da26000-4da44000 rwxp 00000000 00:00 0
4da44000-4da47000 ---p 00000000 00:00 0
4da47000-4da65000 rwxp 00000000 00:00 0
4da65000-4da68000 ---p 00000000 00:00 0
4da68000-4da86000 rwxp 00000000 00:00 0
4da86000-4da89000 ---p 00000000 00:00 0
4da89000-4daa7000 rwxp 00000000 00:00 0
4daa7000-4daaa000 ---p 00000000 00:00 0
4daaa000-4dac8000 rwxp 00000000 00:00 0
4dac8000-4dacb000 ---p 00000000 00:00 0
4dacb000-4dae9000 rwxp 00000000 00:00 0
4dae9000-4daec000 ---p 00000000 00:00 0
4daec000-4db0a000 rwxp 00000000 00:00 0
4db0a000-4db0d000 ---p 00000000 00:00 0
4db0d000-4db2b000 rwxp 00000000 00:00 0
4db2b000-4db2e000 ---p 00000000 00:00 0
4db2e000-4db4c000 rwxp 00000000 00:00 0
4db4c000-4db4f000 ---p 00000000 00:00 0
4db4f000-4db6d000 rwxp 00000000 00:00 0
4db6d000-4db70000 ---p 00000000 00:00 0
4db70000-4db8e000 rwxp 00000000 00:00 0
4db8e000-4db91000 ---p 00000000 00:00 0
4db91000-4dbaf000 rwxp 00000000 00:00 0
4dbaf000-4dbb2000 ---p 00000000 00:00 0
4dbb2000-4dbd0000 rwxp 00000000 00:00 0
4dbd0000-4dbd3000 ---p 00000000 00:00 0
4dbd3000-4dbf1000 rwxp 00000000 00:00 0
4dc12000-4dc15000 ---p 00000000 00:00 0
4dc15000-4dc33000 rwxp 00000000 00:00 0
4dc33000-4dc36000 ---p 00000000 00:00 0
4dc36000-4dc54000 rwxp 00000000 00:00 0
4dc75000-4dc78000 ---p 00000000 00:00 0
4dc78000-4dc96000 rwxp 00000000 00:00 0
4dcb7000-4dcba000 ---p 00000000 00:00 0
4dcba000-4dcd8000 rwxp 00000000 00:00 0
4dd1a000-4dd1d000 ---p 00000000 00:00 0
4dd1d000-4dd3b000 rwxp 00000000 00:00 0
4dd3b000-4dd3e000 ---p 00000000 00:00 0
4dd3e000-4dd5c000 rwxp 00000000 00:00 0
4dd5c000-4dd5f000 ---p 00000000 00:00 0
4dd5f000-4dd7d000 rwxp 00000000 00:00 0
4dd7d000-4dd80000 ---p 00000000 00:00 0
4dd80000-4dd9e000 rwxp 00000000 00:00 0
4dd9e000-4dda1000 ---p 00000000 00:00 0
4dda1000-4ddbf000 rwxp 00000000 00:00 0
4ddbf000-4ddc2000 ---p 00000000 00:00 0
4ddc2000-4dde0000 rwxp 00000000 00:00 0
4dde0000-4dde3000 ---p 00000000 00:00 0
4dde3000-4de01000 rwxp 00000000 00:00 0
4de01000-4de04000 ---p 00000000 00:00 0
4de04000-4de22000 rwxp 00000000 00:00 0
4de22000-4de25000 ---p 00000000 00:00 0
4de25000-4de43000 rwxp 00000000 00:00 0
4de43000-4de46000 ---p 00000000 00:00 0
4de46000-4de64000 rwxp 00000000 00:00 0
4de64000-4de67000 ---p 00000000 00:00 0
4de67000-4de85000 rwxp 00000000 00:00 0
4de85000-4de88000 ---p 00000000 00:00 0
4de88000-4dea6000 rwxp 00000000 00:00 0
4dea6000-4dea9000 ---p 00000000 00:00 0
4dea9000-4dec7000 rwxp 00000000 00:00 0
4dec7000-4deca000 ---p 00000000 00:00 0
4deca000-4dee8000 rwxp 00000000 00:00 0
4dee8000-4deeb000 ---p 00000000 00:00 0
4deeb000-4df09000 rwxp 00000000 00:00 0
4df2a000-4df2d000 ---p 00000000 00:00 0
4df2d000-4df4b000 rwxp 00000000 00:00 0
4df4b000-4df4e000 ---p 00000000 00:00 0
4df4e000-4df6c000 rwxp 00000000 00:00 0
4df8d000-4df90000 ---p 00000000 00:00 0
4df90000-4dfae000 rwxp 00000000 00:00 0
4dfae000-4dfb1000 ---p 00000000 00:00 0
4dfb1000-4dfcf000 rwxp 00000000 00:00 0
4dfcf000-4dfd2000 ---p 00000000 00:00 0
4dfd2000-4dff0000 rwxp 00000000 00:00 0
4dff0000-4dff3000 ---p 00000000 00:00 0
4dff3000-4e011000 rwxp 00000000 00:00 0
4e011000-4e014000 ---p 00000000 00:00 0
4e014000-4e032000 rwxp 00000000 00:00 0
4e032000-4e035000 ---p 00000000 00:00 0
4e035000-4e053000 rwxp 00000000 00:00 0
4e053000-4e056000 ---p 00000000 00:00 0
4e056000-4e074000 rwxp 00000000 00:00 0
4e074000-4e077000 ---p 00000000 00:00 0
4e077000-4e095000 rwxp 00000000 00:00 0
4e0b6000-4e0b9000 ---p 00000000 00:00 0
4e0b9000-4e0d7000 rwxp 00000000 00:00 0
4e119000-4e11c000 ---p 00000000 00:00 0
4e11c000-4e13a000 rwxp 00000000 00:00 0
4e13a000-4e13d000 ---p 00000000 00:00 0
4e13d000-4e15b000 rwxp 00000000 00:00 0
4e15b000-4e15e000 ---p 00000000 00:00 0
4e15e000-4e17c000 rwxp 00000000 00:00 0
4e17c000-4e17f000 ---p 00000000 00:00 0
4e17f000-4e19d000 rwxp 00000000 00:00 0
4e1be000-4e1c1000 ---p 00000000 00:00 0
4e1c1000-4e1df000 rwxp 00000000 00:00 0
4e1df000-4e1e2000 ---p 00000000 00:00 0
4e1e2000-4e200000 rwxp 00000000 00:00 0
4e200000-4e203000 ---p 00000000 00:00 0
4e203000-4e221000 rwxp 00000000 00:00 0
4e221000-4e224000 ---p 00000000 00:00 0
4e224000-4e242000 rwxp 00000000 00:00 0
4e242000-4e245000 ---p 00000000 00:00 0
4e245000-4e263000 rwxp 00000000 00:00 0
4e263000-4e266000 ---p 00000000 00:00 0
4e266000-4e284000 rwxp 00000000 00:00 0
4e284000-4e287000 ---p 00000000 00:00 0
4e287000-4e2a5000 rwxp 00000000 00:00 0
4e2a5000-4e2a8000 ---p 00000000 00:00 0
4e2a8000-4e2c6000 rwxp 00000000 00:00 0
4e2c6000-4e2c9000 ---p 00000000 00:00 0
4e2c9000-4e2e7000 rwxp 00000000 00:00 0
4e2e7000-4e2ea000 ---p 00000000 00:00 0
4e2ea000-4e308000 rwxp 00000000 00:00 0
4e329000-4e32c000 ---p 00000000 00:00 0
4e32c000-4e34a000 rwxp 00000000 00:00 0
4e34a000-4e34d000 ---p 00000000 00:00 0
4e34d000-4e36b000 rwxp 00000000 00:00 0
4e38c000-4e38f000 ---p 00000000 00:00 0
4e38f000-4e3ad000 rwxp 00000000 00:00 0
4e3ad000-4e3b0000 ---p 00000000 00:00 0
4e3b0000-4e3ce000 rwxp 00000000 00:00 0
4e3ce000-4e3d1000 ---p 00000000 00:00 0
4e3d1000-4e3ef000 rwxp 00000000 00:00 0
4e3ef000-4e3f2000 ---p 00000000 00:00 0
4e3f2000-4e410000 rwxp 00000000 00:00 0
4e410000-4e413000 ---p 00000000 00:00 0
4e413000-4e431000 rwxp 00000000 00:00 0
4e431000-4e434000 ---p 00000000 00:00 0
4e434000-4e452000 rwxp 00000000 00:00 0
4e452000-4e455000 ---p 00000000 00:00 0
4e455000-4e473000 rwxp 00000000 00:00 0
4e473000-4e476000 ---p 00000000 00:00 0
4e476000-4e494000 rwxp 00000000 00:00 0
4e494000-4e497000 ---p 00000000 00:00 0
4e497000-4e4b5000 rwxp 00000000 00:00 0
4e4b5000-4e4b8000 ---p 00000000 00:00 0
4e4b8000-4e4d6000 rwxp 00000000 00:00 0
4e4d6000-4e4d9000 ---p 00000000 00:00 0
4e4d9000-4e4f7000 rwxp 00000000 00:00 0
4e4f7000-4e4fa000 ---p 00000000 00:00 0
4e4fa000-4e518000 rwxp 00000000 00:00 0
4e518000-4e51b000 ---p 00000000 00:00 0
4e51b000-4e539000 rwxp 00000000 00:00 0
4e539000-4e53c000 ---p 00000000 00:00 0
4e53c000-4e55a000 rwxp 00000000 00:00 0
4e55a000-4e55d000 ---p 00000000 00:00 0
4e55d000-4e57b000 rwxp 00000000 00:00 0
4e5bd000-4e5c0000 ---p 00000000 00:00 0
4e5c0000-4e5de000 rwxp 00000000 00:00 0
4e641000-4e644000 ---p 00000000 00:00 0
4e644000-4e662000 rwxp 00000000 00:00 0
4e662000-4e665000 ---p 00000000 00:00 0
4e665000-4e683000 rwxp 00000000 00:00 0
4e683000-4e686000 ---p 00000000 00:00 0
4e686000-4e6a4000 rwxp 00000000 00:00 0
4e6c5000-4e6c8000 ---p 00000000 00:00 0
4e6c8000-4e6e6000 rwxp 00000000 00:00 0
4e6e6000-4e6e9000 ---p 00000000 00:00 0
4e6e9000-4e707000 rwxp 00000000 00:00 0
4e707000-4e70a000 ---p 00000000 00:00 0
4e70a000-4e728000 rwxp 00000000 00:00 0
4e749000-4e74c000 ---p 00000000 00:00 0
4e74c000-4e76a000 rwxp 00000000 00:00 0
4e76a000-4e76d000 ---p 00000000 00:00 0
4e76d000-4e78b000 rwxp 00000000 00:00 0
4e78b000-4e78e000 ---p 00000000 00:00 0
4e78e000-4e7ac000 rwxp 00000000 00:00 0
4e7ac000-4e7af000 ---p 00000000 00:00 0
4e7af000-4e7cd000 rwxp 00000000 00:00 0
4e7ee000-4e7f1000 ---p 00000000 00:00 0
4e7f1000-4e80f000 rwxp 00000000 00:00 0
4e80f000-4e812000 ---p 00000000 00:00 0
4e812000-4e830000 rwxp 00000000 00:00 0
4e830000-4e833000 ---p 00000000 00:00 0
4e833000-4e851000 rwxp 00000000 00:00 0
4e851000-4e854000 ---p 00000000 00:00 0
4e854000-4e872000 rwxp 00000000 00:00 0
4e872000-4e875000 ---p 00000000 00:00 0
4e875000-4e893000 rwxp 00000000 00:00 0
4e893000-4e896000 ---p 00000000 00:00 0
4e896000-4e8b4000 rwxp 00000000 00:00 0
4e8d5000-4e8d8000 ---p 00000000 00:00 0
4e8d8000-4e8f6000 rwxp 00000000 00:00 0
4e8f6000-4e8f9000 ---p 00000000 00:00 0
4e8f9000-4e917000 rwxp 00000000 00:00 0
4e917000-4e91a000 ---p 00000000 00:00 0
4e91a000-4e938000 rwxp 00000000 00:00 0
4e938000-4e93b000 ---p 00000000 00:00 0
4e93b000-4e959000 rwxp 00000000 00:00 0
4e959000-4e95c000 ---p 00000000 00:00 0
4e95c000-4e97a000 rwxp 00000000 00:00 0
4e97a000-4e97d000 ---p 00000000 00:00 0
4e97d000-4e99b000 rwxp 00000000 00:00 0
4e99b000-4e99e000 ---p 00000000 00:00 0
4e99e000-4e9bc000 rwxp 00000000 00:00 0
4e9dd000-4e9e0000 ---p 00000000 00:00 0
4e9e0000-4e9fe000 rwxp 00000000 00:00 0
4e9fe000-4ea01000 ---p 00000000 00:00 0
4ea01000-4ea1f000 rwxp 00000000 00:00 0
4ea1f000-4ea22000 ---p 00000000 00:00 0
4ea22000-4ea40000 rwxp 00000000 00:00 0
4ea40000-4ea43000 ---p 00000000 00:00 0
4ea43000-4ea61000 rwxp 00000000 00:00 0
4ea61000-4ea64000 ---p 00000000 00:00 0
4ea64000-4ea82000 rwxp 00000000 00:00 0
4ea82000-4ea85000 ---p 00000000 00:00 0
4ea85000-4eaa3000 rwxp 00000000 00:00 0
4eaa3000-4eaa6000 ---p 00000000 00:00 0
4eaa6000-4eac4000 rwxp 00000000 00:00 0
4eac4000-4eac7000 ---p 00000000 00:00 0
4eac7000-4eae5000 rwxp 00000000 00:00 0
4eae5000-4eae8000 ---p 00000000 00:00 0
4eae8000-4eb06000 rwxp 00000000 00:00 0
4eb06000-4eb09000 ---p 00000000 00:00 0
4eb09000-4eb27000 rwxp 00000000 00:00 0
4eb27000-4eb2a000 ---p 00000000 00:00 0
4eb2a000-4eb48000 rwxp 00000000 00:00 0
2aaaaac00000-2aadb2c00000 rwxs 00000000 00:0a
294912 /SYSV00000000 (deleted)
7f3d3c000000-7f3d3e062000 rwxp 00000000 00:00 0
7f3d3e062000-7f3d40000000 ---p 00000000 00:00 0
7f3d44000000-7f3d4482b000 rwxp 00000000 00:00 0
7f3d4482b000-7f3d48000000 ---p 00000000 00:00 0
7f3d48449000-7f3d4c000000 rwxp 00000000 00:00 0
7f3d4c000000-7f3d4feb6000 rwxp 00000000 00:00 0
7f3d4feb6000-7f3d50000000 ---p 00000000 00:00 0
7f3d50000000-7f3d53a6b000 rwxp 00000000 00:00 0
7f3d53a6b000-7f3d54000000 ---p 00000000 00:00 0
7f3d540ae000-7f3d542ae000 rwxp 00000000 00:00 0
7f3d542fc000-7f3d5782b000 rwxp 00000000 00:00 0
7f3d5782b000-7f3d57830000 r-xp 00000000 08:01
8388779 /opt/jdk1.6.0_18/jre/lib/amd64/headless/libmawt.so
7f3d57830000-7f3d5792f000 ---p 00005000 08:01
8388779 /opt/jdk1.6.0_18/jre/lib/amd64/headless/libmawt.so
7f3d5792f000-7f3d57931000 rwxp 00004000 08:01
8388779 /opt/jdk1.6.0_18/jre/lib/amd64/headless/libmawt.so
7f3d57931000-7f3d579c3000 r-xp 00000000 08:01
8388777 /opt/jdk1.6.0_18/jre/lib/amd64/libawt.so
7f3d579c3000-7f3d57ac2000 ---p 00092000 08:01
8388777 /opt/jdk1.6.0_18/jre/lib/amd64/libawt.so
7f3d57ac2000-7f3d57adb000 rwxp 00091000 08:01
8388777 /opt/jdk1.6.0_18/jre/lib/amd64/libawt.so
7f3d57adb000-7f3d58000000 rwxp 00000000 00:00 0
7f3d58000000-7f3d5bd6f000 rwxp 00000000 00:00 0
7f3d5bd6f000-7f3d5c000000 ---p 00000000 00:00 0
7f3d5c0cb000-7f3d5c0da000 r-xs 00676000 08:01
8373997 /opt/jdk1.6.0_18/jre/lib/charsets.jar
7f3d5c0da000-7f3d5cbde000 rwxp 00000000 00:00 0
7f3d5cbde000-7f3d5cbe1000 r-xs 00013000 08:01
8374021 /opt/jdk1.6.0_18/jre/lib/jce.jar
7f3d5cbe1000-7f3d5d1ca000 rwxp 00000000 00:00 0
7f3d5d1e7000-7f3d5d2e7000 rwxp 00000000 00:00 0
7f3d5d2e7000-7f3d5d2ee000 r-xp 00000000 08:01
8388796 /opt/jdk1.6.0_18/jre/lib/amd64/libnio.so
7f3d5d2ee000-7f3d5d3ed000 ---p 00007000 08:01
8388796 /opt/jdk1.6.0_18/jre/lib/amd64/libnio.so
7f3d5d3ed000-7f3d5d3ef000 rwxp 00006000 08:01
8388796 /opt/jdk1.6.0_18/jre/lib/amd64/libnio.so
7f3d5d3ef000-7f3d5d6a3000 rwxp 00000000 00:00 0
7f3d5d6a3000-7f3d5d6b3000 r-xp 00000000 08:01
428285 /lib/libresolv-2.7.so
7f3d5d6b3000-7f3d5d8b3000 ---p 00010000 08:01
428285 /lib/libresolv-2.7.so
7f3d5d8b3000-7f3d5d8b5000 rwxp 00010000 08:01
428285 /lib/libresolv-2.7.so
7f3d5d8b5000-7f3d5d8b7000 rwxp 00000000 00:00 0
7f3d5d8b7000-7f3d5d8bb000 r-xp 00000000 08:01
428286 /lib/libnss_dns-2.7.so
7f3d5d8bb000-7f3d5daba000 ---p 00004000 08:01
428286 /lib/libnss_dns-2.7.so
7f3d5daba000-7f3d5dabc000 rwxp 00003000 08:01
428286 /lib/libnss_dns-2.7.so
7f3d5dabc000-7f3d5e0bd000 rwxp 00000000 00:00 0
7f3d5e0bd000-7f3d5e0d0000 r-xp 00000000 08:01
8388776 /opt/jdk1.6.0_18/jre/lib/amd64/libnet.so
7f3d5e0d0000-7f3d5e1d1000 ---p 00013000 08:01
8388776 /opt/jdk1.6.0_18/jre/lib/amd64/libnet.so
7f3d5e1d1000-7f3d5e1d4000 rwxp 00014000 08:01
8388776 /opt/jdk1.6.0_18/jre/lib/amd64/libnet.so
7f3d5e1d4000-7f3d5e427000 rwxp 00000000 00:00 0
7f3d5e463000-7f3d5e464000 rwxp 00000000 00:00 0
7f3d5e464000-7f3d5e46b000 r-xs 00111000 08:01
8374006 /opt/jdk1.6.0_18/jre/lib/resources.jar
7f3d5e46b000-7f3d5e86b000 rwxp 00000000 00:00 0
7f3d5e86b000-7f3d5e86e000 r-xs 00027000 08:01
8388858 /opt/jdk1.6.0_18/jre/lib/ext/sunjce_provider.jar
7f3d5e86e000-7f3d5e875000 r-xs 00091000 08:01
8374003 /opt/jdk1.6.0_18/jre/lib/jsse.jar
7f3d5e875000-7f3d5f075000 rwxp 00000000 00:00 0
7f3d5f140000-7f3d5f147000 r-xs 000a5000 08:01
84740 /home/www/start.e-messenger.net/html/WEB-INF/lib/mysql-connector-java-5.1.6.jar
7f3d5f201000-7f3d5f217000 r-xp 00000000 08:01
6897777 /usr/lib/libz.so.1.2.3.3
7f3d5f217000-7f3d5f417000 ---p 00016000 08:01
6897777 /usr/lib/libz.so.1.2.3.3
7f3d5f417000-7f3d5f418000 rwxp 00016000 08:01
6897777 /usr/lib/libz.so.1.2.3.3
7f3d5f418000-7f3d5f420000 r-xp 00000000 08:01
428282 /lib/libcrypt-2.7.so
7f3d5f420000-7f3d5f620000 ---p 00008000 08:01
428282 /lib/libcrypt-2.7.so
7f3d5f620000-7f3d5f622000 rwxp 00008000 08:01
428282 /lib/libcrypt-2.7.so
7f3d5f622000-7f3d5f650000 rwxp 00000000 00:00 0
7f3d5f650000-7f3d5f679000 r-xp 00000000 08:01
6914181 /usr/local/lib/libapr-1.so.0.3.9
7f3d5f679000-7f3d5f878000 ---p 00029000 08:01
6914181 /usr/local/lib/libapr-1.so.0.3.9
7f3d5f878000-7f3d5f879000 rwxp 00028000 08:01
6914181 /usr/local/lib/libapr-1.so.0.3.9
7f3d5f879000-7f3d5f87a000 rwxp 00000000 00:00 0
7f3d5f87a000-7f3d5f9ec000 r-xp 00000000 08:01
6898948 /usr/lib/libcrypto.so.0.9.8
7f3d5f9ec000-7f3d5fbeb000 ---p 00172000 08:01
6898948 /usr/lib/libcrypto.so.0.9.8
7f3d5fbeb000-7f3d5fc11000 rwxp 00171000 08:01
6898948 /usr/lib/libcrypto.so.0.9.8
7f3d5fc11000-7f3d5fc15000 rwxp 00000000 00:00 0
7f3d5fc15000-7f3d5fc5f000 r-xp 00000000 08:01
6898949 /usr/lib/libssl.so.0.9.8
7f3d5fc5f000-7f3d5fe5f000 ---p 0004a000 08:01
6898949 /usr/lib/libssl.so.0.9.8
7f3d5fe5f000-7f3d5fe66000 rwxp 0004a000 08:01
6898949 /usr/lib/libssl.so.0.9.8
7f3d5fe66000-7f3d60000000 rwxp 00000000 00:00 0
7f3d60000000-7f3d63ff9000 rwxp 00000000 00:00 0
7f3d63ff9000-7f3d64000000 ---p 00000000 00:00 0
7f3d640ec000-7f3d640ef000 r-xs 000cb000 08:01
8388855 /opt/jdk1.6.0_18/jre/lib/ext/localedata.jar
7f3d640ef000-7f3d6410e000 r-xp 00000000 08:01
6914185 /usr/local/lib/libtcnative-1.so.0.1.18
7f3d6410e000-7f3d6430e000 ---p 0001f000 08:01
6914185 /usr/local/lib/libtcnative-1.so.0.1.18
7f3d6430e000-7f3d64310000 rwxp 0001f000 08:01
6914185 /usr/local/lib/libtcnative-1.so.0.1.18
7f3d64310000-7f3d64610000 rwxp 00000000 00:00 0
7f3d64610000-7f3d64612000 r-xs 0000b000 08:01
10518573 /opt/apache-tomcat-6.0.24/lib/tomcat-i18n-fr.jar
7f3d64612000-7f3d64614000 r-xs 00014000 08:01
10518568 /opt/apache-tomcat-6.0.24/lib/servlet-api.jar
7f3d64614000-7f3d64620000 r-xs 0014c000 08:01
10518574 /opt/apache-tomcat-6.0.24/lib/jasper-jdt.jar
7f3d64620000-7f3d64720000 rwxp 00000000 00:00 0
7f3d64720000-7f3d64723000 r-xs 00018000 08:01
10518577 /opt/apache-tomcat-6.0.24/lib/jasper-el.jar
7f3d64723000-7f3d64727000 r-xs 00035000 08:01
10518582 /opt/apache-tomcat-6.0.24/lib/tomcat-dbcp.jar
7f3d64727000-7f3d64736000 r-xs 00112000 08:01
10518578 /opt/apache-tomcat-6.0.24/lib/catalina.jar
7f3d64736000-7f3d64739000 r-xs 0001d000 08:01
10518576 /opt/apache-tomcat-6.0.24/lib/catalina-ha.jar
7f3d64739000-7f3d6473c000 r-xs 0000f000 08:01
10518580 /opt/apache-tomcat-6.0.24/lib/tomcat-i18n-es.jar
7f3d6473c000-7f3d6483c000 rwxp 00000000 00:00 0
7f3d6483c000-7f3d64842000 r-xp 00000000 08:01
8388746 /opt/jdk1.6.0_18/jre/lib/amd64/libmanagement.so
7f3d64842000-7f3d64941000 ---p 00006000 08:01
8388746 /opt/jdk1.6.0_18/jre/lib/amd64/libmanagement.so
7f3d64941000-7f3d64943000 rwxp 00005000 08:01
8388746 /opt/jdk1.6.0_18/jre/lib/amd64/libmanagement.so
7f3d64943000-7f3d64a43000 rwxp 00000000 00:00 0
7f3d64a43000-7f3d64b7d000 r-xp 00000000 08:01
6930455 /usr/lib/locale/locale-archive
7f3d64b7d000-7f3d64d13000 r-xs 02fc6000 08:01
8373993 /opt/jdk1.6.0_18/jre/lib/rt.jar
7f3d64d13000-7f3d75e7e000 rwxp 00000000 00:00 0
7f3d75e7e000-7f3d77400000 rwxp 00000000 00:00 0
7f3d77400000-7f3d78e7f000 rwxp 00000000 00:00 0
7f3d78e7f000-7f3d78e8d000 r-xp 00000000 08:01
8388787 /opt/jdk1.6.0_18/jre/lib/amd64/libzip.so
7f3d78e8d000-7f3d78f8f000 ---p 0000e000 08:01
8388787 /opt/jdk1.6.0_18/jre/lib/amd64/libzip.so
7f3d78f8f000-7f3d78f92000 rwxp 00010000 08:01
8388787 /opt/jdk1.6.0_18/jre/lib/amd64/libzip.so
7f3d78f92000-7f3d78f93000 rwxp 00000000 00:00 0
7f3d78f93000-7f3d78f9d000 r-xp 00000000 08:01
428271 /lib/libnss_files-2.7.so
7f3d78f9d000-7f3d7919d000 ---p 0000a000 08:01
428271 /lib/libnss_files-2.7.so
7f3d7919d000-7f3d7919f000 rwxp 0000a000 08:01
428271 /lib/libnss_files-2.7.so
7f3d7919f000-7f3d791a8000 r-xp 00000000 08:01
428268 /lib/libnss_nis-2.7.so
7f3d791a8000-7f3d793a8000 ---p 00009000 08:01
428268 /lib/libnss_nis-2.7.so
7f3d793a8000-7f3d793aa000 rwxp 00009000 08:01
428268 /lib/libnss_nis-2.7.so
7f3d793aa000-7f3d793b1000 r-xp 00000000 08:01
428273 /lib/libnss_compat-2.7.so
7f3d793b1000-7f3d795b0000 ---p 00007000 08:01
428273 /lib/libnss_compat-2.7.so
7f3d795b0000-7f3d795b2000 rwxp 00006000 08:01
428273 /lib/libnss_compat-2.7.so
7f3d795b2000-7f3d795b9000 r-xp 00000000 08:01
8388798 /opt/jdk1.6.0_18/jre/lib/amd64/native_threads/libhpi.so
7f3d795b9000-7f3d796ba000 ---p 00007000 08:01
8388798 /opt/jdk1.6.0_18/jre/lib/amd64/native_threads/libhpi.so
7f3d796ba000-7f3d796bc000 rwxp 00008000 08:01
8388798 /opt/jdk1.6.0_18/jre/lib/amd64/native_threads/libhpi.so
7f3d796bc000-7f3d796bd000 rwxp 00000000 00:00 0
7f3d796bd000-7f3d796d2000 r-xp 00000000 08:01
428283 /lib/libnsl-2.7.so
7f3d796d2000-7f3d798d1000 ---p 00015000 08:01
428283 /lib/libnsl-2.7.so
7f3d798d1000-7f3d798d3000 rwxp 00014000 08:01
428283 /lib/libnsl-2.7.so
7f3d798d3000-7f3d798d5000 rwxp 00000000 00:00 0
7f3d798d5000-7f3d798fe000 r-xp 00000000 08:01
8388761 /opt/jdk1.6.0_18/jre/lib/amd64/libjava.so
7f3d798fe000-7f3d799fd000 ---p 00029000 08:01
8388761 /opt/jdk1.6.0_18/jre/lib/amd64/libjava.so
7f3d799fd000-7f3d79a04000 rwxp 00028000 08:01
8388761 /opt/jdk1.6.0_18/jre/lib/amd64/libjava.so
7f3d79a04000-7f3d79a11000 r-xp 00000000 08:01
8388764 /opt/jdk1.6.0_18/jre/lib/amd64/libverify.so
7f3d79a11000-7f3d79b10000 ---p 0000d000 08:01
8388764 /opt/jdk1.6.0_18/jre/lib/amd64/libverify.so
7f3d79b10000-7f3d79b13000 rwxp 0000c000 08:01
8388764 /opt/jdk1.6.0_18/jre/lib/amd64/libverify.so
7f3d79b13000-7f3d79b1b000 r-xp 00000000 08:01
428275 /lib/librt-2.7.so
7f3d79b1b000-7f3d79d1a000 ---p 00008000 08:01
428275 /lib/librt-2.7.so
7f3d79d1a000-7f3d79d1c000 rwxp 00007000 08:01
428275 /lib/librt-2.7.so
7f3d79d1c000-7f3d79d9e000 r-xp 00000000 08:01
428289 /lib/libm-2.7.so
7f3d79d9e000-7f3d79f9d000 ---p 00082000 08:01
428289 /lib/libm-2.7.so
7f3d79f9d000-7f3d79f9f000 rwxp 00081000 08:01
428289 /lib/libm-2.7.so
7f3d79f9f000-7f3d7a753000 r-xp 00000000 08:01
8388757 /opt/jdk1.6.0_18/jre/lib/amd64/server/libjvm.so
7f3d7a753000-7f3d7a853000 ---p 007b4000 08:01
8388757 /opt/jdk1.6.0_18/jre/lib/amd64/server/libjvm.so
7f3d7a853000-7f3d7a9dd000 rwxp 007b4000 08:01
8388757 /opt/jdk1.6.0_18/jre/lib/amd64/server/libjvm.so
7f3d7a9dd000-7f3d7aa16000 rwxp 00000000 00:00 0
7f3d7aa16000-7f3d7ab60000 r-xp 00000000 08:01
428284 /lib/libc-2.7.so
7f3d7ab60000-7f3d7ad5f000 ---p 0014a000 08:01
428284 /lib/libc-2.7.so
7f3d7ad5f000-7f3d7ad62000 r-xp 00149000 08:01
428284 /lib/libc-2.7.so
7f3d7ad62000-7f3d7ad64000 rwxp 0014c000 08:01
428284 /lib/libc-2.7.so
7f3d7ad64000-7f3d7ad69000 rwxp 00000000 00:00 0
7f3d7ad69000-7f3d7ad6b000 r-xp 00000000 08:01
428276 /lib/libdl-2.7.so
7f3d7ad6b000-7f3d7af6b000 ---p 00002000 08:01
428276 /lib/libdl-2.7.so
7f3d7af6b000-7f3d7af6d000 rwxp 00002000 08:01
428276 /lib/libdl-2.7.so
7f3d7af6d000-7f3d7af83000 r-xp 00000000 08:01
428287 /lib/libpthread-2.7.so
7f3d7af83000-7f3d7b183000 ---p 00016000 08:01
428287 /lib/libpthread-2.7.so
7f3d7b183000-7f3d7b185000 rwxp 00016000 08:01
428287 /lib/libpthread-2.7.so
7f3d7b185000-7f3d7b189000 rwxp 00000000 00:00 0
7f3d7b189000-7f3d7b1a5000 r-xp 00000000 08:01
428278 /lib/ld-2.7.so
7f3d7b1a5000-7f3d7b1a6000 r-xs 00007000 08:01
10518572 /opt/apache-tomcat-6.0.24/lib/el-api.jar
7f3d7b1a6000-7f3d7b1a8000 r-xs 00011000 08:01
10518575 /opt/apache-tomcat-6.0.24/lib/jsp-api.jar
7f3d7b1a8000-7f3d7b1af000 r-xs 00079000 08:01
10518579 /opt/apache-tomcat-6.0.24/lib/jasper.jar
7f3d7b1af000-7f3d7b1ba000 r-xs 000af000 08:01
10518581 /opt/apache-tomcat-6.0.24/lib/tomcat-coyote.jar
7f3d7b1ba000-7f3d7b1bf000 r-xs 00035000 08:01
10518571 /opt/apache-tomcat-6.0.24/lib/catalina-tribes.jar
7f3d7b1bf000-7f3d7b1c1000 r-xs 0000c000 08:01
10518567 /opt/apache-tomcat-6.0.24/lib/catalina-ant.jar
7f3d7b1c1000-7f3d7b1c3000 r-xs 0000c000 08:01
10518570 /opt/apache-tomcat-6.0.24/lib/tomcat-i18n-ja.jar
7f3d7b1c3000-7f3d7b1c5000 r-xs 00005000 08:01
10518550 /opt/apache-tomcat-6.0.24/bin/tomcat-juli.jar
7f3d7b1c5000-7f3d7b1c7000 r-xs 00001000 08:01
10518551 /opt/apache-tomcat-6.0.24/bin/commons-daemon.jar
7f3d7b1c7000-7f3d7b216000 rwxp 00000000 00:00 0
7f3d7b216000-7f3d7b287000 rwxp 00000000 00:00 0
7f3d7b287000-7f3d7b28f000 rwxs 00000000 08:01
1639348 /tmp/hsperfdata_root/27023
7f3d7b28f000-7f3d7b291000 rwxp 00000000 00:00 0
7f3d7b291000-7f3d7b298000 r-xp 00000000 08:01
8388786 /opt/jdk1.6.0_18/jre/lib/amd64/jli/libjli.so
7f3d7b298000-7f3d7b399000 ---p 00007000 08:01
8388786 /opt/jdk1.6.0_18/jre/lib/amd64/jli/libjli.so
7f3d7b399000-7f3d7b39b000 rwxp 00008000 08:01
8388786 /opt/jdk1.6.0_18/jre/lib/amd64/jli/libjli.so
7f3d7b39b000-7f3d7b39c000 rwxp 00000000 00:00 0
7f3d7b39c000-7f3d7b39d000 r-xs 00003000 08:01
10518569 /opt/apache-tomcat-6.0.24/lib/annotations-api.jar
7f3d7b39d000-7f3d7b39f000 r-xs 00004000 08:01
10518548 /opt/apache-tomcat-6.0.24/bin/bootstrap.jar
7f3d7b39f000-7f3d7b3a0000 rwxp 00000000 00:00 0
7f3d7b3a0000-7f3d7b3a1000 ---p 00000000 00:00 0
7f3d7b3a1000-7f3d7b3a4000 rwxp 00000000 00:00 0
7f3d7b3a4000-7f3d7b3a6000 rwxp 0001b000 08:01
428278 /lib/ld-2.7.so
7fff1b0fa000-7fff1b10f000 rwxp 00000000 00:00 0
[stack]
7fff1b1f9000-7fff1b1fa000 r-xp 00000000 00:00 0
[vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0
[vsyscall]
VM Arguments:
jvm_args: -verbose:gc -Djava.awt.headless=true -Dsun.net.inetaddr.ttl=60
-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/opt/apache-tomcat/temp
-Djava.library.path=/usr/local/lib
-Djava.endorsed.dirs=/opt/apache-tomcat/endorsed
-Dcatalina.base=/opt/apache-tomcat -Dcatalina.home=/opt/apache-tomcat
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Djava.util.logging.config.file=/opt/apache-tomcat/conf/logging.properties -XX:+PrintGCDetails -Xloggc:/opt/apache-tomcat/logs/gc.log -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=60 -Xms12288M -Xmx12288M -XX:NewSize=2048M -XX:MaxNewSize=2048M -XX:PermSize=128M -XX:MaxPermSize=128M -Xss128K -XX:+UseLargePages
java_command: org.apache.catalina.startup.Bootstrap start
Launcher Type: SUN_STANDARD
Environment Variables:
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
USERNAME=root
LD_LIBRARY_PATH=/opt/jdk1.6.0_18/jre/lib/amd64/server:/opt/jdk1.6.0_18/jre/lib/amd64:/opt/jdk1.6.0_18/jre/../lib/amd64
SHELL=/bin/bash
Signal Handlers:
SIGSEGV: [libjvm.so+0x70f1a0], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGBUS: [libjvm.so+0x70f1a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGFPE: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGPIPE: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGXFSZ: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGILL: [libjvm.so+0x5d7f70], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x5da790], sa_mask[0]=0x00000000,
sa_flags=0x10000004
SIGHUP: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGTERM: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
SIGQUIT: [libjvm.so+0x5da4e0], sa_mask[0]=0x7ffbfeff,
sa_flags=0x10000004
--------------- S Y S T E M ---------------
OS:5.0.4
uname:Linux 2.6.31.12 #1 SMP Fri Feb 5 13:17:11 CET 2010 x86_64
libc:glibc 2.7 NPTL 2.7
rlimit: STACK 8192k, CORE 0k, NPROC infinity, NOFILE 131072, AS infinity
load average:0.49 0.22 0.18
CPU:total 8 (4 cores per cpu, 1 threads per core) family 6 model 23
stepping 6, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1
Memory: 4k page, physical 16449468k(367476k free), swap
4016208k(4014256k free)
vm_info: Java HotSpot(TM) 64-Bit Server VM (16.0-b13) for linux-amd64
JRE (1.6.0_18-b07), built on Dec 17 2009 13:42:22 by "java_re" with gcc
3.2.2 (SuSE Linux)
time: Tue Mar 16 21:46:41 2010
elapsed time: 102453 seconds
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
Here's a hs_err file after a crash I had yesterday. We turned off some
things in our code without restarting and the crashes have virtually
stopped but we do still get the off one here and there where the
application has not been restarted, could be that the problem lingers
and builds up in time, who knows.
It's a sigsegv in GCTaskThread. From the occupation in eden it looks
like it happened during a scavenge (ParNew).
Maybe an expert in some dark cave could shed some more light on it.
On Tue, 2010-03-16 at 22:00 +0100, André Warnier wrote:
> Carl wrote:
> > My approach is to get something (a JVM) that works and then gradually
> > change until it breaks. Then, I know what is causing the problem. To
> > date, I haven't been able to get a JVM that works.
> >
> I think we understand that, and agree.
> Our remarks were "tongue in cheek", if that is the right expression.
>
> At the bottom of things, finding a bug in the most recent JVM would be
> much more globally important than finding it in your applications,
> particularly a bug that can cause the JVM to segfault.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by André Warnier <aw...@ice-sa.com>.
Carl wrote:
> My approach is to get something (a JVM) that works and then gradually
> change until it breaks. Then, I know what is causing the problem. To
> date, I haven't been able to get a JVM that works.
>
I think we understand that, and agree.
Our remarks were "tongue in cheek", if that is the right expression.
At the bottom of things, finding a bug in the most recent JVM would be
much more globally important than finding it in your applications,
particularly a bug that can cause the JVM to segfault.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by Carl <ca...@etrak-plus.com>.
My approach is to get something (a JVM) that works and then gradually change
until it breaks. Then, I know what is causing the problem. To date, I
haven't been able to get a JVM that works.
In my case, it might be something in my application that is causing the
crash on 64 bit Slackware as there are many people running 64 bit on Linux
without a problem. If it is my application, then any 64 bit JVM I throw at
it should crash.
On the other hand, if the 1.6.0_7 JVM works, then it is likely a bug in one
of the changes that brings the JVM to the current version. Time will tell.
Thanks,
Carl
----- Original Message -----
From: "André Warnier" <aw...@ice-sa.com>
To: "Tomcat Users List" <us...@tomcat.apache.org>
Sent: Tuesday, March 16, 2010 3:20 PM
Subject: Re: [OT] Re: jvm exits without trace
> Ognjen Blagojevic wrote:
>> Hi,
>>
>> "Tomcat dies suddenly" thread was exciting almost as "Prison Break" TV
>> series. I couldn't wait to find out what would be solution to the
>> problem, and I must admit that just downgrading to lower sub-sub-sub
>> version JVM left me a bit disappointed. :)
>>
> +1
> It sounds quite like the standard tech support solution for Windows
> problems : de-install, re-install; and if that does not help, push the
> reset button.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by André Warnier <aw...@ice-sa.com>.
Ognjen Blagojevic wrote:
> Hi,
>
> "Tomcat dies suddenly" thread was exciting almost as "Prison Break" TV
> series. I couldn't wait to find out what would be solution to the
> problem, and I must admit that just downgrading to lower sub-sub-sub
> version JVM left me a bit disappointed. :)
>
+1
It sounds quite like the standard tech support solution for Windows
problems : de-install, re-install; and if that does not help, push the
reset button.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: [OT] Re: jvm exits without trace
Posted by David kerber <dc...@verizon.net>.
Ognjen Blagojevic wrote:
> Hi,
>
> "Tomcat dies suddenly" thread was exciting almost as "Prison Break" TV
> series. I couldn't wait to find out what would be solution to the
> problem, and I must admit that just downgrading to lower sub-sub-sub
> version JVM left me a bit disappointed. :)
Well, I wouldn't call that a true "solution"; more of a workaround. At
some point, they're going to have to be able to update to a more current
version. I'd love to see what the root cause is, if it's ever truly
determined...
D
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
[OT] Re: jvm exits without trace
Posted by Ognjen Blagojevic <og...@etf.bg.ac.rs>.
Hi,
"Tomcat dies suddenly" thread was exciting almost as "Prison Break" TV
series. I couldn't wait to find out what would be solution to the
problem, and I must admit that just downgrading to lower sub-sub-sub
version JVM left me a bit disappointed. :)
Regards,
Ognjen
Carl wrote:
> Taylan,
>
> I have had a similar problem that is yet unsolved (see the thread
> 'Tomcat dies suddenly'.) In my case, the death left a core file which
> showed the JVM stopped with a seg fault. A week ago yesterday, we
> switched to the Sun 1.6.0_7 JVM (from 1.6.0_17 and 1.6.0_17) (Chuck
> suggested this) and so far, it is running even though we have had loads
> and usages similar to those that caused crashes in the past.
>
> Therefore, you might consider trying that JVM.
>
> Hope I haven't jinxed myself by saying it is still up.
>
> Thanks,
>
> Carl
>
> ----- Original Message ----- From: "Taylan Develioglu"
> <td...@ebuddy.com>
> To: "Tomcat Users List" <us...@tomcat.apache.org>
> Sent: Tuesday, March 16, 2010 7:41 AM
> Subject: Re: jvm exits without trace
>
>
>> With parent I meant the main JVM process as opposed to forked processes
>> or threads, sorry to confuse you there. Stracing the threads generates
>> too much data to store so I had to settle with the parent process.
>>
>> To answer your other questions.
>>
>> The code is 100% pure java, why it causes this messy crash is still
>> unclear but development is working to figure it out.
>>
>> I'll follow up when we find out more, but I'm not sure if we're likely
>> to dig into the root cause, working around it is more of a priority
>> right now than debugging the jvm.
>>
>>
>> On Mon, 2010-03-15 at 17:08 +0100, Christopher Schultz wrote:
>>> -----BEGIN PGP SIGNED MESSAGE-----
>>> Hash: SHA1
>>>
>>> Taylan,
>>>
>>> On 3/15/2010 10:19 AM, Taylan Develioglu wrote:
>>> > The cause for the crashes was in our own application code, we're
>>> > currently investigating the exact reason.
>>>
>>> Yeah, I'd like to second Chuck's question: was it native code?
>>>
>>> > A strace of the parent process shows killed by sigsegv, why or how
>>> this
>>> > can happen is still unclear.
>>>
>>> So, the parent was being killed? What was the parent of the JVM?
>>>
>>> > Thanks to everyone that gave their assistance.
>>>
>>> Definitely follow-up to let us all know what you've uncovered... this
>>> was certainly a weird situation.
>>>
>>> - -chris
>>> -----BEGIN PGP SIGNATURE-----
>>> Version: GnuPG v1.4.10 (MingW32)
>>> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>>>
>>> iEYEARECAAYFAkueW4wACgkQ9CaO5/Lv0PAdhgCfa32vlcsMI5ELCNcLSjjV+S/o
>>> FZEAnjvjXgAwxjejTXexGO//89TyeF+r
>>> =BPtZ
>>> -----END PGP SIGNATURE-----
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> For additional commands, e-mail: users-help@tomcat.apache.org
>>
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Carl <ca...@etrak-plus.com>.
Taylan,
I have had a similar problem that is yet unsolved (see the thread 'Tomcat
dies suddenly'.) In my case, the death left a core file which showed the
JVM stopped with a seg fault. A week ago yesterday, we switched to the Sun
1.6.0_7 JVM (from 1.6.0_17 and 1.6.0_17) (Chuck suggested this) and so far,
it is running even though we have had loads and usages similar to those that
caused crashes in the past.
Therefore, you might consider trying that JVM.
Hope I haven't jinxed myself by saying it is still up.
Thanks,
Carl
----- Original Message -----
From: "Taylan Develioglu" <td...@ebuddy.com>
To: "Tomcat Users List" <us...@tomcat.apache.org>
Sent: Tuesday, March 16, 2010 7:41 AM
Subject: Re: jvm exits without trace
> With parent I meant the main JVM process as opposed to forked processes
> or threads, sorry to confuse you there. Stracing the threads generates
> too much data to store so I had to settle with the parent process.
>
> To answer your other questions.
>
> The code is 100% pure java, why it causes this messy crash is still
> unclear but development is working to figure it out.
>
> I'll follow up when we find out more, but I'm not sure if we're likely
> to dig into the root cause, working around it is more of a priority
> right now than debugging the jvm.
>
>
> On Mon, 2010-03-15 at 17:08 +0100, Christopher Schultz wrote:
>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
>>
>> Taylan,
>>
>> On 3/15/2010 10:19 AM, Taylan Develioglu wrote:
>> > The cause for the crashes was in our own application code, we're
>> > currently investigating the exact reason.
>>
>> Yeah, I'd like to second Chuck's question: was it native code?
>>
>> > A strace of the parent process shows killed by sigsegv, why or how this
>> > can happen is still unclear.
>>
>> So, the parent was being killed? What was the parent of the JVM?
>>
>> > Thanks to everyone that gave their assistance.
>>
>> Definitely follow-up to let us all know what you've uncovered... this
>> was certainly a weird situation.
>>
>> - -chris
>> -----BEGIN PGP SIGNATURE-----
>> Version: GnuPG v1.4.10 (MingW32)
>> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>>
>> iEYEARECAAYFAkueW4wACgkQ9CaO5/Lv0PAdhgCfa32vlcsMI5ELCNcLSjjV+S/o
>> FZEAnjvjXgAwxjejTXexGO//89TyeF+r
>> =BPtZ
>> -----END PGP SIGNATURE-----
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> For additional commands, e-mail: users-help@tomcat.apache.org
>>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
With parent I meant the main JVM process as opposed to forked processes
or threads, sorry to confuse you there. Stracing the threads generates
too much data to store so I had to settle with the parent process.
To answer your other questions.
The code is 100% pure java, why it causes this messy crash is still
unclear but development is working to figure it out.
I'll follow up when we find out more, but I'm not sure if we're likely
to dig into the root cause, working around it is more of a priority
right now than debugging the jvm.
On Mon, 2010-03-15 at 17:08 +0100, Christopher Schultz wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> Taylan,
>
> On 3/15/2010 10:19 AM, Taylan Develioglu wrote:
> > The cause for the crashes was in our own application code, we're
> > currently investigating the exact reason.
>
> Yeah, I'd like to second Chuck's question: was it native code?
>
> > A strace of the parent process shows killed by sigsegv, why or how this
> > can happen is still unclear.
>
> So, the parent was being killed? What was the parent of the JVM?
>
> > Thanks to everyone that gave their assistance.
>
> Definitely follow-up to let us all know what you've uncovered... this
> was certainly a weird situation.
>
> - -chris
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.10 (MingW32)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAkueW4wACgkQ9CaO5/Lv0PAdhgCfa32vlcsMI5ELCNcLSjjV+S/o
> FZEAnjvjXgAwxjejTXexGO//89TyeF+r
> =BPtZ
> -----END PGP SIGNATURE-----
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Taylan,
On 3/15/2010 10:19 AM, Taylan Develioglu wrote:
> The cause for the crashes was in our own application code, we're
> currently investigating the exact reason.
Yeah, I'd like to second Chuck's question: was it native code?
> A strace of the parent process shows killed by sigsegv, why or how this
> can happen is still unclear.
So, the parent was being killed? What was the parent of the JVM?
> Thanks to everyone that gave their assistance.
Definitely follow-up to let us all know what you've uncovered... this
was certainly a weird situation.
- -chris
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkueW4wACgkQ9CaO5/Lv0PAdhgCfa32vlcsMI5ELCNcLSjjV+S/o
FZEAnjvjXgAwxjejTXexGO//89TyeF+r
=BPtZ
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
The cause for the crashes was in our own application code, we're
currently investigating the exact reason.
A strace of the parent process shows killed by sigsegv, why or how this
can happen is still unclear.
Thanks to everyone that gave their assistance.
On Thu, 2010-03-11 at 15:40 +0100, Taylan Develioglu wrote:
> Hi Carl, thanks for the suggestion. I am going to try jvm 1.6.07
> regardless of what I said before.
>
> Funny coincidence, I tried the ibm jvm as well and ran into a similar
> issue (part of our ssl implementation uses sun specific libraries).
>
>
> On Thu, 2010-03-11 at 12:38 +0100, Carl wrote:
> > Taylan,
> >
> > I am currently trying JVM 1.6.0_7 per Chuck's suggestion and, so far (4
> > days), it is working.
> >
> > I started down the IBM JVM path but have abandoned that for now due to
> > difficulties with the SSL implementation (somne browsers would work and some
> > wouldn't with seemingly the same setup.)
> >
> > Thanks,
> >
> > Carl
> > ----- Original Message -----
> > From: "Taylan Develioglu" <td...@ebuddy.com>
> > To: "Tomcat Users List" <us...@tomcat.apache.org>
> > Sent: Thursday, March 11, 2010 6:13 AM
> > Subject: Re: jvm exits without trace
> >
> >
> > >a different kernel did not help either...
> > >
> > > On Thu, 2010-03-11 at 11:37 +0100, Taylan Develioglu wrote:
> > >> Changing to JIO didn't help, the silent crashes continue.
> > >>
> > >> I'm changing kernel versions now.
> > >>
> > >> On Fri, 2010-03-05 at 10:45 +0100, Taylan Develioglu wrote:
> > >> > It's performing rather poorly performance wise, compared to the apr
> > >> > connector. The number of threads required to handle the requests has
> > >> > gone up significantly over the board.
> > >> >
> > >> > Stability wise, I don't have complaints yet.
> > >> >
> > >> > I'm keeping my fingers crossed.
> > >> >
> > >> > On Fri, 2010-03-05 at 10:09 +0100, Pid wrote:
> > >> > > On 05/03/2010 08:41, Taylan Develioglu wrote:
> > >> > > > Pid, that would assume we had a working< 1.6.10 version before
> > >> > > > that we
> > >> > > > replaced.
> > >> > >
> > >> > > That it would.
> > >> > >
> > >> > > > We've run 1.6.10 upwards succesfully for a very long time. So I
> > >> > > > don't
> > >> > > > see the point in doing this.
> > >> > >
> > >> > > I must have missed that.
> > >> > >
> > >> > > How is the HTTP connector performing?
> > >> > >
> > >> > >
> > >> > > p
> > >> > >
> > >> > > > On Wed, 2010-03-03 at 12:00 +0100, Pid wrote:
> > >> > > >> On 03/03/2010 09:11, Taylan Develioglu wrote:
> > >> > > >>> Downgrading to 1.6.0_16 did not help. I'm replacing the apr
> > >> > > >>> connector
> > >> > > >>> with http now.
> > >> > > >>
> > >> > > >> As Chuck mentioned in the other thread, significant changes
> > >> > > >> occurred at
> > >> > > >> 1.6.10, so trying the release before (1.6.7) might be necessary to
> > >> > > >> establish a better determination.
> > >> > > >>
> > >> > > >>
> > >> > > >> p
> > >> > > >>
> > >> > > >>> On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
> > >> > > >>>> Taylan,
> > >> > > >>>>
> > >> > > >>>>> The failures we've seen are in anywhere between 8 hours to a
> > >> > > >>>>> week of
> > >> > > >>>>> runtime.
> > >> > > >>>>
> > >> > > >>>> The timing of the failures seems similar.
> > >> > > >>>>
> > >> > > >>>>> We have also had failures with hotspot error files (hs_err)
> > >> > > >>>>> present, and
> > >> > > >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
> > >> > > >>>>
> > >> > > >>>> I have never seen any hs_* files but have seen core files where
> > >> > > >>>> strace
> > >> > > >>>> showed the jvm stopped on a seg fault.
> > >> > > >>>>
> > >> > > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to
> > >> > > >>>>> 1.6.0_16 when
> > >> > > >>>>> the situation allows (during regular updates of the
> > >> > > >>>>> application, or a
> > >> > > >>>>> crash) to see if that helps.
> > >> > > >>>>
> > >> > > >>>> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results...
> > >> > > >>>> have not
> > >> > > >>>> tried 1.6.0_16. Please post your results of this trial.
> > >> > > >>>>
> > >> > > >>>>> Running tomcat on the
> > >> > > >>>>> foreground might show something, but then again I could be
> > >> > > >>>>> waiting for a
> > >> > > >>>>> month for it to happen.
> > >> > > >>>>
> > >> > > >>>> Yes, this has been part of my problem as anytime we change
> > >> > > >>>> something, we
> > >> > > >>>> have to wait a week for the server to fail.
> > >> > > >>>>
> > >> > > >>>> In one sense, I am fortunate that I have a little more
> > >> > > >>>> flexibility than you.
> > >> > > >>>> I have two servers (different hardware) but only need one in
> > >> > > >>>> service at a
> > >> > > >>>> time. Therefore, I always have one server I can test ideas on
> > >> > > >>>> although I
> > >> > > >>>> have never been able to develop a meaningful stress test, i.e.,
> > >> > > >>>> the only way
> > >> > > >>>> I can test a change is to put it in production.
> > >> > > >>>>
> > >> > > >>>> Thanks,
> > >> > > >>>>
> > >> > > >>>> Carl
> > >> > > >>>>
> > >> > > >>>> ----- Original Message -----
> > >> > > >>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> > >> > > >>>> To: "Tomcat Users List"<us...@tomcat.apache.org>
> > >> > > >>>> Sent: Wednesday, February 24, 2010 8:31 AM
> > >> > > >>>> Subject: Re: jvm exits without trace
> > >> > > >>>>
> > >> > > >>>>
> > >> > > >>>>> Hello Carl,
> > >> > > >>>>>
> > >> > > >>>>> The failures we've seen are in anywhere between 8 hours to a
> > >> > > >>>>> week of
> > >> > > >>>>> runtime. Most of them have (still) been running for almost a
> > >> > > >>>>> month
> > >> > > >>>>> without failure. There are ~100 machines.
> > >> > > >>>>>
> > >> > > >>>>>> From the top of my head, I think we've had about 10+ failures
> > >> > > >>>>>> now.
> > >> > > >>>>>
> > >> > > >>>>> We have also had failures with hotspot error files (hs_err)
> > >> > > >>>>> present, and
> > >> > > >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
> > >> > > >>>>> But I
> > >> > > >>>>> don't know if the two are related.
> > >> > > >>>>>
> > >> > > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to
> > >> > > >>>>> 1.6.0_16 when
> > >> > > >>>>> the situation allows (during regular updates of the
> > >> > > >>>>> application, or a
> > >> > > >>>>> crash) to see if that helps.
> > >> > > >>>>>
> > >> > > >>>>> It might be useful to note that the failures happen with tomcat
> > >> > > >>>>> 6.0.20
> > >> > > >>>>> as well as 6.0.24.
> > >> > > >>>>>
> > >> > > >>>>> As far as load concerns, I haven't had a failure on an idle
> > >> > > >>>>> machines.
> > >> > > >>>>> The machines are well loaded, but only at a fraction limit in
> > >> > > >>>>> regards to
> > >> > > >>>>> load and cpu utilization.
> > >> > > >>>>> Most memory is commited to tomcat, where a 24G machine would
> > >> > > >>>>> have 18G
> > >> > > >>>>> allocated to heap, 128M to permgen and some unspecified amount
> > >> > > >>>>> would get
> > >> > > >>>>> used by jni for apr. About 4G remains free after calculating
> > >> > > >>>>> taking into
> > >> > > >>>>> account the jvm itsself.
> > >> > > >>>>> A 16G machine would have 12G allocated to the heap.
> > >> > > >>>>>
> > >> > > >>>>> Besides the fact that our apps heavily use nio and mina I
> > >> > > >>>>> wouldn't say
> > >> > > >>>>> there's anything else noteworthy. There can be anywhere up to
> > >> > > >>>>> 10000
> > >> > > >>>>> concurrents on one machine.
> > >> > > >>>>>
> > >> > > >>>>> I had searched for coredumps, but no luck. Running tomcat on
> > >> > > >>>>> the
> > >> > > >>>>> foreground might show something, but then again I could be
> > >> > > >>>>> waiting for a
> > >> > > >>>>> month for it to happen.
> > >> > > >>>>>
> > >> > > >>>>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
> > >> > > >>>>>> Taylan,
> > >> > > >>>>>>
> > >> > > >>>>>> I am the person who started the "Tomcat dies suddenly" thread
> > >> > > >>>>>> which I
> > >> > > >>>>>> still
> > >> > > >>>>>> haven't resolved. I am curious about the pattern of failures
> > >> > > >>>>>> you are
> > >> > > >>>>>> experiencing because they may provide some clues to my
> > >> > > >>>>>> problem. In my
> > >> > > >>>>>> case,
> > >> > > >>>>>> the system will run for 15 minutes to 10 days before failing
> > >> > > >>>>>> (most of the
> > >> > > >>>>>> time it is several days to a week.) It appears to die from a
> > >> > > >>>>>> seg fault
> > >> > > >>>>>> in
> > >> > > >>>>>> the JVM (I am using Sun 1.6.0_18 but have tried previous
> > >> > > >>>>>> versions)... you
> > >> > > >>>>>> may be able to see the cause of the failure from the core file
> > >> > > >>>>>> (the core
> > >> > > >>>>>> files on my systems were in several directories so you may
> > >> > > >>>>>> have to do a
> > >> > > >>>>>> 'find' to locate them.) Load may be a factor but the failures
> > >> > > >>>>>> generally
> > >> > > >>>>>> come after the load has been heavy for a while. I am running
> > >> > > >>>>>> a couple of
> > >> > > >>>>>> applications and it seems the failures are more frequent when
> > >> > > >>>>>> people are
> > >> > > >>>>>> hitting the additional apps (the primary app is always used,
> > >> > > >>>>>> the
> > >> > > >>>>>> remaining
> > >> > > >>>>>> apps are used sporatically.)
> > >> > > >>>>>>
> > >> > > >>>>>> How does this compare to what you are experiencing?
> > >> > > >>>>>>
> > >> > > >>>>>> Thanks,
> > >> > > >>>>>>
> > >> > > >>>>>> Carl
> > >> > > >>>>>>
> > >> > > >>>>>> ----- Original Message -----
> > >> > > >>>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> > >> > > >>>>>> To: "Tomcat Users
> > >> > > >>>>>> List"<us...@pidster.com>
> > >> > > >>>>>> Sent: Wednesday, February 24, 2010 5:09 AM
> > >> > > >>>>>> Subject: Re: jvm exits without trace
> > >> > > >>>>>>
> > >> > > >>>>>>
> > >> > > >>>>>>> The GC log shows plenty of heap space left in all the spaces.
> > >> > > >>>>>>>
> > >> > > >>>>>>> I purposely didn't bother replacing the variables because I
> > >> > > >>>>>>> figured
> > >> > > >>>>>>> they
> > >> > > >>>>>>> would not be relevant.
> > >> > > >>>>>>>
> > >> > > >>>>>>> But if you think they might provide clues they're as follows:
> > >> > > >>>>>>>
> > >> > > >>>>>>> JAVA_HEAP_SIZE=18432M
> > >> > > >>>>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed
> > >> > > >>>>>>> 's/M$\|G$//')/6))M
> > >> > > >>>>>>> JAVA_PERM_SIZE=128M
> > >> > > >>>>>>> JAVA_STCK_SIZE=128K
> > >> > > >>>>>>>
> > >> > > >>>>>>> EDEN_SIZE is 1/6th of total heap.
> > >> > > >>>>>>>
> > >> > > >>>>>>> And I said there was nothing in the system logs.
> > >> > > >>>>>>> But you get a couple of points for trying.
> > >> > > >>>>>>>
> > >> > > >>>>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
> > >> > > >>>>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
> > >> > > >>>>>>>>> I thought I'd add the connector definitions too, :
> > >> > > >>>>>>>>>
> > >> > > >>>>>>>>> <Connector port="80"
> > >> > > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> > >> > > >>>>>>>>> compression="1024"
> > >> > > >>>>>>>>> keepAliveTimeout="60000"
> > >> > > >>>>>>>>> maxKeepAliveRequests="-1"
> > >> > > >>>>>>>>> enableLookups="false" redirectPort="443"
> > >> > > >>>>>>>>> maxThreads="150"
> > >> > > >>>>>>>>> pollerSize="32768"
> > >> > > >>>>>>>>> pollerThreadCount="4"/>
> > >> > > >>>>>>>>>
> > >> > > >>>>>>>>> <Connector port="443"
> > >> > > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> > >> > > >>>>>>>>> SSLEnabled="true"
> > >> > > >>>>>>>>> enableLookups="false" maxThreads="10"
> > >> > > >>>>>>>>> scheme="https"
> > >> > > >>>>>>>>> secure="true"
> > >> > > >>>>>>>>>
> > >> > > >>>>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
> > >> > > >>>>>>>>>
> > >> > > >>>>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
> > >> > > >>>>>>>>>
> > >> > > >>>>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
> > >> > > >>>>>>>>>
> > >> > > >>>>>>>>>
> > >> > > >>>>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
> > >> > > >>>>>>>>>> Hi,
> > >> > > >>>>>>>>>>
> > >> > > >>>>>>>>>> I have jvm's, running tomcat and our application, exiting
> > >> > > >>>>>>>>>> mysteriously,
> > >> > > >>>>>>>>>> and was wondering if anyone could give me some advice on
> > >> > > >>>>>>>>>> how to
> > >> > > >>>>>>>>>> debug
> > >> > > >>>>>>>>>> this thing.
> > >> > > >>>>>>>>>>
> > >> > > >>>>>>>>>> There is nothing in catalina.out, nor our application
> > >> > > >>>>>>>>>> logs, and no
> > >> > > >>>>>>>>>> hotspot error file. GC log looks normal. No trace in
> > >> > > >>>>>>>>>> system logs.
> > >> > > >>>>>>>>>>
> > >> > > >>>>>>>>>> I am left completely clueless :(, has anyone dealt with a
> > >> > > >>>>>>>>>> problem
> > >> > > >>>>>>>>>> like
> > >> > > >>>>>>>>>> this before?
> > >> > > >>>>>>>>>>
> > >> > > >>>>>>>>>> Any help appreciated.
> > >> > > >>>>>>>>>>
> > >> > > >>>>>>>>>> - Tomcat 6.0.24
> > >> > > >>>>>>>>>> - TC native 1.1.18
> > >> > > >>>>>>>>>> - APR 1.3.9
> > >> > > >>>>>>>>>> - Sun JDK 6u18
> > >> > > >>>>>>>>>> - Debian Lenny, 2.6.31.10-amd64
> > >> > > >>>>>>>>>>
> > >> > > >>>>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use
> > >> > > >>>>>>>>>> TCNative/APR.
> > >> > > >>>>>>>>>>
> > >> > > >>>>>>>>>> JAVA_OPTS ( ):
> > >> > > >>>>>>>>>>
> > >> > > >>>>>>>>>> -verbose:gc
> > >> > > >>>>>>>>>> -Djava.awt.headless=true
> > >> > > >>>>>>>>>> -Dsun.net.inetaddr.ttl=60
> > >> > > >>>>>>>>>> -Dfile.encoding=UTF-8
> > >> > > >>>>>>>>>> -Djava.io.tmpdir=$TMP_DIR
> > >> > > >>>>>>>>>> -Djava.library.path=/usr/local/lib
> > >> > > >>>>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
> > >> > > >>>>>>>>>> -Dcatalina.base=$CATALINA_BASE
> > >> > > >>>>>>>>>> -Dcatalina.home=$CATALINA_HOME
> > >> > > >>>>>>>>
> > >> > >
> > >> > > >>>>>>>>>> >>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> > >> > > >>>>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
> > >> > > >>>>>>>>>> -XX:+PrintGCDetails
> > >> > > >>>>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
> > >> > > >>>>>>>>>> -XX:+UseConcMarkSweepGC
> > >> > > >>>>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
> > >> > > >>>>>>>>>> -Xms$JAVA_HEAP_SIZE
> > >> > > >>>>>>>>>> -Xmx$JAVA_HEAP_SIZE
> > >> > > >>>>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
> > >> > > >>>>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
> > >> > > >>>>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
> > >> > > >>>>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
> > >> > > >>>>>>>>>> -Xss$JAVA_STCK_SIZE
> > >> > > >>>>>>>>>> -XX:+UseLargePages
> > >> > > >>>>>>>>
> > >> > > >>>>>>>> There's no actual heap size settings in the above. But you
> > >> > > >>>>>>>> get a
> > >> > > >>>>>>>> couple
> > >> > > >>>>>>>> of points for trying.
> > >> > > >>>>>>>>
> > >> > > >>>>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then
> > >> > > >>>>>>>> check the
> > >> > > >>>>>>>> server logs carefully. (e.g. /var/log/messages)
> > >> > > >>>>>>>>
> > >> > > >>>>>>>>
> > >> > > >>>>>>>> p
> > >> > > >>>>>>>>
> > >> > > >>>>>>>>> ---------------------------------------------------------------------
> > >> > > >>>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > > >>>>>>>>> For additional commands, e-mail:
> > >> > > >>>>>>>>> users-help@tomcat.apache.org
> > >> > > >>>>>>>>>
> > >> > > >>>>>>>>
> > >> > > >>>>>>>>
> > >> > > >>>>>>>> ---------------------------------------------------------------------
> > >> > > >>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > > >>>>>>>> For additional commands, e-mail:
> > >> > > >>>>>>>> users-help@tomcat.apache.org
> > >> > > >>>>>>>>
> > >> > > >>>>>>>
> > >> > > >>>>>>>
> > >> > > >>>>>>>
> > >> > > >>>>>>> ---------------------------------------------------------------------
> > >> > > >>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > > >>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >> > > >>>>>>>
> > >> > > >>>>>>>
> > >> > > >>>>>>
> > >> > > >>>>>>
> > >> > > >>>>>> ---------------------------------------------------------------------
> > >> > > >>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > > >>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >> > > >>>>>>
> > >> > > >>>>>
> > >> > > >>>>>
> > >> > > >>>>>
> > >> > > >>>>> ---------------------------------------------------------------------
> > >> > > >>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > > >>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >> > > >>>>>
> > >> > > >>>>>
> > >> > > >>>>
> > >> > > >>>>
> > >> > > >>>> ---------------------------------------------------------------------
> > >> > > >>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > > >>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >> > > >>>>
> > >> > > >>>
> > >> > > >>>
> > >> > > >>>
> > >> > > >>> ---------------------------------------------------------------------
> > >> > > >>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > > >>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >> > > >>>
> > >> > > >>
> > >> > > >>
> > >> > > >> ---------------------------------------------------------------------
> > >> > > >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > > >> For additional commands, e-mail: users-help@tomcat.apache.org
> > >> > > >>
> > >> > > >
> > >> > > >
> > >> > >
> > >> >
> > >> >
> > >> >
> > >> > ---------------------------------------------------------------------
> > >> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> > For additional commands, e-mail: users-help@tomcat.apache.org
> > >> >
> > >>
> > >>
> > >>
> > >> ---------------------------------------------------------------------
> > >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>
> > >
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > For additional commands, e-mail: users-help@tomcat.apache.org
> > >
> > >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > For additional commands, e-mail: users-help@tomcat.apache.org
> >
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
Hi Carl, thanks for the suggestion. I am going to try jvm 1.6.07
regardless of what I said before.
Funny coincidence, I tried the ibm jvm as well and ran into a similar
issue (part of our ssl implementation uses sun specific libraries).
On Thu, 2010-03-11 at 12:38 +0100, Carl wrote:
> Taylan,
>
> I am currently trying JVM 1.6.0_7 per Chuck's suggestion and, so far (4
> days), it is working.
>
> I started down the IBM JVM path but have abandoned that for now due to
> difficulties with the SSL implementation (somne browsers would work and some
> wouldn't with seemingly the same setup.)
>
> Thanks,
>
> Carl
> ----- Original Message -----
> From: "Taylan Develioglu" <td...@ebuddy.com>
> To: "Tomcat Users List" <us...@tomcat.apache.org>
> Sent: Thursday, March 11, 2010 6:13 AM
> Subject: Re: jvm exits without trace
>
>
> >a different kernel did not help either...
> >
> > On Thu, 2010-03-11 at 11:37 +0100, Taylan Develioglu wrote:
> >> Changing to JIO didn't help, the silent crashes continue.
> >>
> >> I'm changing kernel versions now.
> >>
> >> On Fri, 2010-03-05 at 10:45 +0100, Taylan Develioglu wrote:
> >> > It's performing rather poorly performance wise, compared to the apr
> >> > connector. The number of threads required to handle the requests has
> >> > gone up significantly over the board.
> >> >
> >> > Stability wise, I don't have complaints yet.
> >> >
> >> > I'm keeping my fingers crossed.
> >> >
> >> > On Fri, 2010-03-05 at 10:09 +0100, Pid wrote:
> >> > > On 05/03/2010 08:41, Taylan Develioglu wrote:
> >> > > > Pid, that would assume we had a working< 1.6.10 version before
> >> > > > that we
> >> > > > replaced.
> >> > >
> >> > > That it would.
> >> > >
> >> > > > We've run 1.6.10 upwards succesfully for a very long time. So I
> >> > > > don't
> >> > > > see the point in doing this.
> >> > >
> >> > > I must have missed that.
> >> > >
> >> > > How is the HTTP connector performing?
> >> > >
> >> > >
> >> > > p
> >> > >
> >> > > > On Wed, 2010-03-03 at 12:00 +0100, Pid wrote:
> >> > > >> On 03/03/2010 09:11, Taylan Develioglu wrote:
> >> > > >>> Downgrading to 1.6.0_16 did not help. I'm replacing the apr
> >> > > >>> connector
> >> > > >>> with http now.
> >> > > >>
> >> > > >> As Chuck mentioned in the other thread, significant changes
> >> > > >> occurred at
> >> > > >> 1.6.10, so trying the release before (1.6.7) might be necessary to
> >> > > >> establish a better determination.
> >> > > >>
> >> > > >>
> >> > > >> p
> >> > > >>
> >> > > >>> On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
> >> > > >>>> Taylan,
> >> > > >>>>
> >> > > >>>>> The failures we've seen are in anywhere between 8 hours to a
> >> > > >>>>> week of
> >> > > >>>>> runtime.
> >> > > >>>>
> >> > > >>>> The timing of the failures seems similar.
> >> > > >>>>
> >> > > >>>>> We have also had failures with hotspot error files (hs_err)
> >> > > >>>>> present, and
> >> > > >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
> >> > > >>>>
> >> > > >>>> I have never seen any hs_* files but have seen core files where
> >> > > >>>> strace
> >> > > >>>> showed the jvm stopped on a seg fault.
> >> > > >>>>
> >> > > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to
> >> > > >>>>> 1.6.0_16 when
> >> > > >>>>> the situation allows (during regular updates of the
> >> > > >>>>> application, or a
> >> > > >>>>> crash) to see if that helps.
> >> > > >>>>
> >> > > >>>> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results...
> >> > > >>>> have not
> >> > > >>>> tried 1.6.0_16. Please post your results of this trial.
> >> > > >>>>
> >> > > >>>>> Running tomcat on the
> >> > > >>>>> foreground might show something, but then again I could be
> >> > > >>>>> waiting for a
> >> > > >>>>> month for it to happen.
> >> > > >>>>
> >> > > >>>> Yes, this has been part of my problem as anytime we change
> >> > > >>>> something, we
> >> > > >>>> have to wait a week for the server to fail.
> >> > > >>>>
> >> > > >>>> In one sense, I am fortunate that I have a little more
> >> > > >>>> flexibility than you.
> >> > > >>>> I have two servers (different hardware) but only need one in
> >> > > >>>> service at a
> >> > > >>>> time. Therefore, I always have one server I can test ideas on
> >> > > >>>> although I
> >> > > >>>> have never been able to develop a meaningful stress test, i.e.,
> >> > > >>>> the only way
> >> > > >>>> I can test a change is to put it in production.
> >> > > >>>>
> >> > > >>>> Thanks,
> >> > > >>>>
> >> > > >>>> Carl
> >> > > >>>>
> >> > > >>>> ----- Original Message -----
> >> > > >>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> >> > > >>>> To: "Tomcat Users List"<us...@tomcat.apache.org>
> >> > > >>>> Sent: Wednesday, February 24, 2010 8:31 AM
> >> > > >>>> Subject: Re: jvm exits without trace
> >> > > >>>>
> >> > > >>>>
> >> > > >>>>> Hello Carl,
> >> > > >>>>>
> >> > > >>>>> The failures we've seen are in anywhere between 8 hours to a
> >> > > >>>>> week of
> >> > > >>>>> runtime. Most of them have (still) been running for almost a
> >> > > >>>>> month
> >> > > >>>>> without failure. There are ~100 machines.
> >> > > >>>>>
> >> > > >>>>>> From the top of my head, I think we've had about 10+ failures
> >> > > >>>>>> now.
> >> > > >>>>>
> >> > > >>>>> We have also had failures with hotspot error files (hs_err)
> >> > > >>>>> present, and
> >> > > >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
> >> > > >>>>> But I
> >> > > >>>>> don't know if the two are related.
> >> > > >>>>>
> >> > > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to
> >> > > >>>>> 1.6.0_16 when
> >> > > >>>>> the situation allows (during regular updates of the
> >> > > >>>>> application, or a
> >> > > >>>>> crash) to see if that helps.
> >> > > >>>>>
> >> > > >>>>> It might be useful to note that the failures happen with tomcat
> >> > > >>>>> 6.0.20
> >> > > >>>>> as well as 6.0.24.
> >> > > >>>>>
> >> > > >>>>> As far as load concerns, I haven't had a failure on an idle
> >> > > >>>>> machines.
> >> > > >>>>> The machines are well loaded, but only at a fraction limit in
> >> > > >>>>> regards to
> >> > > >>>>> load and cpu utilization.
> >> > > >>>>> Most memory is commited to tomcat, where a 24G machine would
> >> > > >>>>> have 18G
> >> > > >>>>> allocated to heap, 128M to permgen and some unspecified amount
> >> > > >>>>> would get
> >> > > >>>>> used by jni for apr. About 4G remains free after calculating
> >> > > >>>>> taking into
> >> > > >>>>> account the jvm itsself.
> >> > > >>>>> A 16G machine would have 12G allocated to the heap.
> >> > > >>>>>
> >> > > >>>>> Besides the fact that our apps heavily use nio and mina I
> >> > > >>>>> wouldn't say
> >> > > >>>>> there's anything else noteworthy. There can be anywhere up to
> >> > > >>>>> 10000
> >> > > >>>>> concurrents on one machine.
> >> > > >>>>>
> >> > > >>>>> I had searched for coredumps, but no luck. Running tomcat on
> >> > > >>>>> the
> >> > > >>>>> foreground might show something, but then again I could be
> >> > > >>>>> waiting for a
> >> > > >>>>> month for it to happen.
> >> > > >>>>>
> >> > > >>>>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
> >> > > >>>>>> Taylan,
> >> > > >>>>>>
> >> > > >>>>>> I am the person who started the "Tomcat dies suddenly" thread
> >> > > >>>>>> which I
> >> > > >>>>>> still
> >> > > >>>>>> haven't resolved. I am curious about the pattern of failures
> >> > > >>>>>> you are
> >> > > >>>>>> experiencing because they may provide some clues to my
> >> > > >>>>>> problem. In my
> >> > > >>>>>> case,
> >> > > >>>>>> the system will run for 15 minutes to 10 days before failing
> >> > > >>>>>> (most of the
> >> > > >>>>>> time it is several days to a week.) It appears to die from a
> >> > > >>>>>> seg fault
> >> > > >>>>>> in
> >> > > >>>>>> the JVM (I am using Sun 1.6.0_18 but have tried previous
> >> > > >>>>>> versions)... you
> >> > > >>>>>> may be able to see the cause of the failure from the core file
> >> > > >>>>>> (the core
> >> > > >>>>>> files on my systems were in several directories so you may
> >> > > >>>>>> have to do a
> >> > > >>>>>> 'find' to locate them.) Load may be a factor but the failures
> >> > > >>>>>> generally
> >> > > >>>>>> come after the load has been heavy for a while. I am running
> >> > > >>>>>> a couple of
> >> > > >>>>>> applications and it seems the failures are more frequent when
> >> > > >>>>>> people are
> >> > > >>>>>> hitting the additional apps (the primary app is always used,
> >> > > >>>>>> the
> >> > > >>>>>> remaining
> >> > > >>>>>> apps are used sporatically.)
> >> > > >>>>>>
> >> > > >>>>>> How does this compare to what you are experiencing?
> >> > > >>>>>>
> >> > > >>>>>> Thanks,
> >> > > >>>>>>
> >> > > >>>>>> Carl
> >> > > >>>>>>
> >> > > >>>>>> ----- Original Message -----
> >> > > >>>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> >> > > >>>>>> To: "Tomcat Users
> >> > > >>>>>> List"<us...@pidster.com>
> >> > > >>>>>> Sent: Wednesday, February 24, 2010 5:09 AM
> >> > > >>>>>> Subject: Re: jvm exits without trace
> >> > > >>>>>>
> >> > > >>>>>>
> >> > > >>>>>>> The GC log shows plenty of heap space left in all the spaces.
> >> > > >>>>>>>
> >> > > >>>>>>> I purposely didn't bother replacing the variables because I
> >> > > >>>>>>> figured
> >> > > >>>>>>> they
> >> > > >>>>>>> would not be relevant.
> >> > > >>>>>>>
> >> > > >>>>>>> But if you think they might provide clues they're as follows:
> >> > > >>>>>>>
> >> > > >>>>>>> JAVA_HEAP_SIZE=18432M
> >> > > >>>>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed
> >> > > >>>>>>> 's/M$\|G$//')/6))M
> >> > > >>>>>>> JAVA_PERM_SIZE=128M
> >> > > >>>>>>> JAVA_STCK_SIZE=128K
> >> > > >>>>>>>
> >> > > >>>>>>> EDEN_SIZE is 1/6th of total heap.
> >> > > >>>>>>>
> >> > > >>>>>>> And I said there was nothing in the system logs.
> >> > > >>>>>>> But you get a couple of points for trying.
> >> > > >>>>>>>
> >> > > >>>>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
> >> > > >>>>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
> >> > > >>>>>>>>> I thought I'd add the connector definitions too, :
> >> > > >>>>>>>>>
> >> > > >>>>>>>>> <Connector port="80"
> >> > > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> >> > > >>>>>>>>> compression="1024"
> >> > > >>>>>>>>> keepAliveTimeout="60000"
> >> > > >>>>>>>>> maxKeepAliveRequests="-1"
> >> > > >>>>>>>>> enableLookups="false" redirectPort="443"
> >> > > >>>>>>>>> maxThreads="150"
> >> > > >>>>>>>>> pollerSize="32768"
> >> > > >>>>>>>>> pollerThreadCount="4"/>
> >> > > >>>>>>>>>
> >> > > >>>>>>>>> <Connector port="443"
> >> > > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> >> > > >>>>>>>>> SSLEnabled="true"
> >> > > >>>>>>>>> enableLookups="false" maxThreads="10"
> >> > > >>>>>>>>> scheme="https"
> >> > > >>>>>>>>> secure="true"
> >> > > >>>>>>>>>
> >> > > >>>>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
> >> > > >>>>>>>>>
> >> > > >>>>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
> >> > > >>>>>>>>>
> >> > > >>>>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
> >> > > >>>>>>>>>
> >> > > >>>>>>>>>
> >> > > >>>>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
> >> > > >>>>>>>>>> Hi,
> >> > > >>>>>>>>>>
> >> > > >>>>>>>>>> I have jvm's, running tomcat and our application, exiting
> >> > > >>>>>>>>>> mysteriously,
> >> > > >>>>>>>>>> and was wondering if anyone could give me some advice on
> >> > > >>>>>>>>>> how to
> >> > > >>>>>>>>>> debug
> >> > > >>>>>>>>>> this thing.
> >> > > >>>>>>>>>>
> >> > > >>>>>>>>>> There is nothing in catalina.out, nor our application
> >> > > >>>>>>>>>> logs, and no
> >> > > >>>>>>>>>> hotspot error file. GC log looks normal. No trace in
> >> > > >>>>>>>>>> system logs.
> >> > > >>>>>>>>>>
> >> > > >>>>>>>>>> I am left completely clueless :(, has anyone dealt with a
> >> > > >>>>>>>>>> problem
> >> > > >>>>>>>>>> like
> >> > > >>>>>>>>>> this before?
> >> > > >>>>>>>>>>
> >> > > >>>>>>>>>> Any help appreciated.
> >> > > >>>>>>>>>>
> >> > > >>>>>>>>>> - Tomcat 6.0.24
> >> > > >>>>>>>>>> - TC native 1.1.18
> >> > > >>>>>>>>>> - APR 1.3.9
> >> > > >>>>>>>>>> - Sun JDK 6u18
> >> > > >>>>>>>>>> - Debian Lenny, 2.6.31.10-amd64
> >> > > >>>>>>>>>>
> >> > > >>>>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use
> >> > > >>>>>>>>>> TCNative/APR.
> >> > > >>>>>>>>>>
> >> > > >>>>>>>>>> JAVA_OPTS ( ):
> >> > > >>>>>>>>>>
> >> > > >>>>>>>>>> -verbose:gc
> >> > > >>>>>>>>>> -Djava.awt.headless=true
> >> > > >>>>>>>>>> -Dsun.net.inetaddr.ttl=60
> >> > > >>>>>>>>>> -Dfile.encoding=UTF-8
> >> > > >>>>>>>>>> -Djava.io.tmpdir=$TMP_DIR
> >> > > >>>>>>>>>> -Djava.library.path=/usr/local/lib
> >> > > >>>>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
> >> > > >>>>>>>>>> -Dcatalina.base=$CATALINA_BASE
> >> > > >>>>>>>>>> -Dcatalina.home=$CATALINA_HOME
> >> > > >>>>>>>>
> >> > >
> >> > > >>>>>>>>>> >>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> >> > > >>>>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
> >> > > >>>>>>>>>> -XX:+PrintGCDetails
> >> > > >>>>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
> >> > > >>>>>>>>>> -XX:+UseConcMarkSweepGC
> >> > > >>>>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
> >> > > >>>>>>>>>> -Xms$JAVA_HEAP_SIZE
> >> > > >>>>>>>>>> -Xmx$JAVA_HEAP_SIZE
> >> > > >>>>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
> >> > > >>>>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
> >> > > >>>>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
> >> > > >>>>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
> >> > > >>>>>>>>>> -Xss$JAVA_STCK_SIZE
> >> > > >>>>>>>>>> -XX:+UseLargePages
> >> > > >>>>>>>>
> >> > > >>>>>>>> There's no actual heap size settings in the above. But you
> >> > > >>>>>>>> get a
> >> > > >>>>>>>> couple
> >> > > >>>>>>>> of points for trying.
> >> > > >>>>>>>>
> >> > > >>>>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then
> >> > > >>>>>>>> check the
> >> > > >>>>>>>> server logs carefully. (e.g. /var/log/messages)
> >> > > >>>>>>>>
> >> > > >>>>>>>>
> >> > > >>>>>>>> p
> >> > > >>>>>>>>
> >> > > >>>>>>>>> ---------------------------------------------------------------------
> >> > > >>>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > > >>>>>>>>> For additional commands, e-mail:
> >> > > >>>>>>>>> users-help@tomcat.apache.org
> >> > > >>>>>>>>>
> >> > > >>>>>>>>
> >> > > >>>>>>>>
> >> > > >>>>>>>> ---------------------------------------------------------------------
> >> > > >>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > > >>>>>>>> For additional commands, e-mail:
> >> > > >>>>>>>> users-help@tomcat.apache.org
> >> > > >>>>>>>>
> >> > > >>>>>>>
> >> > > >>>>>>>
> >> > > >>>>>>>
> >> > > >>>>>>> ---------------------------------------------------------------------
> >> > > >>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > > >>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >> > > >>>>>>>
> >> > > >>>>>>>
> >> > > >>>>>>
> >> > > >>>>>>
> >> > > >>>>>> ---------------------------------------------------------------------
> >> > > >>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > > >>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >> > > >>>>>>
> >> > > >>>>>
> >> > > >>>>>
> >> > > >>>>>
> >> > > >>>>> ---------------------------------------------------------------------
> >> > > >>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > > >>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >> > > >>>>>
> >> > > >>>>>
> >> > > >>>>
> >> > > >>>>
> >> > > >>>> ---------------------------------------------------------------------
> >> > > >>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > > >>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >> > > >>>>
> >> > > >>>
> >> > > >>>
> >> > > >>>
> >> > > >>> ---------------------------------------------------------------------
> >> > > >>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > > >>> For additional commands, e-mail: users-help@tomcat.apache.org
> >> > > >>>
> >> > > >>
> >> > > >>
> >> > > >> ---------------------------------------------------------------------
> >> > > >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > > >> For additional commands, e-mail: users-help@tomcat.apache.org
> >> > > >>
> >> > > >
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > ---------------------------------------------------------------------
> >> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> > For additional commands, e-mail: users-help@tomcat.apache.org
> >> >
> >>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> For additional commands, e-mail: users-help@tomcat.apache.org
> >>
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > For additional commands, e-mail: users-help@tomcat.apache.org
> >
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Carl <ca...@etrak-plus.com>.
Taylan,
I am currently trying JVM 1.6.0_7 per Chuck's suggestion and, so far (4
days), it is working.
I started down the IBM JVM path but have abandoned that for now due to
difficulties with the SSL implementation (somne browsers would work and some
wouldn't with seemingly the same setup.)
Thanks,
Carl
----- Original Message -----
From: "Taylan Develioglu" <td...@ebuddy.com>
To: "Tomcat Users List" <us...@tomcat.apache.org>
Sent: Thursday, March 11, 2010 6:13 AM
Subject: Re: jvm exits without trace
>a different kernel did not help either...
>
> On Thu, 2010-03-11 at 11:37 +0100, Taylan Develioglu wrote:
>> Changing to JIO didn't help, the silent crashes continue.
>>
>> I'm changing kernel versions now.
>>
>> On Fri, 2010-03-05 at 10:45 +0100, Taylan Develioglu wrote:
>> > It's performing rather poorly performance wise, compared to the apr
>> > connector. The number of threads required to handle the requests has
>> > gone up significantly over the board.
>> >
>> > Stability wise, I don't have complaints yet.
>> >
>> > I'm keeping my fingers crossed.
>> >
>> > On Fri, 2010-03-05 at 10:09 +0100, Pid wrote:
>> > > On 05/03/2010 08:41, Taylan Develioglu wrote:
>> > > > Pid, that would assume we had a working< 1.6.10 version before
>> > > > that we
>> > > > replaced.
>> > >
>> > > That it would.
>> > >
>> > > > We've run 1.6.10 upwards succesfully for a very long time. So I
>> > > > don't
>> > > > see the point in doing this.
>> > >
>> > > I must have missed that.
>> > >
>> > > How is the HTTP connector performing?
>> > >
>> > >
>> > > p
>> > >
>> > > > On Wed, 2010-03-03 at 12:00 +0100, Pid wrote:
>> > > >> On 03/03/2010 09:11, Taylan Develioglu wrote:
>> > > >>> Downgrading to 1.6.0_16 did not help. I'm replacing the apr
>> > > >>> connector
>> > > >>> with http now.
>> > > >>
>> > > >> As Chuck mentioned in the other thread, significant changes
>> > > >> occurred at
>> > > >> 1.6.10, so trying the release before (1.6.7) might be necessary to
>> > > >> establish a better determination.
>> > > >>
>> > > >>
>> > > >> p
>> > > >>
>> > > >>> On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
>> > > >>>> Taylan,
>> > > >>>>
>> > > >>>>> The failures we've seen are in anywhere between 8 hours to a
>> > > >>>>> week of
>> > > >>>>> runtime.
>> > > >>>>
>> > > >>>> The timing of the failures seems similar.
>> > > >>>>
>> > > >>>>> We have also had failures with hotspot error files (hs_err)
>> > > >>>>> present, and
>> > > >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
>> > > >>>>
>> > > >>>> I have never seen any hs_* files but have seen core files where
>> > > >>>> strace
>> > > >>>> showed the jvm stopped on a seg fault.
>> > > >>>>
>> > > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to
>> > > >>>>> 1.6.0_16 when
>> > > >>>>> the situation allows (during regular updates of the
>> > > >>>>> application, or a
>> > > >>>>> crash) to see if that helps.
>> > > >>>>
>> > > >>>> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results...
>> > > >>>> have not
>> > > >>>> tried 1.6.0_16. Please post your results of this trial.
>> > > >>>>
>> > > >>>>> Running tomcat on the
>> > > >>>>> foreground might show something, but then again I could be
>> > > >>>>> waiting for a
>> > > >>>>> month for it to happen.
>> > > >>>>
>> > > >>>> Yes, this has been part of my problem as anytime we change
>> > > >>>> something, we
>> > > >>>> have to wait a week for the server to fail.
>> > > >>>>
>> > > >>>> In one sense, I am fortunate that I have a little more
>> > > >>>> flexibility than you.
>> > > >>>> I have two servers (different hardware) but only need one in
>> > > >>>> service at a
>> > > >>>> time. Therefore, I always have one server I can test ideas on
>> > > >>>> although I
>> > > >>>> have never been able to develop a meaningful stress test, i.e.,
>> > > >>>> the only way
>> > > >>>> I can test a change is to put it in production.
>> > > >>>>
>> > > >>>> Thanks,
>> > > >>>>
>> > > >>>> Carl
>> > > >>>>
>> > > >>>> ----- Original Message -----
>> > > >>>> From: "Taylan Develioglu"<td...@ebuddy.com>
>> > > >>>> To: "Tomcat Users List"<us...@tomcat.apache.org>
>> > > >>>> Sent: Wednesday, February 24, 2010 8:31 AM
>> > > >>>> Subject: Re: jvm exits without trace
>> > > >>>>
>> > > >>>>
>> > > >>>>> Hello Carl,
>> > > >>>>>
>> > > >>>>> The failures we've seen are in anywhere between 8 hours to a
>> > > >>>>> week of
>> > > >>>>> runtime. Most of them have (still) been running for almost a
>> > > >>>>> month
>> > > >>>>> without failure. There are ~100 machines.
>> > > >>>>>
>> > > >>>>>> From the top of my head, I think we've had about 10+ failures
>> > > >>>>>> now.
>> > > >>>>>
>> > > >>>>> We have also had failures with hotspot error files (hs_err)
>> > > >>>>> present, and
>> > > >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
>> > > >>>>> But I
>> > > >>>>> don't know if the two are related.
>> > > >>>>>
>> > > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to
>> > > >>>>> 1.6.0_16 when
>> > > >>>>> the situation allows (during regular updates of the
>> > > >>>>> application, or a
>> > > >>>>> crash) to see if that helps.
>> > > >>>>>
>> > > >>>>> It might be useful to note that the failures happen with tomcat
>> > > >>>>> 6.0.20
>> > > >>>>> as well as 6.0.24.
>> > > >>>>>
>> > > >>>>> As far as load concerns, I haven't had a failure on an idle
>> > > >>>>> machines.
>> > > >>>>> The machines are well loaded, but only at a fraction limit in
>> > > >>>>> regards to
>> > > >>>>> load and cpu utilization.
>> > > >>>>> Most memory is commited to tomcat, where a 24G machine would
>> > > >>>>> have 18G
>> > > >>>>> allocated to heap, 128M to permgen and some unspecified amount
>> > > >>>>> would get
>> > > >>>>> used by jni for apr. About 4G remains free after calculating
>> > > >>>>> taking into
>> > > >>>>> account the jvm itsself.
>> > > >>>>> A 16G machine would have 12G allocated to the heap.
>> > > >>>>>
>> > > >>>>> Besides the fact that our apps heavily use nio and mina I
>> > > >>>>> wouldn't say
>> > > >>>>> there's anything else noteworthy. There can be anywhere up to
>> > > >>>>> 10000
>> > > >>>>> concurrents on one machine.
>> > > >>>>>
>> > > >>>>> I had searched for coredumps, but no luck. Running tomcat on
>> > > >>>>> the
>> > > >>>>> foreground might show something, but then again I could be
>> > > >>>>> waiting for a
>> > > >>>>> month for it to happen.
>> > > >>>>>
>> > > >>>>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
>> > > >>>>>> Taylan,
>> > > >>>>>>
>> > > >>>>>> I am the person who started the "Tomcat dies suddenly" thread
>> > > >>>>>> which I
>> > > >>>>>> still
>> > > >>>>>> haven't resolved. I am curious about the pattern of failures
>> > > >>>>>> you are
>> > > >>>>>> experiencing because they may provide some clues to my
>> > > >>>>>> problem. In my
>> > > >>>>>> case,
>> > > >>>>>> the system will run for 15 minutes to 10 days before failing
>> > > >>>>>> (most of the
>> > > >>>>>> time it is several days to a week.) It appears to die from a
>> > > >>>>>> seg fault
>> > > >>>>>> in
>> > > >>>>>> the JVM (I am using Sun 1.6.0_18 but have tried previous
>> > > >>>>>> versions)... you
>> > > >>>>>> may be able to see the cause of the failure from the core file
>> > > >>>>>> (the core
>> > > >>>>>> files on my systems were in several directories so you may
>> > > >>>>>> have to do a
>> > > >>>>>> 'find' to locate them.) Load may be a factor but the failures
>> > > >>>>>> generally
>> > > >>>>>> come after the load has been heavy for a while. I am running
>> > > >>>>>> a couple of
>> > > >>>>>> applications and it seems the failures are more frequent when
>> > > >>>>>> people are
>> > > >>>>>> hitting the additional apps (the primary app is always used,
>> > > >>>>>> the
>> > > >>>>>> remaining
>> > > >>>>>> apps are used sporatically.)
>> > > >>>>>>
>> > > >>>>>> How does this compare to what you are experiencing?
>> > > >>>>>>
>> > > >>>>>> Thanks,
>> > > >>>>>>
>> > > >>>>>> Carl
>> > > >>>>>>
>> > > >>>>>> ----- Original Message -----
>> > > >>>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
>> > > >>>>>> To: "Tomcat Users
>> > > >>>>>> List"<us...@pidster.com>
>> > > >>>>>> Sent: Wednesday, February 24, 2010 5:09 AM
>> > > >>>>>> Subject: Re: jvm exits without trace
>> > > >>>>>>
>> > > >>>>>>
>> > > >>>>>>> The GC log shows plenty of heap space left in all the spaces.
>> > > >>>>>>>
>> > > >>>>>>> I purposely didn't bother replacing the variables because I
>> > > >>>>>>> figured
>> > > >>>>>>> they
>> > > >>>>>>> would not be relevant.
>> > > >>>>>>>
>> > > >>>>>>> But if you think they might provide clues they're as follows:
>> > > >>>>>>>
>> > > >>>>>>> JAVA_HEAP_SIZE=18432M
>> > > >>>>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed
>> > > >>>>>>> 's/M$\|G$//')/6))M
>> > > >>>>>>> JAVA_PERM_SIZE=128M
>> > > >>>>>>> JAVA_STCK_SIZE=128K
>> > > >>>>>>>
>> > > >>>>>>> EDEN_SIZE is 1/6th of total heap.
>> > > >>>>>>>
>> > > >>>>>>> And I said there was nothing in the system logs.
>> > > >>>>>>> But you get a couple of points for trying.
>> > > >>>>>>>
>> > > >>>>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
>> > > >>>>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
>> > > >>>>>>>>> I thought I'd add the connector definitions too, :
>> > > >>>>>>>>>
>> > > >>>>>>>>> <Connector port="80"
>> > > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
>> > > >>>>>>>>> compression="1024"
>> > > >>>>>>>>> keepAliveTimeout="60000"
>> > > >>>>>>>>> maxKeepAliveRequests="-1"
>> > > >>>>>>>>> enableLookups="false" redirectPort="443"
>> > > >>>>>>>>> maxThreads="150"
>> > > >>>>>>>>> pollerSize="32768"
>> > > >>>>>>>>> pollerThreadCount="4"/>
>> > > >>>>>>>>>
>> > > >>>>>>>>> <Connector port="443"
>> > > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
>> > > >>>>>>>>> SSLEnabled="true"
>> > > >>>>>>>>> enableLookups="false" maxThreads="10"
>> > > >>>>>>>>> scheme="https"
>> > > >>>>>>>>> secure="true"
>> > > >>>>>>>>>
>> > > >>>>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
>> > > >>>>>>>>>
>> > > >>>>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
>> > > >>>>>>>>>
>> > > >>>>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
>> > > >>>>>>>>>
>> > > >>>>>>>>>
>> > > >>>>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
>> > > >>>>>>>>>> Hi,
>> > > >>>>>>>>>>
>> > > >>>>>>>>>> I have jvm's, running tomcat and our application, exiting
>> > > >>>>>>>>>> mysteriously,
>> > > >>>>>>>>>> and was wondering if anyone could give me some advice on
>> > > >>>>>>>>>> how to
>> > > >>>>>>>>>> debug
>> > > >>>>>>>>>> this thing.
>> > > >>>>>>>>>>
>> > > >>>>>>>>>> There is nothing in catalina.out, nor our application
>> > > >>>>>>>>>> logs, and no
>> > > >>>>>>>>>> hotspot error file. GC log looks normal. No trace in
>> > > >>>>>>>>>> system logs.
>> > > >>>>>>>>>>
>> > > >>>>>>>>>> I am left completely clueless :(, has anyone dealt with a
>> > > >>>>>>>>>> problem
>> > > >>>>>>>>>> like
>> > > >>>>>>>>>> this before?
>> > > >>>>>>>>>>
>> > > >>>>>>>>>> Any help appreciated.
>> > > >>>>>>>>>>
>> > > >>>>>>>>>> - Tomcat 6.0.24
>> > > >>>>>>>>>> - TC native 1.1.18
>> > > >>>>>>>>>> - APR 1.3.9
>> > > >>>>>>>>>> - Sun JDK 6u18
>> > > >>>>>>>>>> - Debian Lenny, 2.6.31.10-amd64
>> > > >>>>>>>>>>
>> > > >>>>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use
>> > > >>>>>>>>>> TCNative/APR.
>> > > >>>>>>>>>>
>> > > >>>>>>>>>> JAVA_OPTS ( ):
>> > > >>>>>>>>>>
>> > > >>>>>>>>>> -verbose:gc
>> > > >>>>>>>>>> -Djava.awt.headless=true
>> > > >>>>>>>>>> -Dsun.net.inetaddr.ttl=60
>> > > >>>>>>>>>> -Dfile.encoding=UTF-8
>> > > >>>>>>>>>> -Djava.io.tmpdir=$TMP_DIR
>> > > >>>>>>>>>> -Djava.library.path=/usr/local/lib
>> > > >>>>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
>> > > >>>>>>>>>> -Dcatalina.base=$CATALINA_BASE
>> > > >>>>>>>>>> -Dcatalina.home=$CATALINA_HOME
>> > > >>>>>>>>
>> > >
>> > > >>>>>>>>>> >>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
>> > > >>>>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
>> > > >>>>>>>>>> -XX:+PrintGCDetails
>> > > >>>>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
>> > > >>>>>>>>>> -XX:+UseConcMarkSweepGC
>> > > >>>>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
>> > > >>>>>>>>>> -Xms$JAVA_HEAP_SIZE
>> > > >>>>>>>>>> -Xmx$JAVA_HEAP_SIZE
>> > > >>>>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
>> > > >>>>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
>> > > >>>>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
>> > > >>>>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
>> > > >>>>>>>>>> -Xss$JAVA_STCK_SIZE
>> > > >>>>>>>>>> -XX:+UseLargePages
>> > > >>>>>>>>
>> > > >>>>>>>> There's no actual heap size settings in the above. But you
>> > > >>>>>>>> get a
>> > > >>>>>>>> couple
>> > > >>>>>>>> of points for trying.
>> > > >>>>>>>>
>> > > >>>>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then
>> > > >>>>>>>> check the
>> > > >>>>>>>> server logs carefully. (e.g. /var/log/messages)
>> > > >>>>>>>>
>> > > >>>>>>>>
>> > > >>>>>>>> p
>> > > >>>>>>>>
>> > > >>>>>>>>> ---------------------------------------------------------------------
>> > > >>>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > > >>>>>>>>> For additional commands, e-mail:
>> > > >>>>>>>>> users-help@tomcat.apache.org
>> > > >>>>>>>>>
>> > > >>>>>>>>
>> > > >>>>>>>>
>> > > >>>>>>>> ---------------------------------------------------------------------
>> > > >>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > > >>>>>>>> For additional commands, e-mail:
>> > > >>>>>>>> users-help@tomcat.apache.org
>> > > >>>>>>>>
>> > > >>>>>>>
>> > > >>>>>>>
>> > > >>>>>>>
>> > > >>>>>>> ---------------------------------------------------------------------
>> > > >>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > > >>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>> > > >>>>>>>
>> > > >>>>>>>
>> > > >>>>>>
>> > > >>>>>>
>> > > >>>>>> ---------------------------------------------------------------------
>> > > >>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > > >>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>> > > >>>>>>
>> > > >>>>>
>> > > >>>>>
>> > > >>>>>
>> > > >>>>> ---------------------------------------------------------------------
>> > > >>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > > >>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>> > > >>>>>
>> > > >>>>>
>> > > >>>>
>> > > >>>>
>> > > >>>> ---------------------------------------------------------------------
>> > > >>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > > >>>> For additional commands, e-mail: users-help@tomcat.apache.org
>> > > >>>>
>> > > >>>
>> > > >>>
>> > > >>>
>> > > >>> ---------------------------------------------------------------------
>> > > >>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > > >>> For additional commands, e-mail: users-help@tomcat.apache.org
>> > > >>>
>> > > >>
>> > > >>
>> > > >> ---------------------------------------------------------------------
>> > > >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > > >> For additional commands, e-mail: users-help@tomcat.apache.org
>> > > >>
>> > > >
>> > > >
>> > >
>> >
>> >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> > For additional commands, e-mail: users-help@tomcat.apache.org
>> >
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> For additional commands, e-mail: users-help@tomcat.apache.org
>>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
a different kernel did not help either...
On Thu, 2010-03-11 at 11:37 +0100, Taylan Develioglu wrote:
> Changing to JIO didn't help, the silent crashes continue.
>
> I'm changing kernel versions now.
>
> On Fri, 2010-03-05 at 10:45 +0100, Taylan Develioglu wrote:
> > It's performing rather poorly performance wise, compared to the apr
> > connector. The number of threads required to handle the requests has
> > gone up significantly over the board.
> >
> > Stability wise, I don't have complaints yet.
> >
> > I'm keeping my fingers crossed.
> >
> > On Fri, 2010-03-05 at 10:09 +0100, Pid wrote:
> > > On 05/03/2010 08:41, Taylan Develioglu wrote:
> > > > Pid, that would assume we had a working< 1.6.10 version before that we
> > > > replaced.
> > >
> > > That it would.
> > >
> > > > We've run 1.6.10 upwards succesfully for a very long time. So I don't
> > > > see the point in doing this.
> > >
> > > I must have missed that.
> > >
> > > How is the HTTP connector performing?
> > >
> > >
> > > p
> > >
> > > > On Wed, 2010-03-03 at 12:00 +0100, Pid wrote:
> > > >> On 03/03/2010 09:11, Taylan Develioglu wrote:
> > > >>> Downgrading to 1.6.0_16 did not help. I'm replacing the apr connector
> > > >>> with http now.
> > > >>
> > > >> As Chuck mentioned in the other thread, significant changes occurred at
> > > >> 1.6.10, so trying the release before (1.6.7) might be necessary to
> > > >> establish a better determination.
> > > >>
> > > >>
> > > >> p
> > > >>
> > > >>> On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
> > > >>>> Taylan,
> > > >>>>
> > > >>>>> The failures we've seen are in anywhere between 8 hours to a week of
> > > >>>>> runtime.
> > > >>>>
> > > >>>> The timing of the failures seems similar.
> > > >>>>
> > > >>>>> We have also had failures with hotspot error files (hs_err) present, and
> > > >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
> > > >>>>
> > > >>>> I have never seen any hs_* files but have seen core files where strace
> > > >>>> showed the jvm stopped on a seg fault.
> > > >>>>
> > > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> > > >>>>> the situation allows (during regular updates of the application, or a
> > > >>>>> crash) to see if that helps.
> > > >>>>
> > > >>>> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results... have not
> > > >>>> tried 1.6.0_16. Please post your results of this trial.
> > > >>>>
> > > >>>>> Running tomcat on the
> > > >>>>> foreground might show something, but then again I could be waiting for a
> > > >>>>> month for it to happen.
> > > >>>>
> > > >>>> Yes, this has been part of my problem as anytime we change something, we
> > > >>>> have to wait a week for the server to fail.
> > > >>>>
> > > >>>> In one sense, I am fortunate that I have a little more flexibility than you.
> > > >>>> I have two servers (different hardware) but only need one in service at a
> > > >>>> time. Therefore, I always have one server I can test ideas on although I
> > > >>>> have never been able to develop a meaningful stress test, i.e., the only way
> > > >>>> I can test a change is to put it in production.
> > > >>>>
> > > >>>> Thanks,
> > > >>>>
> > > >>>> Carl
> > > >>>>
> > > >>>> ----- Original Message -----
> > > >>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> > > >>>> To: "Tomcat Users List"<us...@tomcat.apache.org>
> > > >>>> Sent: Wednesday, February 24, 2010 8:31 AM
> > > >>>> Subject: Re: jvm exits without trace
> > > >>>>
> > > >>>>
> > > >>>>> Hello Carl,
> > > >>>>>
> > > >>>>> The failures we've seen are in anywhere between 8 hours to a week of
> > > >>>>> runtime. Most of them have (still) been running for almost a month
> > > >>>>> without failure. There are ~100 machines.
> > > >>>>>
> > > >>>>>> From the top of my head, I think we've had about 10+ failures now.
> > > >>>>>
> > > >>>>> We have also had failures with hotspot error files (hs_err) present, and
> > > >>>>> the cause specified was indeed SIGSEGV indicating a page fault. But I
> > > >>>>> don't know if the two are related.
> > > >>>>>
> > > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> > > >>>>> the situation allows (during regular updates of the application, or a
> > > >>>>> crash) to see if that helps.
> > > >>>>>
> > > >>>>> It might be useful to note that the failures happen with tomcat 6.0.20
> > > >>>>> as well as 6.0.24.
> > > >>>>>
> > > >>>>> As far as load concerns, I haven't had a failure on an idle machines.
> > > >>>>> The machines are well loaded, but only at a fraction limit in regards to
> > > >>>>> load and cpu utilization.
> > > >>>>> Most memory is commited to tomcat, where a 24G machine would have 18G
> > > >>>>> allocated to heap, 128M to permgen and some unspecified amount would get
> > > >>>>> used by jni for apr. About 4G remains free after calculating taking into
> > > >>>>> account the jvm itsself.
> > > >>>>> A 16G machine would have 12G allocated to the heap.
> > > >>>>>
> > > >>>>> Besides the fact that our apps heavily use nio and mina I wouldn't say
> > > >>>>> there's anything else noteworthy. There can be anywhere up to 10000
> > > >>>>> concurrents on one machine.
> > > >>>>>
> > > >>>>> I had searched for coredumps, but no luck. Running tomcat on the
> > > >>>>> foreground might show something, but then again I could be waiting for a
> > > >>>>> month for it to happen.
> > > >>>>>
> > > >>>>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
> > > >>>>>> Taylan,
> > > >>>>>>
> > > >>>>>> I am the person who started the "Tomcat dies suddenly" thread which I
> > > >>>>>> still
> > > >>>>>> haven't resolved. I am curious about the pattern of failures you are
> > > >>>>>> experiencing because they may provide some clues to my problem. In my
> > > >>>>>> case,
> > > >>>>>> the system will run for 15 minutes to 10 days before failing (most of the
> > > >>>>>> time it is several days to a week.) It appears to die from a seg fault
> > > >>>>>> in
> > > >>>>>> the JVM (I am using Sun 1.6.0_18 but have tried previous versions)... you
> > > >>>>>> may be able to see the cause of the failure from the core file (the core
> > > >>>>>> files on my systems were in several directories so you may have to do a
> > > >>>>>> 'find' to locate them.) Load may be a factor but the failures generally
> > > >>>>>> come after the load has been heavy for a while. I am running a couple of
> > > >>>>>> applications and it seems the failures are more frequent when people are
> > > >>>>>> hitting the additional apps (the primary app is always used, the
> > > >>>>>> remaining
> > > >>>>>> apps are used sporatically.)
> > > >>>>>>
> > > >>>>>> How does this compare to what you are experiencing?
> > > >>>>>>
> > > >>>>>> Thanks,
> > > >>>>>>
> > > >>>>>> Carl
> > > >>>>>>
> > > >>>>>> ----- Original Message -----
> > > >>>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> > > >>>>>> To: "Tomcat Users List"<us...@pidster.com>
> > > >>>>>> Sent: Wednesday, February 24, 2010 5:09 AM
> > > >>>>>> Subject: Re: jvm exits without trace
> > > >>>>>>
> > > >>>>>>
> > > >>>>>>> The GC log shows plenty of heap space left in all the spaces.
> > > >>>>>>>
> > > >>>>>>> I purposely didn't bother replacing the variables because I figured
> > > >>>>>>> they
> > > >>>>>>> would not be relevant.
> > > >>>>>>>
> > > >>>>>>> But if you think they might provide clues they're as follows:
> > > >>>>>>>
> > > >>>>>>> JAVA_HEAP_SIZE=18432M
> > > >>>>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed 's/M$\|G$//')/6))M
> > > >>>>>>> JAVA_PERM_SIZE=128M
> > > >>>>>>> JAVA_STCK_SIZE=128K
> > > >>>>>>>
> > > >>>>>>> EDEN_SIZE is 1/6th of total heap.
> > > >>>>>>>
> > > >>>>>>> And I said there was nothing in the system logs.
> > > >>>>>>> But you get a couple of points for trying.
> > > >>>>>>>
> > > >>>>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
> > > >>>>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
> > > >>>>>>>>> I thought I'd add the connector definitions too, :
> > > >>>>>>>>>
> > > >>>>>>>>> <Connector port="80"
> > > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> > > >>>>>>>>> compression="1024" keepAliveTimeout="60000"
> > > >>>>>>>>> maxKeepAliveRequests="-1"
> > > >>>>>>>>> enableLookups="false" redirectPort="443"
> > > >>>>>>>>> maxThreads="150"
> > > >>>>>>>>> pollerSize="32768"
> > > >>>>>>>>> pollerThreadCount="4"/>
> > > >>>>>>>>>
> > > >>>>>>>>> <Connector port="443"
> > > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> > > >>>>>>>>> SSLEnabled="true"
> > > >>>>>>>>> enableLookups="false" maxThreads="10" scheme="https"
> > > >>>>>>>>> secure="true"
> > > >>>>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
> > > >>>>>>>>>
> > > >>>>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
> > > >>>>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
> > > >>>>>>>>>
> > > >>>>>>>>>
> > > >>>>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
> > > >>>>>>>>>> Hi,
> > > >>>>>>>>>>
> > > >>>>>>>>>> I have jvm's, running tomcat and our application, exiting
> > > >>>>>>>>>> mysteriously,
> > > >>>>>>>>>> and was wondering if anyone could give me some advice on how to
> > > >>>>>>>>>> debug
> > > >>>>>>>>>> this thing.
> > > >>>>>>>>>>
> > > >>>>>>>>>> There is nothing in catalina.out, nor our application logs, and no
> > > >>>>>>>>>> hotspot error file. GC log looks normal. No trace in system logs.
> > > >>>>>>>>>>
> > > >>>>>>>>>> I am left completely clueless :(, has anyone dealt with a problem
> > > >>>>>>>>>> like
> > > >>>>>>>>>> this before?
> > > >>>>>>>>>>
> > > >>>>>>>>>> Any help appreciated.
> > > >>>>>>>>>>
> > > >>>>>>>>>> - Tomcat 6.0.24
> > > >>>>>>>>>> - TC native 1.1.18
> > > >>>>>>>>>> - APR 1.3.9
> > > >>>>>>>>>> - Sun JDK 6u18
> > > >>>>>>>>>> - Debian Lenny, 2.6.31.10-amd64
> > > >>>>>>>>>>
> > > >>>>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use TCNative/APR.
> > > >>>>>>>>>>
> > > >>>>>>>>>> JAVA_OPTS ( ):
> > > >>>>>>>>>>
> > > >>>>>>>>>> -verbose:gc
> > > >>>>>>>>>> -Djava.awt.headless=true
> > > >>>>>>>>>> -Dsun.net.inetaddr.ttl=60
> > > >>>>>>>>>> -Dfile.encoding=UTF-8
> > > >>>>>>>>>> -Djava.io.tmpdir=$TMP_DIR
> > > >>>>>>>>>> -Djava.library.path=/usr/local/lib
> > > >>>>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
> > > >>>>>>>>>> -Dcatalina.base=$CATALINA_BASE
> > > >>>>>>>>>> -Dcatalina.home=$CATALINA_HOME
> > > >>>>>>>>
> > > >>>>>>>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> > > >>>>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
> > > >>>>>>>>>> -XX:+PrintGCDetails
> > > >>>>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
> > > >>>>>>>>>> -XX:+UseConcMarkSweepGC
> > > >>>>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
> > > >>>>>>>>>> -Xms$JAVA_HEAP_SIZE
> > > >>>>>>>>>> -Xmx$JAVA_HEAP_SIZE
> > > >>>>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
> > > >>>>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
> > > >>>>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
> > > >>>>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
> > > >>>>>>>>>> -Xss$JAVA_STCK_SIZE
> > > >>>>>>>>>> -XX:+UseLargePages
> > > >>>>>>>>
> > > >>>>>>>> There's no actual heap size settings in the above. But you get a
> > > >>>>>>>> couple
> > > >>>>>>>> of points for trying.
> > > >>>>>>>>
> > > >>>>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then check the
> > > >>>>>>>> server logs carefully. (e.g. /var/log/messages)
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>> p
> > > >>>>>>>>
> > > >>>>>>>>> ---------------------------------------------------------------------
> > > >>>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > >>>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > > >>>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>> ---------------------------------------------------------------------
> > > >>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > >>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > > >>>>>>>>
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>> ---------------------------------------------------------------------
> > > >>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > >>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>
> > > >>>>>>
> > > >>>>>> ---------------------------------------------------------------------
> > > >>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > >>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > > >>>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>>
> > > >>>>> ---------------------------------------------------------------------
> > > >>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > >>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > > >>>>>
> > > >>>>>
> > > >>>>
> > > >>>>
> > > >>>> ---------------------------------------------------------------------
> > > >>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > >>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > > >>>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> ---------------------------------------------------------------------
> > > >>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > >>> For additional commands, e-mail: users-help@tomcat.apache.org
> > > >>>
> > > >>
> > > >>
> > > >> ---------------------------------------------------------------------
> > > >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > > >> For additional commands, e-mail: users-help@tomcat.apache.org
> > > >>
> > > >
> > > >
> > >
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > For additional commands, e-mail: users-help@tomcat.apache.org
> >
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
Changing to JIO didn't help, the silent crashes continue.
I'm changing kernel versions now.
On Fri, 2010-03-05 at 10:45 +0100, Taylan Develioglu wrote:
> It's performing rather poorly performance wise, compared to the apr
> connector. The number of threads required to handle the requests has
> gone up significantly over the board.
>
> Stability wise, I don't have complaints yet.
>
> I'm keeping my fingers crossed.
>
> On Fri, 2010-03-05 at 10:09 +0100, Pid wrote:
> > On 05/03/2010 08:41, Taylan Develioglu wrote:
> > > Pid, that would assume we had a working< 1.6.10 version before that we
> > > replaced.
> >
> > That it would.
> >
> > > We've run 1.6.10 upwards succesfully for a very long time. So I don't
> > > see the point in doing this.
> >
> > I must have missed that.
> >
> > How is the HTTP connector performing?
> >
> >
> > p
> >
> > > On Wed, 2010-03-03 at 12:00 +0100, Pid wrote:
> > >> On 03/03/2010 09:11, Taylan Develioglu wrote:
> > >>> Downgrading to 1.6.0_16 did not help. I'm replacing the apr connector
> > >>> with http now.
> > >>
> > >> As Chuck mentioned in the other thread, significant changes occurred at
> > >> 1.6.10, so trying the release before (1.6.7) might be necessary to
> > >> establish a better determination.
> > >>
> > >>
> > >> p
> > >>
> > >>> On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
> > >>>> Taylan,
> > >>>>
> > >>>>> The failures we've seen are in anywhere between 8 hours to a week of
> > >>>>> runtime.
> > >>>>
> > >>>> The timing of the failures seems similar.
> > >>>>
> > >>>>> We have also had failures with hotspot error files (hs_err) present, and
> > >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
> > >>>>
> > >>>> I have never seen any hs_* files but have seen core files where strace
> > >>>> showed the jvm stopped on a seg fault.
> > >>>>
> > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> > >>>>> the situation allows (during regular updates of the application, or a
> > >>>>> crash) to see if that helps.
> > >>>>
> > >>>> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results... have not
> > >>>> tried 1.6.0_16. Please post your results of this trial.
> > >>>>
> > >>>>> Running tomcat on the
> > >>>>> foreground might show something, but then again I could be waiting for a
> > >>>>> month for it to happen.
> > >>>>
> > >>>> Yes, this has been part of my problem as anytime we change something, we
> > >>>> have to wait a week for the server to fail.
> > >>>>
> > >>>> In one sense, I am fortunate that I have a little more flexibility than you.
> > >>>> I have two servers (different hardware) but only need one in service at a
> > >>>> time. Therefore, I always have one server I can test ideas on although I
> > >>>> have never been able to develop a meaningful stress test, i.e., the only way
> > >>>> I can test a change is to put it in production.
> > >>>>
> > >>>> Thanks,
> > >>>>
> > >>>> Carl
> > >>>>
> > >>>> ----- Original Message -----
> > >>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> > >>>> To: "Tomcat Users List"<us...@tomcat.apache.org>
> > >>>> Sent: Wednesday, February 24, 2010 8:31 AM
> > >>>> Subject: Re: jvm exits without trace
> > >>>>
> > >>>>
> > >>>>> Hello Carl,
> > >>>>>
> > >>>>> The failures we've seen are in anywhere between 8 hours to a week of
> > >>>>> runtime. Most of them have (still) been running for almost a month
> > >>>>> without failure. There are ~100 machines.
> > >>>>>
> > >>>>>> From the top of my head, I think we've had about 10+ failures now.
> > >>>>>
> > >>>>> We have also had failures with hotspot error files (hs_err) present, and
> > >>>>> the cause specified was indeed SIGSEGV indicating a page fault. But I
> > >>>>> don't know if the two are related.
> > >>>>>
> > >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> > >>>>> the situation allows (during regular updates of the application, or a
> > >>>>> crash) to see if that helps.
> > >>>>>
> > >>>>> It might be useful to note that the failures happen with tomcat 6.0.20
> > >>>>> as well as 6.0.24.
> > >>>>>
> > >>>>> As far as load concerns, I haven't had a failure on an idle machines.
> > >>>>> The machines are well loaded, but only at a fraction limit in regards to
> > >>>>> load and cpu utilization.
> > >>>>> Most memory is commited to tomcat, where a 24G machine would have 18G
> > >>>>> allocated to heap, 128M to permgen and some unspecified amount would get
> > >>>>> used by jni for apr. About 4G remains free after calculating taking into
> > >>>>> account the jvm itsself.
> > >>>>> A 16G machine would have 12G allocated to the heap.
> > >>>>>
> > >>>>> Besides the fact that our apps heavily use nio and mina I wouldn't say
> > >>>>> there's anything else noteworthy. There can be anywhere up to 10000
> > >>>>> concurrents on one machine.
> > >>>>>
> > >>>>> I had searched for coredumps, but no luck. Running tomcat on the
> > >>>>> foreground might show something, but then again I could be waiting for a
> > >>>>> month for it to happen.
> > >>>>>
> > >>>>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
> > >>>>>> Taylan,
> > >>>>>>
> > >>>>>> I am the person who started the "Tomcat dies suddenly" thread which I
> > >>>>>> still
> > >>>>>> haven't resolved. I am curious about the pattern of failures you are
> > >>>>>> experiencing because they may provide some clues to my problem. In my
> > >>>>>> case,
> > >>>>>> the system will run for 15 minutes to 10 days before failing (most of the
> > >>>>>> time it is several days to a week.) It appears to die from a seg fault
> > >>>>>> in
> > >>>>>> the JVM (I am using Sun 1.6.0_18 but have tried previous versions)... you
> > >>>>>> may be able to see the cause of the failure from the core file (the core
> > >>>>>> files on my systems were in several directories so you may have to do a
> > >>>>>> 'find' to locate them.) Load may be a factor but the failures generally
> > >>>>>> come after the load has been heavy for a while. I am running a couple of
> > >>>>>> applications and it seems the failures are more frequent when people are
> > >>>>>> hitting the additional apps (the primary app is always used, the
> > >>>>>> remaining
> > >>>>>> apps are used sporatically.)
> > >>>>>>
> > >>>>>> How does this compare to what you are experiencing?
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>>
> > >>>>>> Carl
> > >>>>>>
> > >>>>>> ----- Original Message -----
> > >>>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> > >>>>>> To: "Tomcat Users List"<us...@pidster.com>
> > >>>>>> Sent: Wednesday, February 24, 2010 5:09 AM
> > >>>>>> Subject: Re: jvm exits without trace
> > >>>>>>
> > >>>>>>
> > >>>>>>> The GC log shows plenty of heap space left in all the spaces.
> > >>>>>>>
> > >>>>>>> I purposely didn't bother replacing the variables because I figured
> > >>>>>>> they
> > >>>>>>> would not be relevant.
> > >>>>>>>
> > >>>>>>> But if you think they might provide clues they're as follows:
> > >>>>>>>
> > >>>>>>> JAVA_HEAP_SIZE=18432M
> > >>>>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed 's/M$\|G$//')/6))M
> > >>>>>>> JAVA_PERM_SIZE=128M
> > >>>>>>> JAVA_STCK_SIZE=128K
> > >>>>>>>
> > >>>>>>> EDEN_SIZE is 1/6th of total heap.
> > >>>>>>>
> > >>>>>>> And I said there was nothing in the system logs.
> > >>>>>>> But you get a couple of points for trying.
> > >>>>>>>
> > >>>>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
> > >>>>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
> > >>>>>>>>> I thought I'd add the connector definitions too, :
> > >>>>>>>>>
> > >>>>>>>>> <Connector port="80"
> > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> > >>>>>>>>> compression="1024" keepAliveTimeout="60000"
> > >>>>>>>>> maxKeepAliveRequests="-1"
> > >>>>>>>>> enableLookups="false" redirectPort="443"
> > >>>>>>>>> maxThreads="150"
> > >>>>>>>>> pollerSize="32768"
> > >>>>>>>>> pollerThreadCount="4"/>
> > >>>>>>>>>
> > >>>>>>>>> <Connector port="443"
> > >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> > >>>>>>>>> SSLEnabled="true"
> > >>>>>>>>> enableLookups="false" maxThreads="10" scheme="https"
> > >>>>>>>>> secure="true"
> > >>>>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
> > >>>>>>>>>
> > >>>>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
> > >>>>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
> > >>>>>>>>>
> > >>>>>>>>>
> > >>>>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
> > >>>>>>>>>> Hi,
> > >>>>>>>>>>
> > >>>>>>>>>> I have jvm's, running tomcat and our application, exiting
> > >>>>>>>>>> mysteriously,
> > >>>>>>>>>> and was wondering if anyone could give me some advice on how to
> > >>>>>>>>>> debug
> > >>>>>>>>>> this thing.
> > >>>>>>>>>>
> > >>>>>>>>>> There is nothing in catalina.out, nor our application logs, and no
> > >>>>>>>>>> hotspot error file. GC log looks normal. No trace in system logs.
> > >>>>>>>>>>
> > >>>>>>>>>> I am left completely clueless :(, has anyone dealt with a problem
> > >>>>>>>>>> like
> > >>>>>>>>>> this before?
> > >>>>>>>>>>
> > >>>>>>>>>> Any help appreciated.
> > >>>>>>>>>>
> > >>>>>>>>>> - Tomcat 6.0.24
> > >>>>>>>>>> - TC native 1.1.18
> > >>>>>>>>>> - APR 1.3.9
> > >>>>>>>>>> - Sun JDK 6u18
> > >>>>>>>>>> - Debian Lenny, 2.6.31.10-amd64
> > >>>>>>>>>>
> > >>>>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use TCNative/APR.
> > >>>>>>>>>>
> > >>>>>>>>>> JAVA_OPTS ( ):
> > >>>>>>>>>>
> > >>>>>>>>>> -verbose:gc
> > >>>>>>>>>> -Djava.awt.headless=true
> > >>>>>>>>>> -Dsun.net.inetaddr.ttl=60
> > >>>>>>>>>> -Dfile.encoding=UTF-8
> > >>>>>>>>>> -Djava.io.tmpdir=$TMP_DIR
> > >>>>>>>>>> -Djava.library.path=/usr/local/lib
> > >>>>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
> > >>>>>>>>>> -Dcatalina.base=$CATALINA_BASE
> > >>>>>>>>>> -Dcatalina.home=$CATALINA_HOME
> > >>>>>>>>
> > >>>>>>>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> > >>>>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
> > >>>>>>>>>> -XX:+PrintGCDetails
> > >>>>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
> > >>>>>>>>>> -XX:+UseConcMarkSweepGC
> > >>>>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
> > >>>>>>>>>> -Xms$JAVA_HEAP_SIZE
> > >>>>>>>>>> -Xmx$JAVA_HEAP_SIZE
> > >>>>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
> > >>>>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
> > >>>>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
> > >>>>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
> > >>>>>>>>>> -Xss$JAVA_STCK_SIZE
> > >>>>>>>>>> -XX:+UseLargePages
> > >>>>>>>>
> > >>>>>>>> There's no actual heap size settings in the above. But you get a
> > >>>>>>>> couple
> > >>>>>>>> of points for trying.
> > >>>>>>>>
> > >>>>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then check the
> > >>>>>>>> server logs carefully. (e.g. /var/log/messages)
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> p
> > >>>>>>>>
> > >>>>>>>>> ---------------------------------------------------------------------
> > >>>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >>>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>>>>>>>>
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> ---------------------------------------------------------------------
> > >>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> ---------------------------------------------------------------------
> > >>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>> ---------------------------------------------------------------------
> > >>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>>>>>
> > >>>>>
> > >>>>>
> > >>>>>
> > >>>>> ---------------------------------------------------------------------
> > >>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>> ---------------------------------------------------------------------
> > >>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >>>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> ---------------------------------------------------------------------
> > >>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >>> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>>
> > >>
> > >>
> > >> ---------------------------------------------------------------------
> > >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > >> For additional commands, e-mail: users-help@tomcat.apache.org
> > >>
> > >
> > >
> >
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
It's performing rather poorly performance wise, compared to the apr
connector. The number of threads required to handle the requests has
gone up significantly over the board.
Stability wise, I don't have complaints yet.
I'm keeping my fingers crossed.
On Fri, 2010-03-05 at 10:09 +0100, Pid wrote:
> On 05/03/2010 08:41, Taylan Develioglu wrote:
> > Pid, that would assume we had a working< 1.6.10 version before that we
> > replaced.
>
> That it would.
>
> > We've run 1.6.10 upwards succesfully for a very long time. So I don't
> > see the point in doing this.
>
> I must have missed that.
>
> How is the HTTP connector performing?
>
>
> p
>
> > On Wed, 2010-03-03 at 12:00 +0100, Pid wrote:
> >> On 03/03/2010 09:11, Taylan Develioglu wrote:
> >>> Downgrading to 1.6.0_16 did not help. I'm replacing the apr connector
> >>> with http now.
> >>
> >> As Chuck mentioned in the other thread, significant changes occurred at
> >> 1.6.10, so trying the release before (1.6.7) might be necessary to
> >> establish a better determination.
> >>
> >>
> >> p
> >>
> >>> On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
> >>>> Taylan,
> >>>>
> >>>>> The failures we've seen are in anywhere between 8 hours to a week of
> >>>>> runtime.
> >>>>
> >>>> The timing of the failures seems similar.
> >>>>
> >>>>> We have also had failures with hotspot error files (hs_err) present, and
> >>>>> the cause specified was indeed SIGSEGV indicating a page fault.
> >>>>
> >>>> I have never seen any hs_* files but have seen core files where strace
> >>>> showed the jvm stopped on a seg fault.
> >>>>
> >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> >>>>> the situation allows (during regular updates of the application, or a
> >>>>> crash) to see if that helps.
> >>>>
> >>>> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results... have not
> >>>> tried 1.6.0_16. Please post your results of this trial.
> >>>>
> >>>>> Running tomcat on the
> >>>>> foreground might show something, but then again I could be waiting for a
> >>>>> month for it to happen.
> >>>>
> >>>> Yes, this has been part of my problem as anytime we change something, we
> >>>> have to wait a week for the server to fail.
> >>>>
> >>>> In one sense, I am fortunate that I have a little more flexibility than you.
> >>>> I have two servers (different hardware) but only need one in service at a
> >>>> time. Therefore, I always have one server I can test ideas on although I
> >>>> have never been able to develop a meaningful stress test, i.e., the only way
> >>>> I can test a change is to put it in production.
> >>>>
> >>>> Thanks,
> >>>>
> >>>> Carl
> >>>>
> >>>> ----- Original Message -----
> >>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> >>>> To: "Tomcat Users List"<us...@tomcat.apache.org>
> >>>> Sent: Wednesday, February 24, 2010 8:31 AM
> >>>> Subject: Re: jvm exits without trace
> >>>>
> >>>>
> >>>>> Hello Carl,
> >>>>>
> >>>>> The failures we've seen are in anywhere between 8 hours to a week of
> >>>>> runtime. Most of them have (still) been running for almost a month
> >>>>> without failure. There are ~100 machines.
> >>>>>
> >>>>>> From the top of my head, I think we've had about 10+ failures now.
> >>>>>
> >>>>> We have also had failures with hotspot error files (hs_err) present, and
> >>>>> the cause specified was indeed SIGSEGV indicating a page fault. But I
> >>>>> don't know if the two are related.
> >>>>>
> >>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> >>>>> the situation allows (during regular updates of the application, or a
> >>>>> crash) to see if that helps.
> >>>>>
> >>>>> It might be useful to note that the failures happen with tomcat 6.0.20
> >>>>> as well as 6.0.24.
> >>>>>
> >>>>> As far as load concerns, I haven't had a failure on an idle machines.
> >>>>> The machines are well loaded, but only at a fraction limit in regards to
> >>>>> load and cpu utilization.
> >>>>> Most memory is commited to tomcat, where a 24G machine would have 18G
> >>>>> allocated to heap, 128M to permgen and some unspecified amount would get
> >>>>> used by jni for apr. About 4G remains free after calculating taking into
> >>>>> account the jvm itsself.
> >>>>> A 16G machine would have 12G allocated to the heap.
> >>>>>
> >>>>> Besides the fact that our apps heavily use nio and mina I wouldn't say
> >>>>> there's anything else noteworthy. There can be anywhere up to 10000
> >>>>> concurrents on one machine.
> >>>>>
> >>>>> I had searched for coredumps, but no luck. Running tomcat on the
> >>>>> foreground might show something, but then again I could be waiting for a
> >>>>> month for it to happen.
> >>>>>
> >>>>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
> >>>>>> Taylan,
> >>>>>>
> >>>>>> I am the person who started the "Tomcat dies suddenly" thread which I
> >>>>>> still
> >>>>>> haven't resolved. I am curious about the pattern of failures you are
> >>>>>> experiencing because they may provide some clues to my problem. In my
> >>>>>> case,
> >>>>>> the system will run for 15 minutes to 10 days before failing (most of the
> >>>>>> time it is several days to a week.) It appears to die from a seg fault
> >>>>>> in
> >>>>>> the JVM (I am using Sun 1.6.0_18 but have tried previous versions)... you
> >>>>>> may be able to see the cause of the failure from the core file (the core
> >>>>>> files on my systems were in several directories so you may have to do a
> >>>>>> 'find' to locate them.) Load may be a factor but the failures generally
> >>>>>> come after the load has been heavy for a while. I am running a couple of
> >>>>>> applications and it seems the failures are more frequent when people are
> >>>>>> hitting the additional apps (the primary app is always used, the
> >>>>>> remaining
> >>>>>> apps are used sporatically.)
> >>>>>>
> >>>>>> How does this compare to what you are experiencing?
> >>>>>>
> >>>>>> Thanks,
> >>>>>>
> >>>>>> Carl
> >>>>>>
> >>>>>> ----- Original Message -----
> >>>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> >>>>>> To: "Tomcat Users List"<us...@pidster.com>
> >>>>>> Sent: Wednesday, February 24, 2010 5:09 AM
> >>>>>> Subject: Re: jvm exits without trace
> >>>>>>
> >>>>>>
> >>>>>>> The GC log shows plenty of heap space left in all the spaces.
> >>>>>>>
> >>>>>>> I purposely didn't bother replacing the variables because I figured
> >>>>>>> they
> >>>>>>> would not be relevant.
> >>>>>>>
> >>>>>>> But if you think they might provide clues they're as follows:
> >>>>>>>
> >>>>>>> JAVA_HEAP_SIZE=18432M
> >>>>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed 's/M$\|G$//')/6))M
> >>>>>>> JAVA_PERM_SIZE=128M
> >>>>>>> JAVA_STCK_SIZE=128K
> >>>>>>>
> >>>>>>> EDEN_SIZE is 1/6th of total heap.
> >>>>>>>
> >>>>>>> And I said there was nothing in the system logs.
> >>>>>>> But you get a couple of points for trying.
> >>>>>>>
> >>>>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
> >>>>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
> >>>>>>>>> I thought I'd add the connector definitions too, :
> >>>>>>>>>
> >>>>>>>>> <Connector port="80"
> >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> >>>>>>>>> compression="1024" keepAliveTimeout="60000"
> >>>>>>>>> maxKeepAliveRequests="-1"
> >>>>>>>>> enableLookups="false" redirectPort="443"
> >>>>>>>>> maxThreads="150"
> >>>>>>>>> pollerSize="32768"
> >>>>>>>>> pollerThreadCount="4"/>
> >>>>>>>>>
> >>>>>>>>> <Connector port="443"
> >>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> >>>>>>>>> SSLEnabled="true"
> >>>>>>>>> enableLookups="false" maxThreads="10" scheme="https"
> >>>>>>>>> secure="true"
> >>>>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
> >>>>>>>>>
> >>>>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
> >>>>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
> >>>>>>>>>> Hi,
> >>>>>>>>>>
> >>>>>>>>>> I have jvm's, running tomcat and our application, exiting
> >>>>>>>>>> mysteriously,
> >>>>>>>>>> and was wondering if anyone could give me some advice on how to
> >>>>>>>>>> debug
> >>>>>>>>>> this thing.
> >>>>>>>>>>
> >>>>>>>>>> There is nothing in catalina.out, nor our application logs, and no
> >>>>>>>>>> hotspot error file. GC log looks normal. No trace in system logs.
> >>>>>>>>>>
> >>>>>>>>>> I am left completely clueless :(, has anyone dealt with a problem
> >>>>>>>>>> like
> >>>>>>>>>> this before?
> >>>>>>>>>>
> >>>>>>>>>> Any help appreciated.
> >>>>>>>>>>
> >>>>>>>>>> - Tomcat 6.0.24
> >>>>>>>>>> - TC native 1.1.18
> >>>>>>>>>> - APR 1.3.9
> >>>>>>>>>> - Sun JDK 6u18
> >>>>>>>>>> - Debian Lenny, 2.6.31.10-amd64
> >>>>>>>>>>
> >>>>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use TCNative/APR.
> >>>>>>>>>>
> >>>>>>>>>> JAVA_OPTS ( ):
> >>>>>>>>>>
> >>>>>>>>>> -verbose:gc
> >>>>>>>>>> -Djava.awt.headless=true
> >>>>>>>>>> -Dsun.net.inetaddr.ttl=60
> >>>>>>>>>> -Dfile.encoding=UTF-8
> >>>>>>>>>> -Djava.io.tmpdir=$TMP_DIR
> >>>>>>>>>> -Djava.library.path=/usr/local/lib
> >>>>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
> >>>>>>>>>> -Dcatalina.base=$CATALINA_BASE
> >>>>>>>>>> -Dcatalina.home=$CATALINA_HOME
> >>>>>>>>
> >>>>>>>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> >>>>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
> >>>>>>>>>> -XX:+PrintGCDetails
> >>>>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
> >>>>>>>>>> -XX:+UseConcMarkSweepGC
> >>>>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
> >>>>>>>>>> -Xms$JAVA_HEAP_SIZE
> >>>>>>>>>> -Xmx$JAVA_HEAP_SIZE
> >>>>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
> >>>>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
> >>>>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
> >>>>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
> >>>>>>>>>> -Xss$JAVA_STCK_SIZE
> >>>>>>>>>> -XX:+UseLargePages
> >>>>>>>>
> >>>>>>>> There's no actual heap size settings in the above. But you get a
> >>>>>>>> couple
> >>>>>>>> of points for trying.
> >>>>>>>>
> >>>>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then check the
> >>>>>>>> server logs carefully. (e.g. /var/log/messages)
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> p
> >>>>>>>>
> >>>>>>>>> ---------------------------------------------------------------------
> >>>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> ---------------------------------------------------------------------
> >>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> ---------------------------------------------------------------------
> >>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>> ---------------------------------------------------------------------
> >>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> ---------------------------------------------------------------------
> >>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>> ---------------------------------------------------------------------
> >>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>
> >>>
> >>>
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> For additional commands, e-mail: users-help@tomcat.apache.org
> >>
> >
> >
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Pid <pi...@pidster.com>.
On 05/03/2010 08:41, Taylan Develioglu wrote:
> Pid, that would assume we had a working< 1.6.10 version before that we
> replaced.
That it would.
> We've run 1.6.10 upwards succesfully for a very long time. So I don't
> see the point in doing this.
I must have missed that.
How is the HTTP connector performing?
p
> On Wed, 2010-03-03 at 12:00 +0100, Pid wrote:
>> On 03/03/2010 09:11, Taylan Develioglu wrote:
>>> Downgrading to 1.6.0_16 did not help. I'm replacing the apr connector
>>> with http now.
>>
>> As Chuck mentioned in the other thread, significant changes occurred at
>> 1.6.10, so trying the release before (1.6.7) might be necessary to
>> establish a better determination.
>>
>>
>> p
>>
>>> On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
>>>> Taylan,
>>>>
>>>>> The failures we've seen are in anywhere between 8 hours to a week of
>>>>> runtime.
>>>>
>>>> The timing of the failures seems similar.
>>>>
>>>>> We have also had failures with hotspot error files (hs_err) present, and
>>>>> the cause specified was indeed SIGSEGV indicating a page fault.
>>>>
>>>> I have never seen any hs_* files but have seen core files where strace
>>>> showed the jvm stopped on a seg fault.
>>>>
>>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
>>>>> the situation allows (during regular updates of the application, or a
>>>>> crash) to see if that helps.
>>>>
>>>> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results... have not
>>>> tried 1.6.0_16. Please post your results of this trial.
>>>>
>>>>> Running tomcat on the
>>>>> foreground might show something, but then again I could be waiting for a
>>>>> month for it to happen.
>>>>
>>>> Yes, this has been part of my problem as anytime we change something, we
>>>> have to wait a week for the server to fail.
>>>>
>>>> In one sense, I am fortunate that I have a little more flexibility than you.
>>>> I have two servers (different hardware) but only need one in service at a
>>>> time. Therefore, I always have one server I can test ideas on although I
>>>> have never been able to develop a meaningful stress test, i.e., the only way
>>>> I can test a change is to put it in production.
>>>>
>>>> Thanks,
>>>>
>>>> Carl
>>>>
>>>> ----- Original Message -----
>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
>>>> To: "Tomcat Users List"<us...@tomcat.apache.org>
>>>> Sent: Wednesday, February 24, 2010 8:31 AM
>>>> Subject: Re: jvm exits without trace
>>>>
>>>>
>>>>> Hello Carl,
>>>>>
>>>>> The failures we've seen are in anywhere between 8 hours to a week of
>>>>> runtime. Most of them have (still) been running for almost a month
>>>>> without failure. There are ~100 machines.
>>>>>
>>>>>> From the top of my head, I think we've had about 10+ failures now.
>>>>>
>>>>> We have also had failures with hotspot error files (hs_err) present, and
>>>>> the cause specified was indeed SIGSEGV indicating a page fault. But I
>>>>> don't know if the two are related.
>>>>>
>>>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
>>>>> the situation allows (during regular updates of the application, or a
>>>>> crash) to see if that helps.
>>>>>
>>>>> It might be useful to note that the failures happen with tomcat 6.0.20
>>>>> as well as 6.0.24.
>>>>>
>>>>> As far as load concerns, I haven't had a failure on an idle machines.
>>>>> The machines are well loaded, but only at a fraction limit in regards to
>>>>> load and cpu utilization.
>>>>> Most memory is commited to tomcat, where a 24G machine would have 18G
>>>>> allocated to heap, 128M to permgen and some unspecified amount would get
>>>>> used by jni for apr. About 4G remains free after calculating taking into
>>>>> account the jvm itsself.
>>>>> A 16G machine would have 12G allocated to the heap.
>>>>>
>>>>> Besides the fact that our apps heavily use nio and mina I wouldn't say
>>>>> there's anything else noteworthy. There can be anywhere up to 10000
>>>>> concurrents on one machine.
>>>>>
>>>>> I had searched for coredumps, but no luck. Running tomcat on the
>>>>> foreground might show something, but then again I could be waiting for a
>>>>> month for it to happen.
>>>>>
>>>>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
>>>>>> Taylan,
>>>>>>
>>>>>> I am the person who started the "Tomcat dies suddenly" thread which I
>>>>>> still
>>>>>> haven't resolved. I am curious about the pattern of failures you are
>>>>>> experiencing because they may provide some clues to my problem. In my
>>>>>> case,
>>>>>> the system will run for 15 minutes to 10 days before failing (most of the
>>>>>> time it is several days to a week.) It appears to die from a seg fault
>>>>>> in
>>>>>> the JVM (I am using Sun 1.6.0_18 but have tried previous versions)... you
>>>>>> may be able to see the cause of the failure from the core file (the core
>>>>>> files on my systems were in several directories so you may have to do a
>>>>>> 'find' to locate them.) Load may be a factor but the failures generally
>>>>>> come after the load has been heavy for a while. I am running a couple of
>>>>>> applications and it seems the failures are more frequent when people are
>>>>>> hitting the additional apps (the primary app is always used, the
>>>>>> remaining
>>>>>> apps are used sporatically.)
>>>>>>
>>>>>> How does this compare to what you are experiencing?
>>>>>>
>>>>>> Thanks,
>>>>>>
>>>>>> Carl
>>>>>>
>>>>>> ----- Original Message -----
>>>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
>>>>>> To: "Tomcat Users List"<us...@pidster.com>
>>>>>> Sent: Wednesday, February 24, 2010 5:09 AM
>>>>>> Subject: Re: jvm exits without trace
>>>>>>
>>>>>>
>>>>>>> The GC log shows plenty of heap space left in all the spaces.
>>>>>>>
>>>>>>> I purposely didn't bother replacing the variables because I figured
>>>>>>> they
>>>>>>> would not be relevant.
>>>>>>>
>>>>>>> But if you think they might provide clues they're as follows:
>>>>>>>
>>>>>>> JAVA_HEAP_SIZE=18432M
>>>>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed 's/M$\|G$//')/6))M
>>>>>>> JAVA_PERM_SIZE=128M
>>>>>>> JAVA_STCK_SIZE=128K
>>>>>>>
>>>>>>> EDEN_SIZE is 1/6th of total heap.
>>>>>>>
>>>>>>> And I said there was nothing in the system logs.
>>>>>>> But you get a couple of points for trying.
>>>>>>>
>>>>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
>>>>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
>>>>>>>>> I thought I'd add the connector definitions too, :
>>>>>>>>>
>>>>>>>>> <Connector port="80"
>>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
>>>>>>>>> compression="1024" keepAliveTimeout="60000"
>>>>>>>>> maxKeepAliveRequests="-1"
>>>>>>>>> enableLookups="false" redirectPort="443"
>>>>>>>>> maxThreads="150"
>>>>>>>>> pollerSize="32768"
>>>>>>>>> pollerThreadCount="4"/>
>>>>>>>>>
>>>>>>>>> <Connector port="443"
>>>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
>>>>>>>>> SSLEnabled="true"
>>>>>>>>> enableLookups="false" maxThreads="10" scheme="https"
>>>>>>>>> secure="true"
>>>>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
>>>>>>>>>
>>>>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
>>>>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> I have jvm's, running tomcat and our application, exiting
>>>>>>>>>> mysteriously,
>>>>>>>>>> and was wondering if anyone could give me some advice on how to
>>>>>>>>>> debug
>>>>>>>>>> this thing.
>>>>>>>>>>
>>>>>>>>>> There is nothing in catalina.out, nor our application logs, and no
>>>>>>>>>> hotspot error file. GC log looks normal. No trace in system logs.
>>>>>>>>>>
>>>>>>>>>> I am left completely clueless :(, has anyone dealt with a problem
>>>>>>>>>> like
>>>>>>>>>> this before?
>>>>>>>>>>
>>>>>>>>>> Any help appreciated.
>>>>>>>>>>
>>>>>>>>>> - Tomcat 6.0.24
>>>>>>>>>> - TC native 1.1.18
>>>>>>>>>> - APR 1.3.9
>>>>>>>>>> - Sun JDK 6u18
>>>>>>>>>> - Debian Lenny, 2.6.31.10-amd64
>>>>>>>>>>
>>>>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use TCNative/APR.
>>>>>>>>>>
>>>>>>>>>> JAVA_OPTS ( ):
>>>>>>>>>>
>>>>>>>>>> -verbose:gc
>>>>>>>>>> -Djava.awt.headless=true
>>>>>>>>>> -Dsun.net.inetaddr.ttl=60
>>>>>>>>>> -Dfile.encoding=UTF-8
>>>>>>>>>> -Djava.io.tmpdir=$TMP_DIR
>>>>>>>>>> -Djava.library.path=/usr/local/lib
>>>>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
>>>>>>>>>> -Dcatalina.base=$CATALINA_BASE
>>>>>>>>>> -Dcatalina.home=$CATALINA_HOME
>>>>>>>>
>>>>>>>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
>>>>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
>>>>>>>>>> -XX:+PrintGCDetails
>>>>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
>>>>>>>>>> -XX:+UseConcMarkSweepGC
>>>>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
>>>>>>>>>> -Xms$JAVA_HEAP_SIZE
>>>>>>>>>> -Xmx$JAVA_HEAP_SIZE
>>>>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
>>>>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
>>>>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
>>>>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
>>>>>>>>>> -Xss$JAVA_STCK_SIZE
>>>>>>>>>> -XX:+UseLargePages
>>>>>>>>
>>>>>>>> There's no actual heap size settings in the above. But you get a
>>>>>>>> couple
>>>>>>>> of points for trying.
>>>>>>>>
>>>>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then check the
>>>>>>>> server logs carefully. (e.g. /var/log/messages)
>>>>>>>>
>>>>>>>>
>>>>>>>> p
>>>>>>>>
>>>>>>>>> ---------------------------------------------------------------------
>>>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> ---------------------------------------------------------------------
>>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>>
>>>>>
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> For additional commands, e-mail: users-help@tomcat.apache.org
>>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Taylan Develioglu <td...@ebuddy.com>.
Pid, that would assume we had a working < 1.6.10 version before that we
replaced.
We've run 1.6.10 upwards succesfully for a very long time. So I don't
see the point in doing this.
On Wed, 2010-03-03 at 12:00 +0100, Pid wrote:
> On 03/03/2010 09:11, Taylan Develioglu wrote:
> > Downgrading to 1.6.0_16 did not help. I'm replacing the apr connector
> > with http now.
>
> As Chuck mentioned in the other thread, significant changes occurred at
> 1.6.10, so trying the release before (1.6.7) might be necessary to
> establish a better determination.
>
>
> p
>
> > On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
> >> Taylan,
> >>
> >>> The failures we've seen are in anywhere between 8 hours to a week of
> >>> runtime.
> >>
> >> The timing of the failures seems similar.
> >>
> >>> We have also had failures with hotspot error files (hs_err) present, and
> >>> the cause specified was indeed SIGSEGV indicating a page fault.
> >>
> >> I have never seen any hs_* files but have seen core files where strace
> >> showed the jvm stopped on a seg fault.
> >>
> >>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> >>> the situation allows (during regular updates of the application, or a
> >>> crash) to see if that helps.
> >>
> >> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results... have not
> >> tried 1.6.0_16. Please post your results of this trial.
> >>
> >>> Running tomcat on the
> >>> foreground might show something, but then again I could be waiting for a
> >>> month for it to happen.
> >>
> >> Yes, this has been part of my problem as anytime we change something, we
> >> have to wait a week for the server to fail.
> >>
> >> In one sense, I am fortunate that I have a little more flexibility than you.
> >> I have two servers (different hardware) but only need one in service at a
> >> time. Therefore, I always have one server I can test ideas on although I
> >> have never been able to develop a meaningful stress test, i.e., the only way
> >> I can test a change is to put it in production.
> >>
> >> Thanks,
> >>
> >> Carl
> >>
> >> ----- Original Message -----
> >> From: "Taylan Develioglu"<td...@ebuddy.com>
> >> To: "Tomcat Users List"<us...@tomcat.apache.org>
> >> Sent: Wednesday, February 24, 2010 8:31 AM
> >> Subject: Re: jvm exits without trace
> >>
> >>
> >>> Hello Carl,
> >>>
> >>> The failures we've seen are in anywhere between 8 hours to a week of
> >>> runtime. Most of them have (still) been running for almost a month
> >>> without failure. There are ~100 machines.
> >>>
> >>> > From the top of my head, I think we've had about 10+ failures now.
> >>>
> >>> We have also had failures with hotspot error files (hs_err) present, and
> >>> the cause specified was indeed SIGSEGV indicating a page fault. But I
> >>> don't know if the two are related.
> >>>
> >>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
> >>> the situation allows (during regular updates of the application, or a
> >>> crash) to see if that helps.
> >>>
> >>> It might be useful to note that the failures happen with tomcat 6.0.20
> >>> as well as 6.0.24.
> >>>
> >>> As far as load concerns, I haven't had a failure on an idle machines.
> >>> The machines are well loaded, but only at a fraction limit in regards to
> >>> load and cpu utilization.
> >>> Most memory is commited to tomcat, where a 24G machine would have 18G
> >>> allocated to heap, 128M to permgen and some unspecified amount would get
> >>> used by jni for apr. About 4G remains free after calculating taking into
> >>> account the jvm itsself.
> >>> A 16G machine would have 12G allocated to the heap.
> >>>
> >>> Besides the fact that our apps heavily use nio and mina I wouldn't say
> >>> there's anything else noteworthy. There can be anywhere up to 10000
> >>> concurrents on one machine.
> >>>
> >>> I had searched for coredumps, but no luck. Running tomcat on the
> >>> foreground might show something, but then again I could be waiting for a
> >>> month for it to happen.
> >>>
> >>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
> >>>> Taylan,
> >>>>
> >>>> I am the person who started the "Tomcat dies suddenly" thread which I
> >>>> still
> >>>> haven't resolved. I am curious about the pattern of failures you are
> >>>> experiencing because they may provide some clues to my problem. In my
> >>>> case,
> >>>> the system will run for 15 minutes to 10 days before failing (most of the
> >>>> time it is several days to a week.) It appears to die from a seg fault
> >>>> in
> >>>> the JVM (I am using Sun 1.6.0_18 but have tried previous versions)... you
> >>>> may be able to see the cause of the failure from the core file (the core
> >>>> files on my systems were in several directories so you may have to do a
> >>>> 'find' to locate them.) Load may be a factor but the failures generally
> >>>> come after the load has been heavy for a while. I am running a couple of
> >>>> applications and it seems the failures are more frequent when people are
> >>>> hitting the additional apps (the primary app is always used, the
> >>>> remaining
> >>>> apps are used sporatically.)
> >>>>
> >>>> How does this compare to what you are experiencing?
> >>>>
> >>>> Thanks,
> >>>>
> >>>> Carl
> >>>>
> >>>> ----- Original Message -----
> >>>> From: "Taylan Develioglu"<td...@ebuddy.com>
> >>>> To: "Tomcat Users List"<us...@pidster.com>
> >>>> Sent: Wednesday, February 24, 2010 5:09 AM
> >>>> Subject: Re: jvm exits without trace
> >>>>
> >>>>
> >>>>> The GC log shows plenty of heap space left in all the spaces.
> >>>>>
> >>>>> I purposely didn't bother replacing the variables because I figured
> >>>>> they
> >>>>> would not be relevant.
> >>>>>
> >>>>> But if you think they might provide clues they're as follows:
> >>>>>
> >>>>> JAVA_HEAP_SIZE=18432M
> >>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed 's/M$\|G$//')/6))M
> >>>>> JAVA_PERM_SIZE=128M
> >>>>> JAVA_STCK_SIZE=128K
> >>>>>
> >>>>> EDEN_SIZE is 1/6th of total heap.
> >>>>>
> >>>>> And I said there was nothing in the system logs.
> >>>>> But you get a couple of points for trying.
> >>>>>
> >>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
> >>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
> >>>>>>> I thought I'd add the connector definitions too, :
> >>>>>>>
> >>>>>>> <Connector port="80"
> >>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> >>>>>>> compression="1024" keepAliveTimeout="60000"
> >>>>>>> maxKeepAliveRequests="-1"
> >>>>>>> enableLookups="false" redirectPort="443"
> >>>>>>> maxThreads="150"
> >>>>>>> pollerSize="32768"
> >>>>>>> pollerThreadCount="4"/>
> >>>>>>>
> >>>>>>> <Connector port="443"
> >>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
> >>>>>>> SSLEnabled="true"
> >>>>>>> enableLookups="false" maxThreads="10" scheme="https"
> >>>>>>> secure="true"
> >>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
> >>>>>>>
> >>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
> >>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
> >>>>>>>
> >>>>>>>
> >>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
> >>>>>>>> Hi,
> >>>>>>>>
> >>>>>>>> I have jvm's, running tomcat and our application, exiting
> >>>>>>>> mysteriously,
> >>>>>>>> and was wondering if anyone could give me some advice on how to
> >>>>>>>> debug
> >>>>>>>> this thing.
> >>>>>>>>
> >>>>>>>> There is nothing in catalina.out, nor our application logs, and no
> >>>>>>>> hotspot error file. GC log looks normal. No trace in system logs.
> >>>>>>>>
> >>>>>>>> I am left completely clueless :(, has anyone dealt with a problem
> >>>>>>>> like
> >>>>>>>> this before?
> >>>>>>>>
> >>>>>>>> Any help appreciated.
> >>>>>>>>
> >>>>>>>> - Tomcat 6.0.24
> >>>>>>>> - TC native 1.1.18
> >>>>>>>> - APR 1.3.9
> >>>>>>>> - Sun JDK 6u18
> >>>>>>>> - Debian Lenny, 2.6.31.10-amd64
> >>>>>>>>
> >>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use TCNative/APR.
> >>>>>>>>
> >>>>>>>> JAVA_OPTS ( ):
> >>>>>>>>
> >>>>>>>> -verbose:gc
> >>>>>>>> -Djava.awt.headless=true
> >>>>>>>> -Dsun.net.inetaddr.ttl=60
> >>>>>>>> -Dfile.encoding=UTF-8
> >>>>>>>> -Djava.io.tmpdir=$TMP_DIR
> >>>>>>>> -Djava.library.path=/usr/local/lib
> >>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
> >>>>>>>> -Dcatalina.base=$CATALINA_BASE
> >>>>>>>> -Dcatalina.home=$CATALINA_HOME
> >>>>>>
> >>>>>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> >>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
> >>>>>>>> -XX:+PrintGCDetails
> >>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
> >>>>>>>> -XX:+UseConcMarkSweepGC
> >>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
> >>>>>>>> -Xms$JAVA_HEAP_SIZE
> >>>>>>>> -Xmx$JAVA_HEAP_SIZE
> >>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
> >>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
> >>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
> >>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
> >>>>>>>> -Xss$JAVA_STCK_SIZE
> >>>>>>>> -XX:+UseLargePages
> >>>>>>
> >>>>>> There's no actual heap size settings in the above. But you get a
> >>>>>> couple
> >>>>>> of points for trying.
> >>>>>>
> >>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then check the
> >>>>>> server logs carefully. (e.g. /var/log/messages)
> >>>>>>
> >>>>>>
> >>>>>> p
> >>>>>>
> >>>>>>> ---------------------------------------------------------------------
> >>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>> ---------------------------------------------------------------------
> >>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> ---------------------------------------------------------------------
> >>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>> ---------------------------------------------------------------------
> >>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>>
> >>>
> >>>
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >>> For additional commands, e-mail: users-help@tomcat.apache.org
> >>>
> >>>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> >> For additional commands, e-mail: users-help@tomcat.apache.org
> >>
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> > For additional commands, e-mail: users-help@tomcat.apache.org
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: jvm exits without trace
Posted by Pid <pi...@pidster.com>.
On 03/03/2010 09:11, Taylan Develioglu wrote:
> Downgrading to 1.6.0_16 did not help. I'm replacing the apr connector
> with http now.
As Chuck mentioned in the other thread, significant changes occurred at
1.6.10, so trying the release before (1.6.7) might be necessary to
establish a better determination.
p
> On Wed, 2010-02-24 at 14:52 +0100, Carl wrote:
>> Taylan,
>>
>>> The failures we've seen are in anywhere between 8 hours to a week of
>>> runtime.
>>
>> The timing of the failures seems similar.
>>
>>> We have also had failures with hotspot error files (hs_err) present, and
>>> the cause specified was indeed SIGSEGV indicating a page fault.
>>
>> I have never seen any hs_* files but have seen core files where strace
>> showed the jvm stopped on a seg fault.
>>
>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
>>> the situation allows (during regular updates of the application, or a
>>> crash) to see if that helps.
>>
>> I have used jdk 1.6.0_17 and 1.6.0_18 with the same results... have not
>> tried 1.6.0_16. Please post your results of this trial.
>>
>>> Running tomcat on the
>>> foreground might show something, but then again I could be waiting for a
>>> month for it to happen.
>>
>> Yes, this has been part of my problem as anytime we change something, we
>> have to wait a week for the server to fail.
>>
>> In one sense, I am fortunate that I have a little more flexibility than you.
>> I have two servers (different hardware) but only need one in service at a
>> time. Therefore, I always have one server I can test ideas on although I
>> have never been able to develop a meaningful stress test, i.e., the only way
>> I can test a change is to put it in production.
>>
>> Thanks,
>>
>> Carl
>>
>> ----- Original Message -----
>> From: "Taylan Develioglu"<td...@ebuddy.com>
>> To: "Tomcat Users List"<us...@tomcat.apache.org>
>> Sent: Wednesday, February 24, 2010 8:31 AM
>> Subject: Re: jvm exits without trace
>>
>>
>>> Hello Carl,
>>>
>>> The failures we've seen are in anywhere between 8 hours to a week of
>>> runtime. Most of them have (still) been running for almost a month
>>> without failure. There are ~100 machines.
>>>
>>> > From the top of my head, I think we've had about 10+ failures now.
>>>
>>> We have also had failures with hotspot error files (hs_err) present, and
>>> the cause specified was indeed SIGSEGV indicating a page fault. But I
>>> don't know if the two are related.
>>>
>>> We also use jdk 1.6.0_18, I'm downgrading the machines to 1.6.0_16 when
>>> the situation allows (during regular updates of the application, or a
>>> crash) to see if that helps.
>>>
>>> It might be useful to note that the failures happen with tomcat 6.0.20
>>> as well as 6.0.24.
>>>
>>> As far as load concerns, I haven't had a failure on an idle machines.
>>> The machines are well loaded, but only at a fraction limit in regards to
>>> load and cpu utilization.
>>> Most memory is commited to tomcat, where a 24G machine would have 18G
>>> allocated to heap, 128M to permgen and some unspecified amount would get
>>> used by jni for apr. About 4G remains free after calculating taking into
>>> account the jvm itsself.
>>> A 16G machine would have 12G allocated to the heap.
>>>
>>> Besides the fact that our apps heavily use nio and mina I wouldn't say
>>> there's anything else noteworthy. There can be anywhere up to 10000
>>> concurrents on one machine.
>>>
>>> I had searched for coredumps, but no luck. Running tomcat on the
>>> foreground might show something, but then again I could be waiting for a
>>> month for it to happen.
>>>
>>> On Wed, 2010-02-24 at 12:42 +0100, Carl wrote:
>>>> Taylan,
>>>>
>>>> I am the person who started the "Tomcat dies suddenly" thread which I
>>>> still
>>>> haven't resolved. I am curious about the pattern of failures you are
>>>> experiencing because they may provide some clues to my problem. In my
>>>> case,
>>>> the system will run for 15 minutes to 10 days before failing (most of the
>>>> time it is several days to a week.) It appears to die from a seg fault
>>>> in
>>>> the JVM (I am using Sun 1.6.0_18 but have tried previous versions)... you
>>>> may be able to see the cause of the failure from the core file (the core
>>>> files on my systems were in several directories so you may have to do a
>>>> 'find' to locate them.) Load may be a factor but the failures generally
>>>> come after the load has been heavy for a while. I am running a couple of
>>>> applications and it seems the failures are more frequent when people are
>>>> hitting the additional apps (the primary app is always used, the
>>>> remaining
>>>> apps are used sporatically.)
>>>>
>>>> How does this compare to what you are experiencing?
>>>>
>>>> Thanks,
>>>>
>>>> Carl
>>>>
>>>> ----- Original Message -----
>>>> From: "Taylan Develioglu"<td...@ebuddy.com>
>>>> To: "Tomcat Users List"<us...@pidster.com>
>>>> Sent: Wednesday, February 24, 2010 5:09 AM
>>>> Subject: Re: jvm exits without trace
>>>>
>>>>
>>>>> The GC log shows plenty of heap space left in all the spaces.
>>>>>
>>>>> I purposely didn't bother replacing the variables because I figured
>>>>> they
>>>>> would not be relevant.
>>>>>
>>>>> But if you think they might provide clues they're as follows:
>>>>>
>>>>> JAVA_HEAP_SIZE=18432M
>>>>> JAVA_EDEN_SIZE=$(($(echo $JAVA_HEAP_SIZE|sed 's/M$\|G$//')/6))M
>>>>> JAVA_PERM_SIZE=128M
>>>>> JAVA_STCK_SIZE=128K
>>>>>
>>>>> EDEN_SIZE is 1/6th of total heap.
>>>>>
>>>>> And I said there was nothing in the system logs.
>>>>> But you get a couple of points for trying.
>>>>>
>>>>> On Wed, 2010-02-24 at 10:44 +0100, Pid wrote:
>>>>>> On 24/02/2010 09:36, Taylan Develioglu wrote:
>>>>>>> I thought I'd add the connector definitions too, :
>>>>>>>
>>>>>>> <Connector port="80"
>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
>>>>>>> compression="1024" keepAliveTimeout="60000"
>>>>>>> maxKeepAliveRequests="-1"
>>>>>>> enableLookups="false" redirectPort="443"
>>>>>>> maxThreads="150"
>>>>>>> pollerSize="32768"
>>>>>>> pollerThreadCount="4"/>
>>>>>>>
>>>>>>> <Connector port="443"
>>>>>>> protocol="org.apache.coyote.http11.Http11AprProtocol"
>>>>>>> SSLEnabled="true"
>>>>>>> enableLookups="false" maxThreads="10" scheme="https"
>>>>>>> secure="true"
>>>>>>> SSLCertificateFile="/etc/ssl/private/something.crt"
>>>>>>>
>>>>>>> SSLCertificateKeyFile="/etc/ssl/private/something.key"
>>>>>>> SSLCACertificateFile="/etc/ssl/certs/ca.crt"/>
>>>>>>>
>>>>>>>
>>>>>>> On Wed, 2010-02-24 at 10:23 +0100, Taylan Develioglu wrote:
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I have jvm's, running tomcat and our application, exiting
>>>>>>>> mysteriously,
>>>>>>>> and was wondering if anyone could give me some advice on how to
>>>>>>>> debug
>>>>>>>> this thing.
>>>>>>>>
>>>>>>>> There is nothing in catalina.out, nor our application logs, and no
>>>>>>>> hotspot error file. GC log looks normal. No trace in system logs.
>>>>>>>>
>>>>>>>> I am left completely clueless :(, has anyone dealt with a problem
>>>>>>>> like
>>>>>>>> this before?
>>>>>>>>
>>>>>>>> Any help appreciated.
>>>>>>>>
>>>>>>>> - Tomcat 6.0.24
>>>>>>>> - TC native 1.1.18
>>>>>>>> - APR 1.3.9
>>>>>>>> - Sun JDK 6u18
>>>>>>>> - Debian Lenny, 2.6.31.10-amd64
>>>>>>>>
>>>>>>>> 2 servlets, one as ROOT. 2 HTTP connectors that use TCNative/APR.
>>>>>>>>
>>>>>>>> JAVA_OPTS ( ):
>>>>>>>>
>>>>>>>> -verbose:gc
>>>>>>>> -Djava.awt.headless=true
>>>>>>>> -Dsun.net.inetaddr.ttl=60
>>>>>>>> -Dfile.encoding=UTF-8
>>>>>>>> -Djava.io.tmpdir=$TMP_DIR
>>>>>>>> -Djava.library.path=/usr/local/lib
>>>>>>>> -Djava.endorsed.dirs=$CATALINA_BASE/endorsed
>>>>>>>> -Dcatalina.base=$CATALINA_BASE
>>>>>>>> -Dcatalina.home=$CATALINA_HOME
>>>>>>
>>>>>>>> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
>>>>>>>> -Djava.util.logging.config.file="$CATALINA_BASE/conf/logging.properties"
>>>>>>>> -XX:+PrintGCDetails
>>>>>>>> -Xloggc:$CATALINA_BASE/logs/gc.log
>>>>>>>> -XX:+UseConcMarkSweepGC
>>>>>>>> -XX:CMSInitiatingOccupancyFraction=70
>>>>>>>> -Xms$JAVA_HEAP_SIZE
>>>>>>>> -Xmx$JAVA_HEAP_SIZE
>>>>>>>> -XX:NewSize=$JAVA_EDEN_SIZE
>>>>>>>> -XX:MaxNewSize=$JAVA_EDEN_SIZE
>>>>>>>> -XX:PermSize=$JAVA_PERM_SIZE
>>>>>>>> -XX:MaxPermSize=$JAVA_PERM_SIZE
>>>>>>>> -Xss$JAVA_STCK_SIZE
>>>>>>>> -XX:+UseLargePages
>>>>>>
>>>>>> There's no actual heap size settings in the above. But you get a
>>>>>> couple
>>>>>> of points for trying.
>>>>>>
>>>>>> Google "Linux Out Of Memory killer" or "OOM Killer" and then check the
>>>>>> server logs carefully. (e.g. /var/log/messages)
>>>>>>
>>>>>>
>>>>>> p
>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>>>>
>>>>>>
>>>>>>
>>>>>> ---------------------------------------------------------------------
>>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>>
>>>>>
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>>
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>>> For additional commands, e-mail: users-help@tomcat.apache.org
>>>
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
>> For additional commands, e-mail: users-help@tomcat.apache.org
>>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org