You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by Barak Yaish <ba...@peer39.com> on 2008/04/28 14:28:19 UTC

Tomcat HTTTP Connectior Hangs

Hello all,

 

I'm running tomcat 5.5.23 on CentOS5 machine, JAVA1.6.2. Once every few
days, Tomcat hangs. The Servlet deployed into it seems to be still running
(keep writing to log), but telnet to 8080 hangs, browsing to tomcat'
homepage hangs. Catalina.out doesn't show any exceptions, thread dump of the
JVM running the tomcat does not show any stuck thread. Load on the tomcat is
not heavy, about 20 requests per minute.

 

Restarting tomcat helps, until the next stuck.

 

Can anyone please advice how to debug and track down this problem?

 

Thanks,

 

Barak.


Re: Tomcat HTTTP Connectior Hangs

Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Barak,

Barak Yaish wrote:
| Please, can someone explain me why a thread that waits for a connection
| hangs the HTTP Connector? This thread is not part of the flow of
serving an
| HTTP request.

Nobody can read your thread dump. How did you produce it? Most thread
dumps have names of methods and such, while this one only has class
names and a status (like "waiting"... waiting on what?!).

Try using "kill -QUIT" on your application and then copy the thread dump
from catalina.out.

- -chris

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (MingW32)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkgXI4UACgkQ9CaO5/Lv0PCxVwCfc33gSmh2/JQuIwusFOEdLtQD
AwwAn3qfAPkQ3bQZEW29IYTUskQaWfdx
=g5Cu
-----END PGP SIGNATURE-----

---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: Tomcat HTTTP Connectior Hangs

Posted by Mark Thomas <ma...@apache.org>.
Barak Yaish wrote:
> Hello all,
> 
> I've started the attached post in users mailing list, which helped me to
> track down the problem.
> I'm reposting here now in order to understand the problem.

Please keep this thread to the users list where it belongs.

Mark


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


Tomcat HTTTP Connectior Hangs

Posted by Barak Yaish <ba...@peer39.com>.
Hello all,

I've started the attached post in users mailing list, which helped me to
track down the problem.
I'm reposting here now in order to understand the problem.

I'm running tomcat 5.5.17 on CentOS5. The problem is that the HTTP connector
hangs (browsing to homepage is impossible, local telnet to port 8080 is
hangs)
when one of the threads running in the Web Application is waiting forever
for a db connection from the pool. 
This thread is not part of the flow of serving an HTTP request.

My question, why this stuck thread cause the HTTP connector to hang?

Please see below the tomcat thread dump and the stack trace of the stack
thread.

THREAD DUMP:


Group system:
  (java.lang.ref.Reference$ReferenceHandler)0x1833
Reference Handler                                               cond.
waiting
  (java.lang.ref.Finalizer$FinalizerThread)0x1834
Finalizer                                                       cond.
waiting
  (java.lang.Thread)0x1835
Signal Dispatcher                                               running
  (java.lang.Thread)0x1836
RMI Scheduler(0)                                                cond.
waiting
  (java.lang.Thread)0x1837
RMI RenewClean-[prod29:37355]
cond. waiting
  (sun.misc.GC$Daemon)0x1838
GC Daemon                                                       cond.
waiting
  (java.lang.Thread)0x1839
RMI RenewClean-[prod31:45514]                     		cond.
waiting
  (java.lang.Thread)0x183a
RMI RenewClean-[prod7:46845]                      		cond.
waiting
  (java.lang.Thread)0x183b
RMI RenewClean-[prod15:33128]                     		cond.
waiting
  (java.lang.Thread)0x183c
RMI RenewClean-[prod12:45154]                     		cond.
waiting
Group main:
  (java.lang.Thread)0x183f
main                                                            running
  (java.util.TimerThread)0x1840
Timer-0                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1841
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1842
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1843
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (java.util.TimerThread)0x1845
Timer-1                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1846
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1847
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1848
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (java.util.TimerThread)0x184a
Timer-2                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184b
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184c
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184d
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (com.barak.deamon.lookup.LookupDaemon)0x184e                  Thread-18
cond. waiting
  (com.barak.deamon.logger.LoggerDaemon2)0x184f                 Thread-19
sleeping
  (com.barak.deamon.loadbalancing.LoadBalancerDaemon)0x1850     Thread-20
sleeping
  (java.util.TimerThread)0x1851
Timer-3                                                         cond.
waiting
  (java.lang.Thread)0x1852
ContainerBackgroundProcessor[StandardEngine[Catalina]]          sleeping
  (java.lang.Thread)0x1853
http-80-Monitor                                                 cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1854
TP-Processor1                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1855
TP-Processor2                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1856
TP-Processor3                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1857
TP-Processor4                                                   running
  (java.lang.Thread)0x1858
TP-Monitor                                                      cond.
waiting
  (java.lang.Thread)0x1859
pool-1-thread-1                                                 cond.
waiting
  (java.lang.Thread)0x185a
pool-1-thread-2                                                 cond.
waiting
  (java.lang.Thread)0x185b
pool-1-thread-3                                                 cond.
waiting
  (java.lang.Thread)0x185c
pool-1-thread-4                                                 cond.
waiting
  (java.lang.Thread)0x185d
pool-1-thread-5                                                 cond.
waiting
  (java.lang.Thread)0x185e
pool-1-thread-6                                                 cond.
waiting
  (java.lang.Thread)0x185f
pool-1-thread-7                                                 cond.
waiting
  (java.lang.Thread)0x1860
pool-1-thread-8                                                 cond.
waiting
  (java.lang.Thread)0x1861
pool-1-thread-9                                                 cond.
waiting
  (java.lang.Thread)0x1862
pool-1-thread-10                                                cond.
waiting
  (java.lang.Thread)0x1863
pool-1-thread-11                                                cond.
waiting
  (java.lang.Thread)0x1864
pool-1-thread-12                                                cond.
waiting
  (java.lang.Thread)0x1865
pool-1-thread-13                                                cond.
waiting
  (java.lang.Thread)0x1866
pool-1-thread-14                                                cond.
waiting
  (java.lang.Thread)0x1867
pool-1-thread-15                                                cond.
waiting
  (java.lang.Thread)0x1868
pool-1-thread-16                                                cond.
waiting
  (java.lang.Thread)0x1869
pool-1-thread-17                                                cond.
waiting
  (java.lang.Thread)0x186a
pool-1-thread-18                                                cond.
waiting
  (java.lang.Thread)0x186b
pool-1-thread-19                                                cond.
waiting
  (java.lang.Thread)0x186c
pool-1-thread-20                                                cond.
waiting
  (java.lang.Thread)0x186d
pool-1-thread-21                                                cond.
waiting
  (java.lang.Thread)0x186e
pool-1-thread-22                                                cond.
waiting
  (java.lang.Thread)0x186f
pool-1-thread-23                                                cond.
waiting
  (java.lang.Thread)0x1870
pool-1-thread-24                                                cond.
waiting
  (java.lang.Thread)0x1871
pool-1-thread-25                                                cond.
waiting
  (java.lang.Thread)0x1872
pool-1-thread-26                                                cond.
waiting
  (java.lang.Thread)0x1873
pool-1-thread-27                                                cond.
waiting
  (java.lang.Thread)0x1874
pool-1-thread-28                                                cond.
waiting
  (java.lang.Thread)0x1875
pool-1-thread-29                                                cond.
waiting
  (java.lang.Thread)0x1876
pool-1-thread-30                                                cond.
waiting
  (java.lang.Thread)0x1877
pool-1-thread-31                                                cond.
waiting
  (java.lang.Thread)0x1878
pool-1-thread-32                                                cond.
waiting
  (java.lang.Thread)0x1879
pool-1-thread-33                                                cond.
waiting
  (java.lang.Thread)0x187a
pool-1-thread-34                                                cond.
waiting
  (java.lang.Thread)0x187b
pool-1-thread-35                                                cond.
waiting
  (java.lang.Thread)0x187c
pool-1-thread-36                                                cond.
waiting
  (java.lang.Thread)0x187d
pool-1-thread-37                                                cond.
waiting
  (java.lang.Thread)0x187e
pool-1-thread-38                                                cond.
waiting
  (java.lang.Thread)0x187f
pool-1-thread-39                                                cond.
waiting
  (java.lang.Thread)0x1880
pool-1-thread-40                                                cond.
waiting
  (java.lang.Thread)0x1881
pool-1-thread-41                                                cond.
waiting
  (java.lang.Thread)0x1882
pool-1-thread-42                                                cond.
waiting
  (java.lang.Thread)0x1883
pool-1-thread-43                                                cond.
waiting
  (java.lang.Thread)0x1884
pool-1-thread-44                                                cond.
waiting
  (java.lang.Thread)0x1885
pool-1-thread-45                                                cond.
waiting
  (java.lang.Thread)0x1886
pool-1-thread-46                                                cond.
waiting
  (java.lang.Thread)0x1887
pool-1-thread-47                                                cond.
waiting
  (java.lang.Thread)0x1888
pool-1-thread-48                                                cond.
waiting
  (java.lang.Thread)0x1889
pool-1-thread-49                                                cond.
waiting
  (java.lang.Thread)0x188a
pool-1-thread-50                                                cond.
waiting
  (java.lang.Thread)0x188b
pool-1-thread-51                                                cond.
waiting
  (java.lang.Thread)0x188c
pool-1-thread-52                                                cond.
waiting
  (java.lang.Thread)0x188d
pool-1-thread-53                                                cond.
waiting
  (java.lang.Thread)0x188e
pool-1-thread-54                                                cond.
waiting
  (java.lang.Thread)0x188f
pool-1-thread-55                                                cond.
waiting
  (java.lang.Thread)0x1890
pool-1-thread-56                                                cond.
waiting
  (java.lang.Thread)0x1891
pool-1-thread-57                                                cond.
waiting
  (java.lang.Thread)0x1892
pool-1-thread-58                                                cond.
waiting
  (java.lang.Thread)0x1893
pool-1-thread-59                                                cond.
waiting
  (java.lang.Thread)0x1894
pool-1-thread-60                                                cond.
waiting
  (java.lang.Thread)0x1895
pool-1-thread-61                                                cond.
waiting
  (java.lang.Thread)0x1896
pool-1-thread-62                                                cond.
waiting
  (java.lang.Thread)0x1897
pool-1-thread-63                                                cond.
waiting
  (java.lang.Thread)0x1898
pool-1-thread-64                                                cond.
waiting
  (java.lang.Thread)0x1899
pool-1-thread-65                                                cond.
waiting
  (java.lang.Thread)0x189a
pool-1-thread-66                                                cond.
waiting
  (java.lang.Thread)0x189b
pool-1-thread-67                                                cond.
waiting
  (java.lang.Thread)0x189c
pool-1-thread-68                                                cond.
waiting
  (java.lang.Thread)0x189d
pool-1-thread-69                                                cond.
waiting
  (java.lang.Thread)0x189e
pool-1-thread-70                                                cond.
waiting
  (java.lang.Thread)0x189f
pool-1-thread-71                                                cond.
waiting
  (java.lang.Thread)0x18a0
pool-1-thread-72                                                cond.
waiting
  (java.lang.Thread)0x18a1
pool-1-thread-73                                                cond.
waiting
  (java.lang.Thread)0x18a2
pool-1-thread-74                                                cond.
waiting
  (java.lang.Thread)0x18a3
pool-1-thread-75                                                cond.
waiting
  (java.lang.Thread)0x18a4
pool-1-thread-76                                                cond.
waiting
  (java.lang.Thread)0x18a5
pool-1-thread-77                                                cond.
waiting
  (java.lang.Thread)0x18a6
pool-1-thread-78                                                cond.
waiting
  (java.lang.Thread)0x18a7
pool-1-thread-79                                                cond.
waiting
  (java.lang.Thread)0x18a8
pool-1-thread-80                                                cond.
waiting
  (java.lang.Thread)0x18a9
pool-1-thread-81                                                cond.
waiting
  (java.lang.Thread)0x18aa
pool-1-thread-82                                                cond.
waiting
  (java.lang.Thread)0x18ab
pool-1-thread-83                                                cond.
waiting
  (java.lang.Thread)0x18ac
pool-1-thread-84                                                cond.
waiting
  (java.lang.Thread)0x18ad
pool-1-thread-85                                                cond.
waiting
  (java.lang.Thread)0x18ae
pool-1-thread-86                                                cond.
waiting
  (java.lang.Thread)0x18af
pool-1-thread-87                                                cond.
waiting
  (java.lang.Thread)0x18b0
pool-1-thread-88                                                cond.
waiting
  (java.lang.Thread)0x18b1
pool-1-thread-89                                                cond.
waiting
  (java.lang.Thread)0x18b2
pool-1-thread-90                                                cond.
waiting
  (java.lang.Thread)0x18b3
pool-1-thread-91                                                cond.
waiting
  (java.lang.Thread)0x18b4
pool-1-thread-92                                                cond.
waiting
  (java.lang.Thread)0x18b5
pool-1-thread-93                                                cond.
waiting
  (java.lang.Thread)0x18b6
pool-1-thread-94                                                cond.
waiting
  (java.lang.Thread)0x18b7
pool-1-thread-95                                                cond.
waiting
  (java.lang.Thread)0x18b8
pool-1-thread-96                                                cond.
waiting
  (java.lang.Thread)0x18b9
pool-1-thread-97                                                cond.
waiting
  (java.lang.Thread)0x18ba
pool-1-thread-98                                                cond.
waiting
  (java.lang.Thread)0x18bb
pool-1-thread-99                                                cond.
waiting
  (java.lang.Thread)0x18bc
pool-1-thread-100                                               cond.
waiting
  (java.lang.Thread)0x18bd
pool-1-thread-101                                               cond.
waiting
  (java.lang.Thread)0x18be
pool-1-thread-102                                               cond.
waiting
  (java.lang.Thread)0x18bf
pool-1-thread-103                                               cond.
waiting
  (java.lang.Thread)0x18c0
pool-1-thread-104                                               cond.
waiting
  (java.lang.Thread)0x18c1
pool-1-thread-105                                               cond.
waiting
  (java.lang.Thread)0x18c2
pool-1-thread-106                                               cond.
waiting
  (java.lang.Thread)0x18c3
pool-1-thread-107                                               cond.
waiting
  (java.lang.Thread)0x18c4
pool-1-thread-108                                               cond.
waiting
  (java.lang.Thread)0x18c5
pool-1-thread-109                                               cond.
waiting
  (java.lang.Thread)0x18c6
pool-1-thread-110                                               cond.
waiting
  (java.lang.Thread)0x18c7
pool-1-thread-111                                               cond.
waiting
  (java.lang.Thread)0x18c8
pool-1-thread-112                                               cond.
waiting
  (java.lang.Thread)0x18c9
pool-1-thread-113                                               cond.
waiting
  (java.lang.Thread)0x18ca
pool-1-thread-114                                               cond.
waiting
  (java.lang.Thread)0x18cb
pool-1-thread-115                                               cond.
waiting
  (java.lang.Thread)0x18cc
pool-1-thread-116                                               cond.
waiting
  (java.lang.Thread)0x18cd
pool-1-thread-117                                               cond.
waiting
  (java.lang.Thread)0x18ce
pool-1-thread-118                                               cond.
waiting
  (java.lang.Thread)0x18cf
pool-1-thread-119                                               cond.
waiting
  (java.lang.Thread)0x18d0
pool-1-thread-120                                               cond.
waiting
  (java.lang.Thread)0x18d1
pool-1-thread-121                                               cond.
waiting
  (java.lang.Thread)0x18d2
pool-1-thread-122                                               cond.
waiting
  (java.lang.Thread)0x18d3
pool-1-thread-123                                               cond.
waiting
  (java.lang.Thread)0x18d4
pool-1-thread-124                                               cond.
waiting
  (java.lang.Thread)0x18d5
pool-1-thread-125                                               cond.
waiting
  (java.lang.Thread)0x18d6
pool-1-thread-126                                               cond.
waiting
  (java.lang.Thread)0x18d7
pool-1-thread-127                                               cond.
waiting
  (java.lang.Thread)0x18d8
pool-1-thread-128                                               cond.
waiting
  (java.lang.Thread)0x18d9
pool-1-thread-129                                               cond.
waiting
  (java.lang.Thread)0x18da
pool-1-thread-130                                               cond.
waiting
  (java.lang.Thread)0x18db
pool-1-thread-131                                               cond.
waiting
  (java.lang.Thread)0x18dc
pool-1-thread-132                                               cond.
waiting
  (java.lang.Thread)0x18dd
pool-1-thread-133                                               cond.
waiting
  (java.lang.Thread)0x18de
pool-1-thread-134                                               cond.
waiting
  (java.lang.Thread)0x18df
pool-1-thread-135                                               cond.
waiting
  (java.lang.Thread)0x18e0
pool-1-thread-136                                               cond.
waiting
  (java.lang.Thread)0x18e1
pool-1-thread-137                                               cond.
waiting
  (java.lang.Thread)0x18e2
pool-1-thread-138                                               cond.
waiting
  (java.lang.Thread)0x18e3
pool-1-thread-139                                               cond.
waiting
  (java.lang.Thread)0x18e4
pool-1-thread-140                                               cond.
waiting
  (java.lang.Thread)0x18e5
pool-1-thread-141                                               cond.
waiting
  (java.lang.Thread)0x18e6
pool-1-thread-142                                               cond.
waiting
  (java.lang.Thread)0x18e7
pool-1-thread-143                                               cond.
waiting
  (java.lang.Thread)0x18e8
pool-1-thread-144                                               cond.
waiting
  (java.lang.Thread)0x18e9
pool-1-thread-145                                               cond.
waiting
  (java.lang.Thread)0x18ea
pool-1-thread-146                                               cond.
waiting
  (java.lang.Thread)0x18eb
pool-1-thread-147                                               cond.
waiting
  (java.lang.Thread)0x18ec
pool-1-thread-148                                               cond.
waiting
  (java.lang.Thread)0x18ed
pool-1-thread-149                                               cond.
waiting
  (java.lang.Thread)0x18ee
pool-1-thread-150                                               cond.
waiting
  (java.lang.Thread)0x18ef
pool-1-thread-151                                               cond.
waiting
  (java.lang.Thread)0x18f0
pool-1-thread-152                                               cond.
waiting
  (java.lang.Thread)0x18f1
pool-1-thread-153                                               cond.
waiting
  (java.lang.Thread)0x18f2
pool-1-thread-154                                               cond.
waiting
  (java.lang.Thread)0x18f3
pool-1-thread-155                                               cond.
waiting
  (java.lang.Thread)0x18f4
pool-1-thread-156                                               cond.
waiting
  (java.lang.Thread)0x18f5
pool-1-thread-157                                               cond.
waiting
  (java.lang.Thread)0x18f6
pool-1-thread-158                                               cond.
waiting
  (java.lang.Thread)0x18f7
pool-1-thread-159                                               cond.
waiting
  (java.lang.Thread)0x18f8
pool-1-thread-160                                               cond.
waiting
  (java.lang.Thread)0x18f9
pool-1-thread-161                                               cond.
waiting
  (java.lang.Thread)0x18fa
pool-1-thread-162                                               cond.
waiting
  (java.lang.Thread)0x18fb
pool-1-thread-163                                               cond.
waiting
  (java.lang.Thread)0x18fc
pool-1-thread-164                                               cond.
waiting
  (java.lang.Thread)0x18fd
pool-1-thread-165                                               cond.
waiting
  (java.lang.Thread)0x18fe
pool-1-thread-166                                               cond.
waiting
  (java.lang.Thread)0x18ff
pool-1-thread-167                                               cond.
waiting
  (java.lang.Thread)0x1900
pool-1-thread-168                                               cond.
waiting
  (java.lang.Thread)0x1901
pool-1-thread-169                                               cond.
waiting
  (java.lang.Thread)0x1902
pool-1-thread-170                                               cond.
waiting
  (java.lang.Thread)0x1903
pool-1-thread-171                                               cond.
waiting
  (java.lang.Thread)0x1904
pool-1-thread-172                                               cond.
waiting
  (java.lang.Thread)0x1905
pool-1-thread-173                                               cond.
waiting
  (java.lang.Thread)0x1906
pool-1-thread-174                                               cond.
waiting
  (java.lang.Thread)0x1907
pool-1-thread-175                                               cond.
waiting
  (java.lang.Thread)0x1908
pool-1-thread-176                                               cond.
waiting
  (java.lang.Thread)0x1909
pool-1-thread-177                                               cond.
waiting
  (java.lang.Thread)0x190a
pool-1-thread-178                                               cond.
waiting
  (java.lang.Thread)0x190b
pool-1-thread-179                                               cond.
waiting
  (java.lang.Thread)0x190c
pool-1-thread-180                                               cond.
waiting
  (java.lang.Thread)0x190d
pool-1-thread-181                                               cond.
waiting
  (java.lang.Thread)0x190e
pool-1-thread-182                                               cond.
waiting
  (java.lang.Thread)0x190f
pool-1-thread-183                                               cond.
waiting
  (java.lang.Thread)0x1910
pool-1-thread-184                                               cond.
waiting
  (java.lang.Thread)0x1911
pool-1-thread-185                                               cond.
waiting
  (java.lang.Thread)0x1912
pool-1-thread-186                                               cond.
waiting
  (java.lang.Thread)0x1913
pool-1-thread-187                                               cond.
waiting
  (java.lang.Thread)0x1914
pool-1-thread-188                                               cond.
waiting
  (java.lang.Thread)0x1915
pool-1-thread-189                                               cond.
waiting
  (java.lang.Thread)0x1916
pool-1-thread-190                                               cond.
waiting
  (java.lang.Thread)0x1917
pool-1-thread-191                                               cond.
waiting
  (java.lang.Thread)0x1918
pool-1-thread-192                                               cond.
waiting
  (java.lang.Thread)0x1919
pool-1-thread-193                                               cond.
waiting
  (java.lang.Thread)0x191a
pool-1-thread-194                                               cond.
waiting
  (java.lang.Thread)0x191b
pool-1-thread-195                                               cond.
waiting
  (java.lang.Thread)0x191c
pool-1-thread-196                                               cond.
waiting
  (java.lang.Thread)0x191d
pool-1-thread-197                                               cond.
waiting
  (java.lang.Thread)0x191e
pool-1-thread-198                                               cond.
waiting
  (java.lang.Thread)0x191f
pool-1-thread-199                                               cond.
waiting
  (java.lang.Thread)0x1920
pool-1-thread-200                                               cond.
waiting
  (java.lang.Thread)0x1921
pool-1-thread-201                                               cond.
waiting
  (java.lang.Thread)0x1922
pool-1-thread-202                                               cond.
waiting
  (java.lang.Thread)0x1923
pool-1-thread-203                                               cond.
waiting
  (java.lang.Thread)0x1924
pool-1-thread-204                                               cond.
waiting
  (java.lang.Thread)0x1925
pool-1-thread-205                                               cond.
waiting
  (java.lang.Thread)0x1926
pool-1-thread-206                                               cond.
waiting
  (java.lang.Thread)0x1927
pool-1-thread-207                                               cond.
waiting
  (java.lang.Thread)0x1928
pool-1-thread-208                                               cond.
waiting
  (java.lang.Thread)0x1929
pool-1-thread-209                                               cond.
waiting
  (java.lang.Thread)0x192a
pool-1-thread-210                                               cond.
waiting
  (java.lang.Thread)0x192b
pool-1-thread-211                                               cond.
waiting
  (java.lang.Thread)0x192c
pool-1-thread-212                                               cond.
waiting
  (java.lang.Thread)0x192d
pool-1-thread-213                                               cond.
waiting
  (java.lang.Thread)0x192e
pool-1-thread-214                                               cond.
waiting
  (java.lang.Thread)0x192f
pool-1-thread-215                                               cond.
waiting
  (java.lang.Thread)0x1930
pool-1-thread-216                                               cond.
waiting
  (java.lang.Thread)0x1931
pool-1-thread-217                                               cond.
waiting
  (java.lang.Thread)0x1932
pool-1-thread-218                                               cond.
waiting
  (java.lang.Thread)0x1933
pool-1-thread-219                                               cond.
waiting
  (java.lang.Thread)0x1934
pool-1-thread-220                                               cond.
waiting
  (java.lang.Thread)0x1935
pool-1-thread-221                                               cond.
waiting
  (java.lang.Thread)0x1936
pool-1-thread-222                                               cond.
waiting
  (java.lang.Thread)0x1937
pool-1-thread-223                                               cond.
waiting
  (java.lang.Thread)0x1938
pool-1-thread-224                                               cond.
waiting
  (java.lang.Thread)0x1939
pool-1-thread-225                                               cond.
waiting
  (java.lang.Thread)0x193a
pool-1-thread-226                                               cond.
waiting
  (java.lang.Thread)0x193b
pool-1-thread-227                                               cond.
waiting
  (java.lang.Thread)0x193c
pool-1-thread-228                                               cond.
waiting
  (java.lang.Thread)0x193d
pool-1-thread-229                                               cond.
waiting
  (java.lang.Thread)0x193e
pool-1-thread-230                                               cond.
waiting
  (java.lang.Thread)0x193f
pool-1-thread-231                                               cond.
waiting
  (java.lang.Thread)0x1940
pool-1-thread-232                                               cond.
waiting
  (java.lang.Thread)0x1941
pool-1-thread-233                                               cond.
waiting
  (java.lang.Thread)0x1942
pool-1-thread-234                                               cond.
waiting
  (java.lang.Thread)0x1943
pool-1-thread-235                                               cond.
waiting
  (java.lang.Thread)0x1944
pool-1-thread-236                                               cond.
waiting
  (java.lang.Thread)0x1945
pool-1-thread-237                                               cond.
waiting
  (java.lang.Thread)0x1946
pool-1-thread-238                                               cond.
waiting
  (java.lang.Thread)0x1947
pool-1-thread-239                                               cond.
waiting
  (java.lang.Thread)0x1948
pool-1-thread-240                                               cond.
waiting
  (java.lang.Thread)0x1949
pool-1-thread-241                                               cond.
waiting
  (java.lang.Thread)0x194a
pool-1-thread-242                                               cond.
waiting
  (java.lang.Thread)0x194b
pool-1-thread-243                                               cond.
waiting
  (java.lang.Thread)0x194c
pool-1-thread-244                                               cond.
waiting
  (java.lang.Thread)0x194d
pool-1-thread-245                                               cond.
waiting
  (java.lang.Thread)0x194e
pool-1-thread-246                                               cond.
waiting
  (java.lang.Thread)0x194f
pool-1-thread-247                                               cond.
waiting
  (java.lang.Thread)0x1950
pool-1-thread-248                                               cond.
waiting
  (java.lang.Thread)0x1951
pool-1-thread-249                                               cond.
waiting
  (java.lang.Thread)0x1952
pool-1-thread-250                                               cond.
waiting
  (java.lang.Thread)0x1953
pool-1-thread-251                                               cond.
waiting
  (java.lang.Thread)0x1954
pool-1-thread-252                                               cond.
waiting
  (java.lang.Thread)0x1955
pool-1-thread-253                                               cond.
waiting
  (java.lang.Thread)0x1956
pool-1-thread-254                                               cond.
waiting
  (java.lang.Thread)0x1957
pool-1-thread-255                                               cond.
waiting
  (java.lang.Thread)0x1958
pool-1-thread-256                                               cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1959
http-80-Processor552                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195a
http-80-Processor682                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195b
http-80-Processor722                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195c
http-80-Processor729                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195d
http-80-Processor731                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195e
http-80-Processor742                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195f
http-80-Processor749                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1960
http-80-Processor752                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1961
http-80-Processor776                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1962
http-80-Processor778                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1963
http-80-Processor794                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1964
http-80-Processor805                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1965
http-80-Processor841                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1966
http-80-Processor860                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1967
http-80-Processor861                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1968
http-80-Processor866                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1969
http-80-Processor875                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196a
http-80-Processor879                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196b
http-80-Processor882                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196c
http-80-Processor886                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196d
http-80-Processor889                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196e
http-80-Processor896                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196f
http-80-Processor899                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1970
http-80-Processor900                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1971
http-80-Processor901                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1972
http-80-Processor903                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1973
http-80-Processor906                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1974
http-80-Processor910                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1975
http-80-Processor914                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1976
http-80-Processor915                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1977
http-80-Processor917                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1978
http-80-Processor918                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1979
http-80-Processor919                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197a
http-80-Processor923                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197b
http-80-Processor926                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197c
http-80-Processor936                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197d
http-80-Processor937                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197e
http-80-Processor938                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197f
http-80-Processor941                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1980
http-80-Processor942                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1981
http-80-Processor943                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1982
http-80-Processor947                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1983
http-80-Processor949                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1984
http-80-Processor950                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1985
http-80-Processor951                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1986
http-80-Processor952                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1987
http-80-Processor953                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1988
http-80-Processor957                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1989
http-80-Processor959                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198a
http-80-Processor960                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198b
http-80-Processor961                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198c
http-80-Processor962                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198d
http-80-Processor963                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198e
http-80-Processor964                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198f
http-80-Processor965                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1990
http-80-Processor966                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1991
http-80-Processor971                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1992
http-80-Processor974                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1993
http-80-Processor975                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1994
http-80-Processor976                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1995
http-80-Processor978                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1996
http-80-Processor979                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1997
http-80-Processor980                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1998
http-80-Processor981                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1999
http-80-Processor982                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199a
http-80-Processor983                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199b
http-80-Processor984                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199c
http-80-Processor985                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199d
http-80-Processor987                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199e
http-80-Processor988                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199f
http-80-Processor989                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a0
http-80-Processor990                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a1
http-80-Processor992                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a2
http-80-Processor994                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a3
http-80-Processor996                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a4
http-80-Processor997                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a5
http-80-Processor999                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a6
http-80-Processor1001                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a7
http-80-Processor1002                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a8
http-80-Processor1003                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a9
http-80-Processor1004                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19aa
http-80-Processor1005                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ab
http-80-Processor1006                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ac
http-80-Processor1007                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ad
http-80-Processor1008                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ae
http-80-Processor1009                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19af
http-80-Processor1010                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b0
http-80-Processor1011                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b1
http-80-Processor1012                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b2
http-80-Processor1013                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b3
http-80-Processor1014                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b4
http-80-Processor1015                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b5
http-80-Processor1016                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b6
http-80-Processor1017                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b7
http-80-Processor1018                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b8
http-80-Processor1019                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b9
http-80-Processor1020                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ba
http-80-Processor1022                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bb
http-80-Processor1023                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bc
http-80-Processor1024                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bd
http-80-Processor1025                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19be
http-80-Processor1026                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bf
http-80-Processor1027                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c0
http-80-Processor1028                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c1
http-80-Processor1029                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c2
http-80-Processor1030                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c3
http-80-Processor1031                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c4
http-80-Processor1032                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c5
http-80-Processor1033                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c6
http-80-Processor1034                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c7
http-80-Processor1035                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c8
http-80-Processor1036                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c9
http-80-Processor1037                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ca
http-80-Processor1038                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cb
http-80-Processor1039                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cc
http-80-Processor1040                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cd
http-80-Processor1041                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ce
http-80-Processor1042                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cf
http-80-Processor1043                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d0
http-80-Processor1044                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d1
http-80-Processor1045                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d2
http-80-Processor1046                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d3
http-80-Processor1047                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d4
http-80-Processor1048                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d5
http-80-Processor1049                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d6
http-80-Processor1050                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d7
http-80-Processor1051                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d8
http-80-Processor1052                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d9
http-80-Processor1053                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19da
http-80-Processor1054                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19db
http-80-Processor1055                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19dc
http-80-Processor1056                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19dd
http-80-Processor1057                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19de
http-80-Processor1058                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19df
http-80-Processor1059                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e0
http-80-Processor1060                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e1
http-80-Processor1061                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e2
http-80-Processor1062                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e3
http-80-Processor1063                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e4
http-80-Processor1064                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e5
http-80-Processor1065                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e6
http-80-Processor1066                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e7
http-80-Processor1067                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e8
http-80-Processor1068                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e9
http-80-Processor1069                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ea
http-80-Processor1070                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19eb
http-80-Processor1071                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ec
http-80-Processor1072                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ed
http-80-Processor1073                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ee
http-80-Processor1074                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ef
http-80-Processor1075                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f0
http-80-Processor1076                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f1
http-80-Processor1077                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f2
http-80-Processor1078                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f3
http-80-Processor1079                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f4
http-80-Processor1080                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f5
http-80-Processor1081                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f6
http-80-Processor1082                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f7
http-80-Processor1083                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f8
http-80-Processor1084                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f9
http-80-Processor1085                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fa
http-80-Processor1086                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fb
http-80-Processor1087                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fc
http-80-Processor1088                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fd
http-80-Processor1089                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fe
http-80-Processor1090                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ff
http-80-Processor1091                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a00
http-80-Processor1092                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a01
http-80-Processor1093                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a02
http-80-Processor1094                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a03
http-80-Processor1095                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a04
http-80-Processor1096                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a05
http-80-Processor1097                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a06
http-80-Processor1098                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a07
http-80-Processor1099                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a08
http-80-Processor1100                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a09
http-80-Processor1101                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0a
http-80-Processor1102                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0b
http-80-Processor1103                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0c
http-80-Processor1104                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0d
http-80-Processor1105                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0e
http-80-Processor1106                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0f
http-80-Processor1107                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a10
http-80-Processor1108                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a11
http-80-Processor1109                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a12
http-80-Processor1110                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a13
http-80-Processor1111                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a14
http-80-Processor1112                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a15
http-80-Processor1113                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a16
http-80-Processor1114                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a17
http-80-Processor1115                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a18
http-80-Processor1116                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a19
http-80-Processor1117                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1a
http-80-Processor1118                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1b
http-80-Processor1119                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1c
http-80-Processor1120                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1d
http-80-Processor1121                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1e
http-80-Processor1122                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1f
http-80-Processor1123                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a20
http-80-Processor1124                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a21
http-80-Processor1125                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a22
http-80-Processor1126                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a23
http-80-Processor1127                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a24
http-80-Processor1128                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a25
http-80-Processor1129                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a26
http-80-Processor1130                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a27
http-80-Processor1131                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a28
http-80-Processor1132                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a29
http-80-Processor1133                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2a
http-80-Processor1134                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2b
http-80-Processor1135                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2c
http-80-Processor1136                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2d
http-80-Processor1137                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2e
http-80-Processor1138                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2f
http-80-Processor1139                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a30
http-80-Processor1140                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a31
http-80-Processor1141                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a32
http-80-Processor1142                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a33
http-80-Processor1143                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a34
http-80-Processor1144                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a35
http-80-Processor1145                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a36
http-80-Processor1146                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a37
http-80-Processor1147                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a38
http-80-Processor1148                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a39
http-80-Processor1149                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3a
http-80-Processor1150                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3b
http-80-Processor1151                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3c
http-80-Processor1152                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3d
http-80-Processor1153                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3e
http-80-Processor1154                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3f
http-80-Processor1155                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a40
http-80-Processor1156                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a41
http-80-Processor1157                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a42
http-80-Processor1158                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a43
http-80-Processor1159                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a44
http-80-Processor1160                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a45
http-80-Processor1161                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a46
http-80-Processor1162                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a47
http-80-Processor1163                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a48
http-80-Processor1164                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a49
http-80-Processor1165                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4a
http-80-Processor1166                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4b
http-80-Processor1167                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4c
http-80-Processor1168                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4d
http-80-Processor1169                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4e
http-80-Processor1170                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4f
http-80-Processor1171                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a50
http-80-Processor1172                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a51
http-80-Processor1173                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a52
http-80-Processor1174                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a53
http-80-Processor1175                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a54
http-80-Processor1176                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a55
http-80-Processor1177                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a56
http-80-Processor1178                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a57
http-80-Processor1179                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a58
http-80-Processor1180                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a59
http-80-Processor1181                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5a
http-80-Processor1182                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5b
http-80-Processor1183                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5c
http-80-Processor1184                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5d
http-80-Processor1185                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5e
http-80-Processor1186                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5f
http-80-Processor1187                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a60
http-80-Processor1188                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a61
http-80-Processor1189                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a62
http-80-Processor1190                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a63
http-80-Processor1191                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a64
http-80-Processor1192                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a65
http-80-Processor1193                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a66
http-80-Processor1194                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a67
http-80-Processor1195                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a68
http-80-Processor1196                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a69
http-80-Processor1197                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6a
http-80-Processor1198                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6b
http-80-Processor1199                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6c
http-80-Processor1200                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6d
http-80-Processor1201                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6e
http-80-Processor1202                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6f
http-80-Processor1203                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a70
http-80-Processor1204                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a71
http-80-Processor1205                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a72
http-80-Processor1206                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a73
http-80-Processor1207                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a74
http-80-Processor1208                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a75
http-80-Processor1209                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a76
http-80-Processor1210                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a77
http-80-Processor1211                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a78
http-80-Processor1212                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a79
http-80-Processor1213                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7a
http-80-Processor1214                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7b
http-80-Processor1215                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7c
http-80-Processor1216                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7d
http-80-Processor1217                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7e
http-80-Processor1218                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7f
http-80-Processor1219                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a80
http-80-Processor1220                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a81
http-80-Processor1221                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a82
http-80-Processor1222                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a83
http-80-Processor1223                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a84
http-80-Processor1224                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a85
http-80-Processor1225                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a86
http-80-Processor1226                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a87
http-80-Processor1227                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a88
http-80-Processor1228                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a89
http-80-Processor1229                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8a
http-80-Processor1230                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8b
http-80-Processor1231                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8c
http-80-Processor1232                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8d
http-80-Processor1233                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8e
http-80-Processor1234                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8f
http-80-Processor1235                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a90
http-80-Processor1236                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a91
http-80-Processor1237                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a92
http-80-Processor1238                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a93
http-80-Processor1239                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a94
http-80-Processor1240                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a95
http-80-Processor1241                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a96
http-80-Processor1242                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a97
http-80-Processor1243                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a98
http-80-Processor1244                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a99
http-80-Processor1245                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9a
http-80-Processor1246                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9b
http-80-Processor1247                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9c
http-80-Processor1248                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9d
http-80-Processor1249                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9e
http-80-Processor1250                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9f
http-80-Processor1251                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa0
http-80-Processor1252                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa1
http-80-Processor1253                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa2
http-80-Processor1254                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa3
http-80-Processor1255                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa4
http-80-Processor1256                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa5
http-80-Processor1257                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa6
http-80-Processor1258                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa7
http-80-Processor1259                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa8
http-80-Processor1260                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa9
http-80-Processor1261                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aaa
http-80-Processor1262                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aab
http-80-Processor1263                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aac
http-80-Processor1264                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aad
http-80-Processor1265                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aae
http-80-Processor1266                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aaf
http-80-Processor1267                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab0
http-80-Processor1268                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab1
http-80-Processor1269                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab2
http-80-Processor1270                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab3
http-80-Processor1271                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab4
http-80-Processor1272                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab5
http-80-Processor1273                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab6
http-80-Processor1274                                           cond.
waiting
>

The stack trace of the stuck thread:

> where 0x184e
>     
   [1] java.lang.Object.wait (native method)
   [2] com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable
 (BasicResourcePool.java:1,315)
   [3] com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource
 (BasicResourcePool.java:557)
   [4] com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource
 (BasicResourcePool.java:477)
   [5]
 com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection
 (C3P0PooledConnectionPool.java:525)
   [6] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection
 (AbstractPoolBackedDataSource.java:128)
   [7] org.hibernate.connection.C3P0ConnectionProvider.getConnection
 (C3P0ConnectionProvider.java:35)
   [8] org.hibernate.jdbc.ConnectionManager.openConnection
 (ConnectionManager.java:417)
   [9] org.hibernate.jdbc.ConnectionManager.getConnection
 (ConnectionManager.java:144)
   [10] org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement
 (AbstractBatcher.java:139)
   [11] org.hibernate.loader.Loader.prepareQueryStatement
Loader.java:1,561)
   [12] org.hibernate.loader.Loader.doQuery (Loader.java:661)
   [13] org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections
 (Loader.java:224)
   [14] org.hibernate.loader.Loader.doList (Loader.java:2,145)
   [15] org.hibernate.loader.Loader.listIgnoreQueryCache
Loader.java:2,029)
   [16] org.hibernate.loader.Loader.list (Loader.java:2,024)
   [17] org.hibernate.loader.hql.QueryLoader.list (QueryLoader.java:392)
   [18] org.hibernate.hql.ast.QueryTranslatorImpl.list
 (QueryTranslatorImpl.java:333)
   [19] org.hibernate.engine.query.HQLQueryPlan.performList
 (HQLQueryPlan.java:172)
   [20] org.hibernate.impl.SessionImpl.list (SessionImpl.java:1,114)
   [21] org.hibernate.impl.QueryImpl.list (QueryImpl.java:79)
   [22] org.hibernate.ejb.QueryImpl.getResultList (QueryImpl.java:53)
   [23] com.barak.persitence.EntityManagerImpl.all
 (EntityManagerImpl.java:148)
   [24] com.barak.deamon.lookup.LookupDaemon.execute
LookupDaemon.java:271)
   [25] com.barak.daemon.StatefulDaemon.run (StatefulDaemon.java:68)


Thanks,

Barak.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@tomcat.apache.org
For additional commands, e-mail: dev-help@tomcat.apache.org


RE: Tomcat HTTTP Connectior Hangs

Posted by Barak Yaish <ba...@peer39.com>.
Hello again,

Please, can someone explain me why a thread that waits for a connection
hangs the HTTP Connector? This thread is not part of the flow of serving an
HTTP request.

Thanks,

Barak.

-----Original Message-----
From: Barak Yaish [mailto:barak@peer39.com] 
Sent: Monday, April 28, 2008 7:13 PM
To: 'Tomcat Users List'
Subject: RE: Tomcat HTTTP Connectior Hangs

Ok, sorry for making troubles.

Here it is:

Group system:
  (java.lang.ref.Reference$ReferenceHandler)0x1833
Reference Handler                                               cond.
waiting
  (java.lang.ref.Finalizer$FinalizerThread)0x1834
Finalizer                                                       cond.
waiting
  (java.lang.Thread)0x1835
Signal Dispatcher                                               running
  (java.lang.Thread)0x1836
RMI Scheduler(0)                                                cond.
waiting
  (java.lang.Thread)0x1837
RMI RenewClean-[prod29:37355]
cond. waiting
  (sun.misc.GC$Daemon)0x1838
GC Daemon                                                       cond.
waiting
  (java.lang.Thread)0x1839
RMI RenewClean-[prod31:45514]                     		cond.
waiting
  (java.lang.Thread)0x183a
RMI RenewClean-[prod7:46845]                      		cond.
waiting
  (java.lang.Thread)0x183b
RMI RenewClean-[prod15:33128]                     		cond.
waiting
  (java.lang.Thread)0x183c
RMI RenewClean-[prod12:45154]                     		cond.
waiting
Group main:
  (java.lang.Thread)0x183f
main                                                            running
  (java.util.TimerThread)0x1840
Timer-0                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1841
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1842
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1843
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (java.util.TimerThread)0x1845
Timer-1                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1846
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1847
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1848
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (java.util.TimerThread)0x184a
Timer-2                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184b
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184c
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184d
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (com.barak.deamon.lookup.LookupDaemon)0x184e                  Thread-18
cond. waiting
  (com.barak.deamon.logger.LoggerDaemon2)0x184f                 Thread-19
sleeping
  (com.barak.deamon.loadbalancing.LoadBalancerDaemon)0x1850     Thread-20
sleeping
  (java.util.TimerThread)0x1851
Timer-3                                                         cond.
waiting
  (java.lang.Thread)0x1852
ContainerBackgroundProcessor[StandardEngine[Catalina]]          sleeping
  (java.lang.Thread)0x1853
http-80-Monitor                                                 cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1854
TP-Processor1                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1855
TP-Processor2                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1856
TP-Processor3                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1857
TP-Processor4                                                   running
  (java.lang.Thread)0x1858
TP-Monitor                                                      cond.
waiting
  (java.lang.Thread)0x1859
pool-1-thread-1                                                 cond.
waiting
  (java.lang.Thread)0x185a
pool-1-thread-2                                                 cond.
waiting
  (java.lang.Thread)0x185b
pool-1-thread-3                                                 cond.
waiting
  (java.lang.Thread)0x185c
pool-1-thread-4                                                 cond.
waiting
  (java.lang.Thread)0x185d
pool-1-thread-5                                                 cond.
waiting
  (java.lang.Thread)0x185e
pool-1-thread-6                                                 cond.
waiting
  (java.lang.Thread)0x185f
pool-1-thread-7                                                 cond.
waiting
  (java.lang.Thread)0x1860
pool-1-thread-8                                                 cond.
waiting
  (java.lang.Thread)0x1861
pool-1-thread-9                                                 cond.
waiting
  (java.lang.Thread)0x1862
pool-1-thread-10                                                cond.
waiting
  (java.lang.Thread)0x1863
pool-1-thread-11                                                cond.
waiting
  (java.lang.Thread)0x1864
pool-1-thread-12                                                cond.
waiting
  (java.lang.Thread)0x1865
pool-1-thread-13                                                cond.
waiting
  (java.lang.Thread)0x1866
pool-1-thread-14                                                cond.
waiting
  (java.lang.Thread)0x1867
pool-1-thread-15                                                cond.
waiting
  (java.lang.Thread)0x1868
pool-1-thread-16                                                cond.
waiting
  (java.lang.Thread)0x1869
pool-1-thread-17                                                cond.
waiting
  (java.lang.Thread)0x186a
pool-1-thread-18                                                cond.
waiting
  (java.lang.Thread)0x186b
pool-1-thread-19                                                cond.
waiting
  (java.lang.Thread)0x186c
pool-1-thread-20                                                cond.
waiting
  (java.lang.Thread)0x186d
pool-1-thread-21                                                cond.
waiting
  (java.lang.Thread)0x186e
pool-1-thread-22                                                cond.
waiting
  (java.lang.Thread)0x186f
pool-1-thread-23                                                cond.
waiting
  (java.lang.Thread)0x1870
pool-1-thread-24                                                cond.
waiting
  (java.lang.Thread)0x1871
pool-1-thread-25                                                cond.
waiting
  (java.lang.Thread)0x1872
pool-1-thread-26                                                cond.
waiting
  (java.lang.Thread)0x1873
pool-1-thread-27                                                cond.
waiting
  (java.lang.Thread)0x1874
pool-1-thread-28                                                cond.
waiting
  (java.lang.Thread)0x1875
pool-1-thread-29                                                cond.
waiting
  (java.lang.Thread)0x1876
pool-1-thread-30                                                cond.
waiting
  (java.lang.Thread)0x1877
pool-1-thread-31                                                cond.
waiting
  (java.lang.Thread)0x1878
pool-1-thread-32                                                cond.
waiting
  (java.lang.Thread)0x1879
pool-1-thread-33                                                cond.
waiting
  (java.lang.Thread)0x187a
pool-1-thread-34                                                cond.
waiting
  (java.lang.Thread)0x187b
pool-1-thread-35                                                cond.
waiting
  (java.lang.Thread)0x187c
pool-1-thread-36                                                cond.
waiting
  (java.lang.Thread)0x187d
pool-1-thread-37                                                cond.
waiting
  (java.lang.Thread)0x187e
pool-1-thread-38                                                cond.
waiting
  (java.lang.Thread)0x187f
pool-1-thread-39                                                cond.
waiting
  (java.lang.Thread)0x1880
pool-1-thread-40                                                cond.
waiting
  (java.lang.Thread)0x1881
pool-1-thread-41                                                cond.
waiting
  (java.lang.Thread)0x1882
pool-1-thread-42                                                cond.
waiting
  (java.lang.Thread)0x1883
pool-1-thread-43                                                cond.
waiting
  (java.lang.Thread)0x1884
pool-1-thread-44                                                cond.
waiting
  (java.lang.Thread)0x1885
pool-1-thread-45                                                cond.
waiting
  (java.lang.Thread)0x1886
pool-1-thread-46                                                cond.
waiting
  (java.lang.Thread)0x1887
pool-1-thread-47                                                cond.
waiting
  (java.lang.Thread)0x1888
pool-1-thread-48                                                cond.
waiting
  (java.lang.Thread)0x1889
pool-1-thread-49                                                cond.
waiting
  (java.lang.Thread)0x188a
pool-1-thread-50                                                cond.
waiting
  (java.lang.Thread)0x188b
pool-1-thread-51                                                cond.
waiting
  (java.lang.Thread)0x188c
pool-1-thread-52                                                cond.
waiting
  (java.lang.Thread)0x188d
pool-1-thread-53                                                cond.
waiting
  (java.lang.Thread)0x188e
pool-1-thread-54                                                cond.
waiting
  (java.lang.Thread)0x188f
pool-1-thread-55                                                cond.
waiting
  (java.lang.Thread)0x1890
pool-1-thread-56                                                cond.
waiting
  (java.lang.Thread)0x1891
pool-1-thread-57                                                cond.
waiting
  (java.lang.Thread)0x1892
pool-1-thread-58                                                cond.
waiting
  (java.lang.Thread)0x1893
pool-1-thread-59                                                cond.
waiting
  (java.lang.Thread)0x1894
pool-1-thread-60                                                cond.
waiting
  (java.lang.Thread)0x1895
pool-1-thread-61                                                cond.
waiting
  (java.lang.Thread)0x1896
pool-1-thread-62                                                cond.
waiting
  (java.lang.Thread)0x1897
pool-1-thread-63                                                cond.
waiting
  (java.lang.Thread)0x1898
pool-1-thread-64                                                cond.
waiting
  (java.lang.Thread)0x1899
pool-1-thread-65                                                cond.
waiting
  (java.lang.Thread)0x189a
pool-1-thread-66                                                cond.
waiting
  (java.lang.Thread)0x189b
pool-1-thread-67                                                cond.
waiting
  (java.lang.Thread)0x189c
pool-1-thread-68                                                cond.
waiting
  (java.lang.Thread)0x189d
pool-1-thread-69                                                cond.
waiting
  (java.lang.Thread)0x189e
pool-1-thread-70                                                cond.
waiting
  (java.lang.Thread)0x189f
pool-1-thread-71                                                cond.
waiting
  (java.lang.Thread)0x18a0
pool-1-thread-72                                                cond.
waiting
  (java.lang.Thread)0x18a1
pool-1-thread-73                                                cond.
waiting
  (java.lang.Thread)0x18a2
pool-1-thread-74                                                cond.
waiting
  (java.lang.Thread)0x18a3
pool-1-thread-75                                                cond.
waiting
  (java.lang.Thread)0x18a4
pool-1-thread-76                                                cond.
waiting
  (java.lang.Thread)0x18a5
pool-1-thread-77                                                cond.
waiting
  (java.lang.Thread)0x18a6
pool-1-thread-78                                                cond.
waiting
  (java.lang.Thread)0x18a7
pool-1-thread-79                                                cond.
waiting
  (java.lang.Thread)0x18a8
pool-1-thread-80                                                cond.
waiting
  (java.lang.Thread)0x18a9
pool-1-thread-81                                                cond.
waiting
  (java.lang.Thread)0x18aa
pool-1-thread-82                                                cond.
waiting
  (java.lang.Thread)0x18ab
pool-1-thread-83                                                cond.
waiting
  (java.lang.Thread)0x18ac
pool-1-thread-84                                                cond.
waiting
  (java.lang.Thread)0x18ad
pool-1-thread-85                                                cond.
waiting
  (java.lang.Thread)0x18ae
pool-1-thread-86                                                cond.
waiting
  (java.lang.Thread)0x18af
pool-1-thread-87                                                cond.
waiting
  (java.lang.Thread)0x18b0
pool-1-thread-88                                                cond.
waiting
  (java.lang.Thread)0x18b1
pool-1-thread-89                                                cond.
waiting
  (java.lang.Thread)0x18b2
pool-1-thread-90                                                cond.
waiting
  (java.lang.Thread)0x18b3
pool-1-thread-91                                                cond.
waiting
  (java.lang.Thread)0x18b4
pool-1-thread-92                                                cond.
waiting
  (java.lang.Thread)0x18b5
pool-1-thread-93                                                cond.
waiting
  (java.lang.Thread)0x18b6
pool-1-thread-94                                                cond.
waiting
  (java.lang.Thread)0x18b7
pool-1-thread-95                                                cond.
waiting
  (java.lang.Thread)0x18b8
pool-1-thread-96                                                cond.
waiting
  (java.lang.Thread)0x18b9
pool-1-thread-97                                                cond.
waiting
  (java.lang.Thread)0x18ba
pool-1-thread-98                                                cond.
waiting
  (java.lang.Thread)0x18bb
pool-1-thread-99                                                cond.
waiting
  (java.lang.Thread)0x18bc
pool-1-thread-100                                               cond.
waiting
  (java.lang.Thread)0x18bd
pool-1-thread-101                                               cond.
waiting
  (java.lang.Thread)0x18be
pool-1-thread-102                                               cond.
waiting
  (java.lang.Thread)0x18bf
pool-1-thread-103                                               cond.
waiting
  (java.lang.Thread)0x18c0
pool-1-thread-104                                               cond.
waiting
  (java.lang.Thread)0x18c1
pool-1-thread-105                                               cond.
waiting
  (java.lang.Thread)0x18c2
pool-1-thread-106                                               cond.
waiting
  (java.lang.Thread)0x18c3
pool-1-thread-107                                               cond.
waiting
  (java.lang.Thread)0x18c4
pool-1-thread-108                                               cond.
waiting
  (java.lang.Thread)0x18c5
pool-1-thread-109                                               cond.
waiting
  (java.lang.Thread)0x18c6
pool-1-thread-110                                               cond.
waiting
  (java.lang.Thread)0x18c7
pool-1-thread-111                                               cond.
waiting
  (java.lang.Thread)0x18c8
pool-1-thread-112                                               cond.
waiting
  (java.lang.Thread)0x18c9
pool-1-thread-113                                               cond.
waiting
  (java.lang.Thread)0x18ca
pool-1-thread-114                                               cond.
waiting
  (java.lang.Thread)0x18cb
pool-1-thread-115                                               cond.
waiting
  (java.lang.Thread)0x18cc
pool-1-thread-116                                               cond.
waiting
  (java.lang.Thread)0x18cd
pool-1-thread-117                                               cond.
waiting
  (java.lang.Thread)0x18ce
pool-1-thread-118                                               cond.
waiting
  (java.lang.Thread)0x18cf
pool-1-thread-119                                               cond.
waiting
  (java.lang.Thread)0x18d0
pool-1-thread-120                                               cond.
waiting
  (java.lang.Thread)0x18d1
pool-1-thread-121                                               cond.
waiting
  (java.lang.Thread)0x18d2
pool-1-thread-122                                               cond.
waiting
  (java.lang.Thread)0x18d3
pool-1-thread-123                                               cond.
waiting
  (java.lang.Thread)0x18d4
pool-1-thread-124                                               cond.
waiting
  (java.lang.Thread)0x18d5
pool-1-thread-125                                               cond.
waiting
  (java.lang.Thread)0x18d6
pool-1-thread-126                                               cond.
waiting
  (java.lang.Thread)0x18d7
pool-1-thread-127                                               cond.
waiting
  (java.lang.Thread)0x18d8
pool-1-thread-128                                               cond.
waiting
  (java.lang.Thread)0x18d9
pool-1-thread-129                                               cond.
waiting
  (java.lang.Thread)0x18da
pool-1-thread-130                                               cond.
waiting
  (java.lang.Thread)0x18db
pool-1-thread-131                                               cond.
waiting
  (java.lang.Thread)0x18dc
pool-1-thread-132                                               cond.
waiting
  (java.lang.Thread)0x18dd
pool-1-thread-133                                               cond.
waiting
  (java.lang.Thread)0x18de
pool-1-thread-134                                               cond.
waiting
  (java.lang.Thread)0x18df
pool-1-thread-135                                               cond.
waiting
  (java.lang.Thread)0x18e0
pool-1-thread-136                                               cond.
waiting
  (java.lang.Thread)0x18e1
pool-1-thread-137                                               cond.
waiting
  (java.lang.Thread)0x18e2
pool-1-thread-138                                               cond.
waiting
  (java.lang.Thread)0x18e3
pool-1-thread-139                                               cond.
waiting
  (java.lang.Thread)0x18e4
pool-1-thread-140                                               cond.
waiting
  (java.lang.Thread)0x18e5
pool-1-thread-141                                               cond.
waiting
  (java.lang.Thread)0x18e6
pool-1-thread-142                                               cond.
waiting
  (java.lang.Thread)0x18e7
pool-1-thread-143                                               cond.
waiting
  (java.lang.Thread)0x18e8
pool-1-thread-144                                               cond.
waiting
  (java.lang.Thread)0x18e9
pool-1-thread-145                                               cond.
waiting
  (java.lang.Thread)0x18ea
pool-1-thread-146                                               cond.
waiting
  (java.lang.Thread)0x18eb
pool-1-thread-147                                               cond.
waiting
  (java.lang.Thread)0x18ec
pool-1-thread-148                                               cond.
waiting
  (java.lang.Thread)0x18ed
pool-1-thread-149                                               cond.
waiting
  (java.lang.Thread)0x18ee
pool-1-thread-150                                               cond.
waiting
  (java.lang.Thread)0x18ef
pool-1-thread-151                                               cond.
waiting
  (java.lang.Thread)0x18f0
pool-1-thread-152                                               cond.
waiting
  (java.lang.Thread)0x18f1
pool-1-thread-153                                               cond.
waiting
  (java.lang.Thread)0x18f2
pool-1-thread-154                                               cond.
waiting
  (java.lang.Thread)0x18f3
pool-1-thread-155                                               cond.
waiting
  (java.lang.Thread)0x18f4
pool-1-thread-156                                               cond.
waiting
  (java.lang.Thread)0x18f5
pool-1-thread-157                                               cond.
waiting
  (java.lang.Thread)0x18f6
pool-1-thread-158                                               cond.
waiting
  (java.lang.Thread)0x18f7
pool-1-thread-159                                               cond.
waiting
  (java.lang.Thread)0x18f8
pool-1-thread-160                                               cond.
waiting
  (java.lang.Thread)0x18f9
pool-1-thread-161                                               cond.
waiting
  (java.lang.Thread)0x18fa
pool-1-thread-162                                               cond.
waiting
  (java.lang.Thread)0x18fb
pool-1-thread-163                                               cond.
waiting
  (java.lang.Thread)0x18fc
pool-1-thread-164                                               cond.
waiting
  (java.lang.Thread)0x18fd
pool-1-thread-165                                               cond.
waiting
  (java.lang.Thread)0x18fe
pool-1-thread-166                                               cond.
waiting
  (java.lang.Thread)0x18ff
pool-1-thread-167                                               cond.
waiting
  (java.lang.Thread)0x1900
pool-1-thread-168                                               cond.
waiting
  (java.lang.Thread)0x1901
pool-1-thread-169                                               cond.
waiting
  (java.lang.Thread)0x1902
pool-1-thread-170                                               cond.
waiting
  (java.lang.Thread)0x1903
pool-1-thread-171                                               cond.
waiting
  (java.lang.Thread)0x1904
pool-1-thread-172                                               cond.
waiting
  (java.lang.Thread)0x1905
pool-1-thread-173                                               cond.
waiting
  (java.lang.Thread)0x1906
pool-1-thread-174                                               cond.
waiting
  (java.lang.Thread)0x1907
pool-1-thread-175                                               cond.
waiting
  (java.lang.Thread)0x1908
pool-1-thread-176                                               cond.
waiting
  (java.lang.Thread)0x1909
pool-1-thread-177                                               cond.
waiting
  (java.lang.Thread)0x190a
pool-1-thread-178                                               cond.
waiting
  (java.lang.Thread)0x190b
pool-1-thread-179                                               cond.
waiting
  (java.lang.Thread)0x190c
pool-1-thread-180                                               cond.
waiting
  (java.lang.Thread)0x190d
pool-1-thread-181                                               cond.
waiting
  (java.lang.Thread)0x190e
pool-1-thread-182                                               cond.
waiting
  (java.lang.Thread)0x190f
pool-1-thread-183                                               cond.
waiting
  (java.lang.Thread)0x1910
pool-1-thread-184                                               cond.
waiting
  (java.lang.Thread)0x1911
pool-1-thread-185                                               cond.
waiting
  (java.lang.Thread)0x1912
pool-1-thread-186                                               cond.
waiting
  (java.lang.Thread)0x1913
pool-1-thread-187                                               cond.
waiting
  (java.lang.Thread)0x1914
pool-1-thread-188                                               cond.
waiting
  (java.lang.Thread)0x1915
pool-1-thread-189                                               cond.
waiting
  (java.lang.Thread)0x1916
pool-1-thread-190                                               cond.
waiting
  (java.lang.Thread)0x1917
pool-1-thread-191                                               cond.
waiting
  (java.lang.Thread)0x1918
pool-1-thread-192                                               cond.
waiting
  (java.lang.Thread)0x1919
pool-1-thread-193                                               cond.
waiting
  (java.lang.Thread)0x191a
pool-1-thread-194                                               cond.
waiting
  (java.lang.Thread)0x191b
pool-1-thread-195                                               cond.
waiting
  (java.lang.Thread)0x191c
pool-1-thread-196                                               cond.
waiting
  (java.lang.Thread)0x191d
pool-1-thread-197                                               cond.
waiting
  (java.lang.Thread)0x191e
pool-1-thread-198                                               cond.
waiting
  (java.lang.Thread)0x191f
pool-1-thread-199                                               cond.
waiting
  (java.lang.Thread)0x1920
pool-1-thread-200                                               cond.
waiting
  (java.lang.Thread)0x1921
pool-1-thread-201                                               cond.
waiting
  (java.lang.Thread)0x1922
pool-1-thread-202                                               cond.
waiting
  (java.lang.Thread)0x1923
pool-1-thread-203                                               cond.
waiting
  (java.lang.Thread)0x1924
pool-1-thread-204                                               cond.
waiting
  (java.lang.Thread)0x1925
pool-1-thread-205                                               cond.
waiting
  (java.lang.Thread)0x1926
pool-1-thread-206                                               cond.
waiting
  (java.lang.Thread)0x1927
pool-1-thread-207                                               cond.
waiting
  (java.lang.Thread)0x1928
pool-1-thread-208                                               cond.
waiting
  (java.lang.Thread)0x1929
pool-1-thread-209                                               cond.
waiting
  (java.lang.Thread)0x192a
pool-1-thread-210                                               cond.
waiting
  (java.lang.Thread)0x192b
pool-1-thread-211                                               cond.
waiting
  (java.lang.Thread)0x192c
pool-1-thread-212                                               cond.
waiting
  (java.lang.Thread)0x192d
pool-1-thread-213                                               cond.
waiting
  (java.lang.Thread)0x192e
pool-1-thread-214                                               cond.
waiting
  (java.lang.Thread)0x192f
pool-1-thread-215                                               cond.
waiting
  (java.lang.Thread)0x1930
pool-1-thread-216                                               cond.
waiting
  (java.lang.Thread)0x1931
pool-1-thread-217                                               cond.
waiting
  (java.lang.Thread)0x1932
pool-1-thread-218                                               cond.
waiting
  (java.lang.Thread)0x1933
pool-1-thread-219                                               cond.
waiting
  (java.lang.Thread)0x1934
pool-1-thread-220                                               cond.
waiting
  (java.lang.Thread)0x1935
pool-1-thread-221                                               cond.
waiting
  (java.lang.Thread)0x1936
pool-1-thread-222                                               cond.
waiting
  (java.lang.Thread)0x1937
pool-1-thread-223                                               cond.
waiting
  (java.lang.Thread)0x1938
pool-1-thread-224                                               cond.
waiting
  (java.lang.Thread)0x1939
pool-1-thread-225                                               cond.
waiting
  (java.lang.Thread)0x193a
pool-1-thread-226                                               cond.
waiting
  (java.lang.Thread)0x193b
pool-1-thread-227                                               cond.
waiting
  (java.lang.Thread)0x193c
pool-1-thread-228                                               cond.
waiting
  (java.lang.Thread)0x193d
pool-1-thread-229                                               cond.
waiting
  (java.lang.Thread)0x193e
pool-1-thread-230                                               cond.
waiting
  (java.lang.Thread)0x193f
pool-1-thread-231                                               cond.
waiting
  (java.lang.Thread)0x1940
pool-1-thread-232                                               cond.
waiting
  (java.lang.Thread)0x1941
pool-1-thread-233                                               cond.
waiting
  (java.lang.Thread)0x1942
pool-1-thread-234                                               cond.
waiting
  (java.lang.Thread)0x1943
pool-1-thread-235                                               cond.
waiting
  (java.lang.Thread)0x1944
pool-1-thread-236                                               cond.
waiting
  (java.lang.Thread)0x1945
pool-1-thread-237                                               cond.
waiting
  (java.lang.Thread)0x1946
pool-1-thread-238                                               cond.
waiting
  (java.lang.Thread)0x1947
pool-1-thread-239                                               cond.
waiting
  (java.lang.Thread)0x1948
pool-1-thread-240                                               cond.
waiting
  (java.lang.Thread)0x1949
pool-1-thread-241                                               cond.
waiting
  (java.lang.Thread)0x194a
pool-1-thread-242                                               cond.
waiting
  (java.lang.Thread)0x194b
pool-1-thread-243                                               cond.
waiting
  (java.lang.Thread)0x194c
pool-1-thread-244                                               cond.
waiting
  (java.lang.Thread)0x194d
pool-1-thread-245                                               cond.
waiting
  (java.lang.Thread)0x194e
pool-1-thread-246                                               cond.
waiting
  (java.lang.Thread)0x194f
pool-1-thread-247                                               cond.
waiting
  (java.lang.Thread)0x1950
pool-1-thread-248                                               cond.
waiting
  (java.lang.Thread)0x1951
pool-1-thread-249                                               cond.
waiting
  (java.lang.Thread)0x1952
pool-1-thread-250                                               cond.
waiting
  (java.lang.Thread)0x1953
pool-1-thread-251                                               cond.
waiting
  (java.lang.Thread)0x1954
pool-1-thread-252                                               cond.
waiting
  (java.lang.Thread)0x1955
pool-1-thread-253                                               cond.
waiting
  (java.lang.Thread)0x1956
pool-1-thread-254                                               cond.
waiting
  (java.lang.Thread)0x1957
pool-1-thread-255                                               cond.
waiting
  (java.lang.Thread)0x1958
pool-1-thread-256                                               cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1959
http-80-Processor552                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195a
http-80-Processor682                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195b
http-80-Processor722                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195c
http-80-Processor729                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195d
http-80-Processor731                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195e
http-80-Processor742                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195f
http-80-Processor749                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1960
http-80-Processor752                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1961
http-80-Processor776                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1962
http-80-Processor778                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1963
http-80-Processor794                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1964
http-80-Processor805                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1965
http-80-Processor841                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1966
http-80-Processor860                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1967
http-80-Processor861                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1968
http-80-Processor866                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1969
http-80-Processor875                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196a
http-80-Processor879                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196b
http-80-Processor882                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196c
http-80-Processor886                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196d
http-80-Processor889                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196e
http-80-Processor896                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196f
http-80-Processor899                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1970
http-80-Processor900                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1971
http-80-Processor901                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1972
http-80-Processor903                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1973
http-80-Processor906                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1974
http-80-Processor910                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1975
http-80-Processor914                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1976
http-80-Processor915                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1977
http-80-Processor917                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1978
http-80-Processor918                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1979
http-80-Processor919                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197a
http-80-Processor923                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197b
http-80-Processor926                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197c
http-80-Processor936                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197d
http-80-Processor937                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197e
http-80-Processor938                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197f
http-80-Processor941                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1980
http-80-Processor942                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1981
http-80-Processor943                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1982
http-80-Processor947                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1983
http-80-Processor949                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1984
http-80-Processor950                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1985
http-80-Processor951                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1986
http-80-Processor952                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1987
http-80-Processor953                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1988
http-80-Processor957                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1989
http-80-Processor959                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198a
http-80-Processor960                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198b
http-80-Processor961                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198c
http-80-Processor962                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198d
http-80-Processor963                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198e
http-80-Processor964                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198f
http-80-Processor965                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1990
http-80-Processor966                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1991
http-80-Processor971                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1992
http-80-Processor974                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1993
http-80-Processor975                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1994
http-80-Processor976                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1995
http-80-Processor978                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1996
http-80-Processor979                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1997
http-80-Processor980                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1998
http-80-Processor981                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1999
http-80-Processor982                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199a
http-80-Processor983                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199b
http-80-Processor984                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199c
http-80-Processor985                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199d
http-80-Processor987                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199e
http-80-Processor988                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199f
http-80-Processor989                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a0
http-80-Processor990                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a1
http-80-Processor992                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a2
http-80-Processor994                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a3
http-80-Processor996                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a4
http-80-Processor997                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a5
http-80-Processor999                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a6
http-80-Processor1001                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a7
http-80-Processor1002                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a8
http-80-Processor1003                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a9
http-80-Processor1004                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19aa
http-80-Processor1005                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ab
http-80-Processor1006                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ac
http-80-Processor1007                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ad
http-80-Processor1008                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ae
http-80-Processor1009                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19af
http-80-Processor1010                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b0
http-80-Processor1011                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b1
http-80-Processor1012                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b2
http-80-Processor1013                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b3
http-80-Processor1014                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b4
http-80-Processor1015                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b5
http-80-Processor1016                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b6
http-80-Processor1017                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b7
http-80-Processor1018                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b8
http-80-Processor1019                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b9
http-80-Processor1020                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ba
http-80-Processor1022                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bb
http-80-Processor1023                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bc
http-80-Processor1024                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bd
http-80-Processor1025                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19be
http-80-Processor1026                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bf
http-80-Processor1027                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c0
http-80-Processor1028                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c1
http-80-Processor1029                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c2
http-80-Processor1030                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c3
http-80-Processor1031                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c4
http-80-Processor1032                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c5
http-80-Processor1033                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c6
http-80-Processor1034                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c7
http-80-Processor1035                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c8
http-80-Processor1036                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c9
http-80-Processor1037                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ca
http-80-Processor1038                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cb
http-80-Processor1039                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cc
http-80-Processor1040                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cd
http-80-Processor1041                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ce
http-80-Processor1042                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cf
http-80-Processor1043                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d0
http-80-Processor1044                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d1
http-80-Processor1045                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d2
http-80-Processor1046                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d3
http-80-Processor1047                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d4
http-80-Processor1048                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d5
http-80-Processor1049                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d6
http-80-Processor1050                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d7
http-80-Processor1051                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d8
http-80-Processor1052                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d9
http-80-Processor1053                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19da
http-80-Processor1054                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19db
http-80-Processor1055                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19dc
http-80-Processor1056                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19dd
http-80-Processor1057                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19de
http-80-Processor1058                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19df
http-80-Processor1059                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e0
http-80-Processor1060                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e1
http-80-Processor1061                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e2
http-80-Processor1062                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e3
http-80-Processor1063                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e4
http-80-Processor1064                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e5
http-80-Processor1065                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e6
http-80-Processor1066                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e7
http-80-Processor1067                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e8
http-80-Processor1068                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e9
http-80-Processor1069                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ea
http-80-Processor1070                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19eb
http-80-Processor1071                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ec
http-80-Processor1072                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ed
http-80-Processor1073                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ee
http-80-Processor1074                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ef
http-80-Processor1075                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f0
http-80-Processor1076                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f1
http-80-Processor1077                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f2
http-80-Processor1078                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f3
http-80-Processor1079                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f4
http-80-Processor1080                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f5
http-80-Processor1081                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f6
http-80-Processor1082                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f7
http-80-Processor1083                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f8
http-80-Processor1084                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f9
http-80-Processor1085                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fa
http-80-Processor1086                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fb
http-80-Processor1087                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fc
http-80-Processor1088                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fd
http-80-Processor1089                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fe
http-80-Processor1090                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ff
http-80-Processor1091                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a00
http-80-Processor1092                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a01
http-80-Processor1093                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a02
http-80-Processor1094                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a03
http-80-Processor1095                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a04
http-80-Processor1096                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a05
http-80-Processor1097                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a06
http-80-Processor1098                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a07
http-80-Processor1099                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a08
http-80-Processor1100                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a09
http-80-Processor1101                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0a
http-80-Processor1102                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0b
http-80-Processor1103                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0c
http-80-Processor1104                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0d
http-80-Processor1105                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0e
http-80-Processor1106                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0f
http-80-Processor1107                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a10
http-80-Processor1108                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a11
http-80-Processor1109                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a12
http-80-Processor1110                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a13
http-80-Processor1111                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a14
http-80-Processor1112                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a15
http-80-Processor1113                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a16
http-80-Processor1114                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a17
http-80-Processor1115                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a18
http-80-Processor1116                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a19
http-80-Processor1117                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1a
http-80-Processor1118                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1b
http-80-Processor1119                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1c
http-80-Processor1120                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1d
http-80-Processor1121                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1e
http-80-Processor1122                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1f
http-80-Processor1123                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a20
http-80-Processor1124                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a21
http-80-Processor1125                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a22
http-80-Processor1126                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a23
http-80-Processor1127                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a24
http-80-Processor1128                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a25
http-80-Processor1129                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a26
http-80-Processor1130                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a27
http-80-Processor1131                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a28
http-80-Processor1132                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a29
http-80-Processor1133                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2a
http-80-Processor1134                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2b
http-80-Processor1135                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2c
http-80-Processor1136                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2d
http-80-Processor1137                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2e
http-80-Processor1138                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2f
http-80-Processor1139                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a30
http-80-Processor1140                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a31
http-80-Processor1141                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a32
http-80-Processor1142                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a33
http-80-Processor1143                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a34
http-80-Processor1144                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a35
http-80-Processor1145                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a36
http-80-Processor1146                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a37
http-80-Processor1147                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a38
http-80-Processor1148                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a39
http-80-Processor1149                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3a
http-80-Processor1150                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3b
http-80-Processor1151                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3c
http-80-Processor1152                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3d
http-80-Processor1153                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3e
http-80-Processor1154                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3f
http-80-Processor1155                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a40
http-80-Processor1156                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a41
http-80-Processor1157                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a42
http-80-Processor1158                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a43
http-80-Processor1159                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a44
http-80-Processor1160                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a45
http-80-Processor1161                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a46
http-80-Processor1162                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a47
http-80-Processor1163                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a48
http-80-Processor1164                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a49
http-80-Processor1165                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4a
http-80-Processor1166                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4b
http-80-Processor1167                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4c
http-80-Processor1168                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4d
http-80-Processor1169                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4e
http-80-Processor1170                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4f
http-80-Processor1171                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a50
http-80-Processor1172                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a51
http-80-Processor1173                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a52
http-80-Processor1174                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a53
http-80-Processor1175                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a54
http-80-Processor1176                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a55
http-80-Processor1177                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a56
http-80-Processor1178                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a57
http-80-Processor1179                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a58
http-80-Processor1180                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a59
http-80-Processor1181                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5a
http-80-Processor1182                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5b
http-80-Processor1183                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5c
http-80-Processor1184                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5d
http-80-Processor1185                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5e
http-80-Processor1186                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5f
http-80-Processor1187                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a60
http-80-Processor1188                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a61
http-80-Processor1189                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a62
http-80-Processor1190                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a63
http-80-Processor1191                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a64
http-80-Processor1192                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a65
http-80-Processor1193                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a66
http-80-Processor1194                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a67
http-80-Processor1195                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a68
http-80-Processor1196                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a69
http-80-Processor1197                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6a
http-80-Processor1198                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6b
http-80-Processor1199                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6c
http-80-Processor1200                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6d
http-80-Processor1201                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6e
http-80-Processor1202                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6f
http-80-Processor1203                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a70
http-80-Processor1204                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a71
http-80-Processor1205                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a72
http-80-Processor1206                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a73
http-80-Processor1207                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a74
http-80-Processor1208                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a75
http-80-Processor1209                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a76
http-80-Processor1210                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a77
http-80-Processor1211                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a78
http-80-Processor1212                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a79
http-80-Processor1213                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7a
http-80-Processor1214                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7b
http-80-Processor1215                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7c
http-80-Processor1216                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7d
http-80-Processor1217                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7e
http-80-Processor1218                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7f
http-80-Processor1219                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a80
http-80-Processor1220                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a81
http-80-Processor1221                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a82
http-80-Processor1222                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a83
http-80-Processor1223                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a84
http-80-Processor1224                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a85
http-80-Processor1225                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a86
http-80-Processor1226                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a87
http-80-Processor1227                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a88
http-80-Processor1228                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a89
http-80-Processor1229                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8a
http-80-Processor1230                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8b
http-80-Processor1231                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8c
http-80-Processor1232                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8d
http-80-Processor1233                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8e
http-80-Processor1234                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8f
http-80-Processor1235                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a90
http-80-Processor1236                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a91
http-80-Processor1237                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a92
http-80-Processor1238                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a93
http-80-Processor1239                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a94
http-80-Processor1240                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a95
http-80-Processor1241                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a96
http-80-Processor1242                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a97
http-80-Processor1243                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a98
http-80-Processor1244                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a99
http-80-Processor1245                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9a
http-80-Processor1246                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9b
http-80-Processor1247                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9c
http-80-Processor1248                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9d
http-80-Processor1249                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9e
http-80-Processor1250                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9f
http-80-Processor1251                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa0
http-80-Processor1252                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa1
http-80-Processor1253                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa2
http-80-Processor1254                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa3
http-80-Processor1255                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa4
http-80-Processor1256                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa5
http-80-Processor1257                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa6
http-80-Processor1258                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa7
http-80-Processor1259                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa8
http-80-Processor1260                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa9
http-80-Processor1261                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aaa
http-80-Processor1262                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aab
http-80-Processor1263                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aac
http-80-Processor1264                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aad
http-80-Processor1265                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aae
http-80-Processor1266                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aaf
http-80-Processor1267                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab0
http-80-Processor1268                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab1
http-80-Processor1269                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab2
http-80-Processor1270                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab3
http-80-Processor1271                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab4
http-80-Processor1272                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab5
http-80-Processor1273                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab6
http-80-Processor1274                                           cond.
waiting
>

-----Original Message-----
From: Filip Hanik - Dev Lists [mailto:devlists@hanik.com] 
Sent: Monday, April 28, 2008 6:44 PM
To: Tomcat Users List
Subject: Re: Tomcat HTTTP Connectior Hangs

you keep with holding information,
post the entire thread dump, in its native format

Filip

Barak Yaish wrote:
> My mistake, you right. There is one thread waiting for a db connection
from
> the pool:
>
>
>   
>> where 0x184e
>>     
>   [1] java.lang.Object.wait (native method)
>   [2] com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable
> (BasicResourcePool.java:1,315)
>   [3] com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource
> (BasicResourcePool.java:557)
>   [4] com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource
> (BasicResourcePool.java:477)
>   [5]
> com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection
> (C3P0PooledConnectionPool.java:525)
>   [6] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection
> (AbstractPoolBackedDataSource.java:128)
>   [7] org.hibernate.connection.C3P0ConnectionProvider.getConnection
> (C3P0ConnectionProvider.java:35)
>   [8] org.hibernate.jdbc.ConnectionManager.openConnection
> (ConnectionManager.java:417)
>   [9] org.hibernate.jdbc.ConnectionManager.getConnection
> (ConnectionManager.java:144)
>   [10] org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement
> (AbstractBatcher.java:139)
>   [11] org.hibernate.loader.Loader.prepareQueryStatement
(Loader.java:1,561)
>   [12] org.hibernate.loader.Loader.doQuery (Loader.java:661)
>   [13] org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections
> (Loader.java:224)
>   [14] org.hibernate.loader.Loader.doList (Loader.java:2,145)
>   [15] org.hibernate.loader.Loader.listIgnoreQueryCache
(Loader.java:2,029)
>   [16] org.hibernate.loader.Loader.list (Loader.java:2,024)
>   [17] org.hibernate.loader.hql.QueryLoader.list (QueryLoader.java:392)
>   [18] org.hibernate.hql.ast.QueryTranslatorImpl.list
> (QueryTranslatorImpl.java:333)
>   [19] org.hibernate.engine.query.HQLQueryPlan.performList
> (HQLQueryPlan.java:172)
>   [20] org.hibernate.impl.SessionImpl.list (SessionImpl.java:1,114)
>   [21] org.hibernate.impl.QueryImpl.list (QueryImpl.java:79)
>   [22] org.hibernate.ejb.QueryImpl.getResultList (QueryImpl.java:53)
>   [23] com.barak.persitence.EntityManagerImpl.all
> (EntityManagerImpl.java:148)
>   [24] com.barak.deamon.lookup.LookupDaemon.execute
(LookupDaemon.java:271)
>   [25] com.barak.daemon.StatefulDaemon.run (StatefulDaemon.java:68)
>
>
> So, my next question is: why this stuck thread causes the entire Tomcat to
> hang? This thread used as a daemon (building a mini cache), and not
> participate when serving an incoming HTTP request.
>
>
> The entire (almost) thread dump of Tomcat:
>
> Group system:
>   (java.lang.ref.Reference$ReferenceHandler)0x1833
> Reference Handler                                               cond.
> waiting
>   (java.lang.ref.Finalizer$FinalizerThread)0x1834
> Finalizer                                                       cond.
> waiting
>   (java.lang.Thread)0x1835
> Signal Dispatcher                                               running
>   (java.lang.Thread)0x1836
> RMI Scheduler(0)                                                cond.
> waiting
>   (java.lang.Thread)0x1837
> RMI RenewClean-[prod29:37355]				    cond. waiting
>   (sun.misc.GC$Daemon)0x1838
> GC Daemon                                                       cond.
> waiting
>   (java.lang.Thread)0x1839
> RMI RenewClean-[prod31:45514]			            cond. waiting
>   (java.lang.Thread)0x183a
> RMI RenewClean-[prod7:46845]			            cond. waiting
>   (java.lang.Thread)0x183b
> RMI RenewClean-[prod15:33128]				    cond. waiting
>   (java.lang.Thread)0x183c
> RMI RenewClean-[prod12:45154]				    cond. waiting
> Group main:
>   (java.lang.Thread)0x183f
> main                                                            running
>   (java.util.TimerThread)0x1840
> Timer-0                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1841
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1842
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1843
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (java.util.TimerThread)0x1845
> Timer-1                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1846
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1847
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1848
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (java.util.TimerThread)0x184a
> Timer-2                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184b
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184c
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184d
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (com.barak.deamon.lookup.LookupDaemon)0x184e                  Thread-18
> cond. waiting
>   (com.barak.deamon.logger.LoggerDaemon2)0x184f                 Thread-19
> sleeping
>   (com.barak.deamon.loadbalancing.LoadBalancerDaemon)0x1850     Thread-20
> sleeping
>   (java.util.TimerThread)0x1851
> Timer-3                                                         cond.
> waiting
>   (java.lang.Thread)0x1852
> ContainerBackgroundProcessor[StandardEngine[Catalina]]          sleeping
>   (java.lang.Thread)0x1853
> http-80-Monitor                                                 cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1854
> TP-Processor1                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1855
> TP-Processor2                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1856
> TP-Processor3                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1857
> TP-Processor4                                                   running
>   (java.lang.Thread)0x1858
> TP-Monitor                                                      cond.
> waiting
>   (java.lang.Thread)0x1859
> pool-1-thread-1                                                 cond.
> waiting
>   (java.lang.Thread)0x185a
> pool-1-thread-2                                                 cond.
> waiting
>   (java.lang.Thread)0x185b
> pool-1-thread-3                                                 cond.
> waiting
>   (java.lang.Thread)0x185c
> pool-1-thread-4                                                 cond.
> waiting
>   (java.lang.Thread)0x185d
> pool-1-thread-5                                                 cond.
> waiting
>   (java.lang.Thread)0x185e
> pool-1-thread-6                                                 cond.
> waiting
>   (java.lang.Thread)0x185f
> pool-1-thread-7                                                 cond.
> waiting
>   (java.lang.Thread)0x1860
> pool-1-thread-8                                                 cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1959
> http-80-Processor552                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195a
> http-80-Processor682                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195b
> http-80-Processor722                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195c
> http-80-Processor729                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195d
> http-80-Processor731                                            cond.
> waiting
>   
>
>
> Thanks for helping quickly!!
>
> Barak.
>
>
> -----Original Message-----
> From: Caldarale, Charles R [mailto:Chuck.Caldarale@unisys.com] 
> Sent: Monday, April 28, 2008 3:35 PM
> To: Tomcat Users List
> Subject: RE: Tomcat HTTTP Connectior Hangs
>
>   
>> From: Barak Yaish [mailto:barak@peer39.com] 
>> Subject: Tomcat HTTTP Connectior Hangs
>>
>> thread dump of the JVM running the tomcat does not show 
>> any stuck thread
>>     
>
> The above is rather hard to believe - you might want to post the thread
> dump, or at least non-duplicate parts of it.
>
> Are your database connections not being returned to the pool, perhaps?
>
>  - Chuck
>
>
> THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY
> MATERIAL and is thus for use only by the intended recipient. If you
> received this in error, please contact the sender and delete the e-mail
> and its attachments from all computers.
>
> ---------------------------------------------------------------------
> To start a new topic, e-mail: users@tomcat.apache.org
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
> ---------------------------------------------------------------------
> To start a new topic, e-mail: users@tomcat.apache.org
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
>
>   


---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


RE: Tomcat HTTTP Connectior Hangs

Posted by Barak Yaish <ba...@peer39.com>.
Ok, sorry for making troubles.

Here it is:

Group system:
  (java.lang.ref.Reference$ReferenceHandler)0x1833
Reference Handler                                               cond.
waiting
  (java.lang.ref.Finalizer$FinalizerThread)0x1834
Finalizer                                                       cond.
waiting
  (java.lang.Thread)0x1835
Signal Dispatcher                                               running
  (java.lang.Thread)0x1836
RMI Scheduler(0)                                                cond.
waiting
  (java.lang.Thread)0x1837
RMI RenewClean-[prod29:37355]
cond. waiting
  (sun.misc.GC$Daemon)0x1838
GC Daemon                                                       cond.
waiting
  (java.lang.Thread)0x1839
RMI RenewClean-[prod31:45514]                     		cond.
waiting
  (java.lang.Thread)0x183a
RMI RenewClean-[prod7:46845]                      		cond.
waiting
  (java.lang.Thread)0x183b
RMI RenewClean-[prod15:33128]                     		cond.
waiting
  (java.lang.Thread)0x183c
RMI RenewClean-[prod12:45154]                     		cond.
waiting
Group main:
  (java.lang.Thread)0x183f
main                                                            running
  (java.util.TimerThread)0x1840
Timer-0                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1841
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1842
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1843
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (java.util.TimerThread)0x1845
Timer-1                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1846
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1847
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1848
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (java.util.TimerThread)0x184a
Timer-2                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184b
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184c
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184d
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (com.barak.deamon.lookup.LookupDaemon)0x184e                  Thread-18
cond. waiting
  (com.barak.deamon.logger.LoggerDaemon2)0x184f                 Thread-19
sleeping
  (com.barak.deamon.loadbalancing.LoadBalancerDaemon)0x1850     Thread-20
sleeping
  (java.util.TimerThread)0x1851
Timer-3                                                         cond.
waiting
  (java.lang.Thread)0x1852
ContainerBackgroundProcessor[StandardEngine[Catalina]]          sleeping
  (java.lang.Thread)0x1853
http-80-Monitor                                                 cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1854
TP-Processor1                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1855
TP-Processor2                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1856
TP-Processor3                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1857
TP-Processor4                                                   running
  (java.lang.Thread)0x1858
TP-Monitor                                                      cond.
waiting
  (java.lang.Thread)0x1859
pool-1-thread-1                                                 cond.
waiting
  (java.lang.Thread)0x185a
pool-1-thread-2                                                 cond.
waiting
  (java.lang.Thread)0x185b
pool-1-thread-3                                                 cond.
waiting
  (java.lang.Thread)0x185c
pool-1-thread-4                                                 cond.
waiting
  (java.lang.Thread)0x185d
pool-1-thread-5                                                 cond.
waiting
  (java.lang.Thread)0x185e
pool-1-thread-6                                                 cond.
waiting
  (java.lang.Thread)0x185f
pool-1-thread-7                                                 cond.
waiting
  (java.lang.Thread)0x1860
pool-1-thread-8                                                 cond.
waiting
  (java.lang.Thread)0x1861
pool-1-thread-9                                                 cond.
waiting
  (java.lang.Thread)0x1862
pool-1-thread-10                                                cond.
waiting
  (java.lang.Thread)0x1863
pool-1-thread-11                                                cond.
waiting
  (java.lang.Thread)0x1864
pool-1-thread-12                                                cond.
waiting
  (java.lang.Thread)0x1865
pool-1-thread-13                                                cond.
waiting
  (java.lang.Thread)0x1866
pool-1-thread-14                                                cond.
waiting
  (java.lang.Thread)0x1867
pool-1-thread-15                                                cond.
waiting
  (java.lang.Thread)0x1868
pool-1-thread-16                                                cond.
waiting
  (java.lang.Thread)0x1869
pool-1-thread-17                                                cond.
waiting
  (java.lang.Thread)0x186a
pool-1-thread-18                                                cond.
waiting
  (java.lang.Thread)0x186b
pool-1-thread-19                                                cond.
waiting
  (java.lang.Thread)0x186c
pool-1-thread-20                                                cond.
waiting
  (java.lang.Thread)0x186d
pool-1-thread-21                                                cond.
waiting
  (java.lang.Thread)0x186e
pool-1-thread-22                                                cond.
waiting
  (java.lang.Thread)0x186f
pool-1-thread-23                                                cond.
waiting
  (java.lang.Thread)0x1870
pool-1-thread-24                                                cond.
waiting
  (java.lang.Thread)0x1871
pool-1-thread-25                                                cond.
waiting
  (java.lang.Thread)0x1872
pool-1-thread-26                                                cond.
waiting
  (java.lang.Thread)0x1873
pool-1-thread-27                                                cond.
waiting
  (java.lang.Thread)0x1874
pool-1-thread-28                                                cond.
waiting
  (java.lang.Thread)0x1875
pool-1-thread-29                                                cond.
waiting
  (java.lang.Thread)0x1876
pool-1-thread-30                                                cond.
waiting
  (java.lang.Thread)0x1877
pool-1-thread-31                                                cond.
waiting
  (java.lang.Thread)0x1878
pool-1-thread-32                                                cond.
waiting
  (java.lang.Thread)0x1879
pool-1-thread-33                                                cond.
waiting
  (java.lang.Thread)0x187a
pool-1-thread-34                                                cond.
waiting
  (java.lang.Thread)0x187b
pool-1-thread-35                                                cond.
waiting
  (java.lang.Thread)0x187c
pool-1-thread-36                                                cond.
waiting
  (java.lang.Thread)0x187d
pool-1-thread-37                                                cond.
waiting
  (java.lang.Thread)0x187e
pool-1-thread-38                                                cond.
waiting
  (java.lang.Thread)0x187f
pool-1-thread-39                                                cond.
waiting
  (java.lang.Thread)0x1880
pool-1-thread-40                                                cond.
waiting
  (java.lang.Thread)0x1881
pool-1-thread-41                                                cond.
waiting
  (java.lang.Thread)0x1882
pool-1-thread-42                                                cond.
waiting
  (java.lang.Thread)0x1883
pool-1-thread-43                                                cond.
waiting
  (java.lang.Thread)0x1884
pool-1-thread-44                                                cond.
waiting
  (java.lang.Thread)0x1885
pool-1-thread-45                                                cond.
waiting
  (java.lang.Thread)0x1886
pool-1-thread-46                                                cond.
waiting
  (java.lang.Thread)0x1887
pool-1-thread-47                                                cond.
waiting
  (java.lang.Thread)0x1888
pool-1-thread-48                                                cond.
waiting
  (java.lang.Thread)0x1889
pool-1-thread-49                                                cond.
waiting
  (java.lang.Thread)0x188a
pool-1-thread-50                                                cond.
waiting
  (java.lang.Thread)0x188b
pool-1-thread-51                                                cond.
waiting
  (java.lang.Thread)0x188c
pool-1-thread-52                                                cond.
waiting
  (java.lang.Thread)0x188d
pool-1-thread-53                                                cond.
waiting
  (java.lang.Thread)0x188e
pool-1-thread-54                                                cond.
waiting
  (java.lang.Thread)0x188f
pool-1-thread-55                                                cond.
waiting
  (java.lang.Thread)0x1890
pool-1-thread-56                                                cond.
waiting
  (java.lang.Thread)0x1891
pool-1-thread-57                                                cond.
waiting
  (java.lang.Thread)0x1892
pool-1-thread-58                                                cond.
waiting
  (java.lang.Thread)0x1893
pool-1-thread-59                                                cond.
waiting
  (java.lang.Thread)0x1894
pool-1-thread-60                                                cond.
waiting
  (java.lang.Thread)0x1895
pool-1-thread-61                                                cond.
waiting
  (java.lang.Thread)0x1896
pool-1-thread-62                                                cond.
waiting
  (java.lang.Thread)0x1897
pool-1-thread-63                                                cond.
waiting
  (java.lang.Thread)0x1898
pool-1-thread-64                                                cond.
waiting
  (java.lang.Thread)0x1899
pool-1-thread-65                                                cond.
waiting
  (java.lang.Thread)0x189a
pool-1-thread-66                                                cond.
waiting
  (java.lang.Thread)0x189b
pool-1-thread-67                                                cond.
waiting
  (java.lang.Thread)0x189c
pool-1-thread-68                                                cond.
waiting
  (java.lang.Thread)0x189d
pool-1-thread-69                                                cond.
waiting
  (java.lang.Thread)0x189e
pool-1-thread-70                                                cond.
waiting
  (java.lang.Thread)0x189f
pool-1-thread-71                                                cond.
waiting
  (java.lang.Thread)0x18a0
pool-1-thread-72                                                cond.
waiting
  (java.lang.Thread)0x18a1
pool-1-thread-73                                                cond.
waiting
  (java.lang.Thread)0x18a2
pool-1-thread-74                                                cond.
waiting
  (java.lang.Thread)0x18a3
pool-1-thread-75                                                cond.
waiting
  (java.lang.Thread)0x18a4
pool-1-thread-76                                                cond.
waiting
  (java.lang.Thread)0x18a5
pool-1-thread-77                                                cond.
waiting
  (java.lang.Thread)0x18a6
pool-1-thread-78                                                cond.
waiting
  (java.lang.Thread)0x18a7
pool-1-thread-79                                                cond.
waiting
  (java.lang.Thread)0x18a8
pool-1-thread-80                                                cond.
waiting
  (java.lang.Thread)0x18a9
pool-1-thread-81                                                cond.
waiting
  (java.lang.Thread)0x18aa
pool-1-thread-82                                                cond.
waiting
  (java.lang.Thread)0x18ab
pool-1-thread-83                                                cond.
waiting
  (java.lang.Thread)0x18ac
pool-1-thread-84                                                cond.
waiting
  (java.lang.Thread)0x18ad
pool-1-thread-85                                                cond.
waiting
  (java.lang.Thread)0x18ae
pool-1-thread-86                                                cond.
waiting
  (java.lang.Thread)0x18af
pool-1-thread-87                                                cond.
waiting
  (java.lang.Thread)0x18b0
pool-1-thread-88                                                cond.
waiting
  (java.lang.Thread)0x18b1
pool-1-thread-89                                                cond.
waiting
  (java.lang.Thread)0x18b2
pool-1-thread-90                                                cond.
waiting
  (java.lang.Thread)0x18b3
pool-1-thread-91                                                cond.
waiting
  (java.lang.Thread)0x18b4
pool-1-thread-92                                                cond.
waiting
  (java.lang.Thread)0x18b5
pool-1-thread-93                                                cond.
waiting
  (java.lang.Thread)0x18b6
pool-1-thread-94                                                cond.
waiting
  (java.lang.Thread)0x18b7
pool-1-thread-95                                                cond.
waiting
  (java.lang.Thread)0x18b8
pool-1-thread-96                                                cond.
waiting
  (java.lang.Thread)0x18b9
pool-1-thread-97                                                cond.
waiting
  (java.lang.Thread)0x18ba
pool-1-thread-98                                                cond.
waiting
  (java.lang.Thread)0x18bb
pool-1-thread-99                                                cond.
waiting
  (java.lang.Thread)0x18bc
pool-1-thread-100                                               cond.
waiting
  (java.lang.Thread)0x18bd
pool-1-thread-101                                               cond.
waiting
  (java.lang.Thread)0x18be
pool-1-thread-102                                               cond.
waiting
  (java.lang.Thread)0x18bf
pool-1-thread-103                                               cond.
waiting
  (java.lang.Thread)0x18c0
pool-1-thread-104                                               cond.
waiting
  (java.lang.Thread)0x18c1
pool-1-thread-105                                               cond.
waiting
  (java.lang.Thread)0x18c2
pool-1-thread-106                                               cond.
waiting
  (java.lang.Thread)0x18c3
pool-1-thread-107                                               cond.
waiting
  (java.lang.Thread)0x18c4
pool-1-thread-108                                               cond.
waiting
  (java.lang.Thread)0x18c5
pool-1-thread-109                                               cond.
waiting
  (java.lang.Thread)0x18c6
pool-1-thread-110                                               cond.
waiting
  (java.lang.Thread)0x18c7
pool-1-thread-111                                               cond.
waiting
  (java.lang.Thread)0x18c8
pool-1-thread-112                                               cond.
waiting
  (java.lang.Thread)0x18c9
pool-1-thread-113                                               cond.
waiting
  (java.lang.Thread)0x18ca
pool-1-thread-114                                               cond.
waiting
  (java.lang.Thread)0x18cb
pool-1-thread-115                                               cond.
waiting
  (java.lang.Thread)0x18cc
pool-1-thread-116                                               cond.
waiting
  (java.lang.Thread)0x18cd
pool-1-thread-117                                               cond.
waiting
  (java.lang.Thread)0x18ce
pool-1-thread-118                                               cond.
waiting
  (java.lang.Thread)0x18cf
pool-1-thread-119                                               cond.
waiting
  (java.lang.Thread)0x18d0
pool-1-thread-120                                               cond.
waiting
  (java.lang.Thread)0x18d1
pool-1-thread-121                                               cond.
waiting
  (java.lang.Thread)0x18d2
pool-1-thread-122                                               cond.
waiting
  (java.lang.Thread)0x18d3
pool-1-thread-123                                               cond.
waiting
  (java.lang.Thread)0x18d4
pool-1-thread-124                                               cond.
waiting
  (java.lang.Thread)0x18d5
pool-1-thread-125                                               cond.
waiting
  (java.lang.Thread)0x18d6
pool-1-thread-126                                               cond.
waiting
  (java.lang.Thread)0x18d7
pool-1-thread-127                                               cond.
waiting
  (java.lang.Thread)0x18d8
pool-1-thread-128                                               cond.
waiting
  (java.lang.Thread)0x18d9
pool-1-thread-129                                               cond.
waiting
  (java.lang.Thread)0x18da
pool-1-thread-130                                               cond.
waiting
  (java.lang.Thread)0x18db
pool-1-thread-131                                               cond.
waiting
  (java.lang.Thread)0x18dc
pool-1-thread-132                                               cond.
waiting
  (java.lang.Thread)0x18dd
pool-1-thread-133                                               cond.
waiting
  (java.lang.Thread)0x18de
pool-1-thread-134                                               cond.
waiting
  (java.lang.Thread)0x18df
pool-1-thread-135                                               cond.
waiting
  (java.lang.Thread)0x18e0
pool-1-thread-136                                               cond.
waiting
  (java.lang.Thread)0x18e1
pool-1-thread-137                                               cond.
waiting
  (java.lang.Thread)0x18e2
pool-1-thread-138                                               cond.
waiting
  (java.lang.Thread)0x18e3
pool-1-thread-139                                               cond.
waiting
  (java.lang.Thread)0x18e4
pool-1-thread-140                                               cond.
waiting
  (java.lang.Thread)0x18e5
pool-1-thread-141                                               cond.
waiting
  (java.lang.Thread)0x18e6
pool-1-thread-142                                               cond.
waiting
  (java.lang.Thread)0x18e7
pool-1-thread-143                                               cond.
waiting
  (java.lang.Thread)0x18e8
pool-1-thread-144                                               cond.
waiting
  (java.lang.Thread)0x18e9
pool-1-thread-145                                               cond.
waiting
  (java.lang.Thread)0x18ea
pool-1-thread-146                                               cond.
waiting
  (java.lang.Thread)0x18eb
pool-1-thread-147                                               cond.
waiting
  (java.lang.Thread)0x18ec
pool-1-thread-148                                               cond.
waiting
  (java.lang.Thread)0x18ed
pool-1-thread-149                                               cond.
waiting
  (java.lang.Thread)0x18ee
pool-1-thread-150                                               cond.
waiting
  (java.lang.Thread)0x18ef
pool-1-thread-151                                               cond.
waiting
  (java.lang.Thread)0x18f0
pool-1-thread-152                                               cond.
waiting
  (java.lang.Thread)0x18f1
pool-1-thread-153                                               cond.
waiting
  (java.lang.Thread)0x18f2
pool-1-thread-154                                               cond.
waiting
  (java.lang.Thread)0x18f3
pool-1-thread-155                                               cond.
waiting
  (java.lang.Thread)0x18f4
pool-1-thread-156                                               cond.
waiting
  (java.lang.Thread)0x18f5
pool-1-thread-157                                               cond.
waiting
  (java.lang.Thread)0x18f6
pool-1-thread-158                                               cond.
waiting
  (java.lang.Thread)0x18f7
pool-1-thread-159                                               cond.
waiting
  (java.lang.Thread)0x18f8
pool-1-thread-160                                               cond.
waiting
  (java.lang.Thread)0x18f9
pool-1-thread-161                                               cond.
waiting
  (java.lang.Thread)0x18fa
pool-1-thread-162                                               cond.
waiting
  (java.lang.Thread)0x18fb
pool-1-thread-163                                               cond.
waiting
  (java.lang.Thread)0x18fc
pool-1-thread-164                                               cond.
waiting
  (java.lang.Thread)0x18fd
pool-1-thread-165                                               cond.
waiting
  (java.lang.Thread)0x18fe
pool-1-thread-166                                               cond.
waiting
  (java.lang.Thread)0x18ff
pool-1-thread-167                                               cond.
waiting
  (java.lang.Thread)0x1900
pool-1-thread-168                                               cond.
waiting
  (java.lang.Thread)0x1901
pool-1-thread-169                                               cond.
waiting
  (java.lang.Thread)0x1902
pool-1-thread-170                                               cond.
waiting
  (java.lang.Thread)0x1903
pool-1-thread-171                                               cond.
waiting
  (java.lang.Thread)0x1904
pool-1-thread-172                                               cond.
waiting
  (java.lang.Thread)0x1905
pool-1-thread-173                                               cond.
waiting
  (java.lang.Thread)0x1906
pool-1-thread-174                                               cond.
waiting
  (java.lang.Thread)0x1907
pool-1-thread-175                                               cond.
waiting
  (java.lang.Thread)0x1908
pool-1-thread-176                                               cond.
waiting
  (java.lang.Thread)0x1909
pool-1-thread-177                                               cond.
waiting
  (java.lang.Thread)0x190a
pool-1-thread-178                                               cond.
waiting
  (java.lang.Thread)0x190b
pool-1-thread-179                                               cond.
waiting
  (java.lang.Thread)0x190c
pool-1-thread-180                                               cond.
waiting
  (java.lang.Thread)0x190d
pool-1-thread-181                                               cond.
waiting
  (java.lang.Thread)0x190e
pool-1-thread-182                                               cond.
waiting
  (java.lang.Thread)0x190f
pool-1-thread-183                                               cond.
waiting
  (java.lang.Thread)0x1910
pool-1-thread-184                                               cond.
waiting
  (java.lang.Thread)0x1911
pool-1-thread-185                                               cond.
waiting
  (java.lang.Thread)0x1912
pool-1-thread-186                                               cond.
waiting
  (java.lang.Thread)0x1913
pool-1-thread-187                                               cond.
waiting
  (java.lang.Thread)0x1914
pool-1-thread-188                                               cond.
waiting
  (java.lang.Thread)0x1915
pool-1-thread-189                                               cond.
waiting
  (java.lang.Thread)0x1916
pool-1-thread-190                                               cond.
waiting
  (java.lang.Thread)0x1917
pool-1-thread-191                                               cond.
waiting
  (java.lang.Thread)0x1918
pool-1-thread-192                                               cond.
waiting
  (java.lang.Thread)0x1919
pool-1-thread-193                                               cond.
waiting
  (java.lang.Thread)0x191a
pool-1-thread-194                                               cond.
waiting
  (java.lang.Thread)0x191b
pool-1-thread-195                                               cond.
waiting
  (java.lang.Thread)0x191c
pool-1-thread-196                                               cond.
waiting
  (java.lang.Thread)0x191d
pool-1-thread-197                                               cond.
waiting
  (java.lang.Thread)0x191e
pool-1-thread-198                                               cond.
waiting
  (java.lang.Thread)0x191f
pool-1-thread-199                                               cond.
waiting
  (java.lang.Thread)0x1920
pool-1-thread-200                                               cond.
waiting
  (java.lang.Thread)0x1921
pool-1-thread-201                                               cond.
waiting
  (java.lang.Thread)0x1922
pool-1-thread-202                                               cond.
waiting
  (java.lang.Thread)0x1923
pool-1-thread-203                                               cond.
waiting
  (java.lang.Thread)0x1924
pool-1-thread-204                                               cond.
waiting
  (java.lang.Thread)0x1925
pool-1-thread-205                                               cond.
waiting
  (java.lang.Thread)0x1926
pool-1-thread-206                                               cond.
waiting
  (java.lang.Thread)0x1927
pool-1-thread-207                                               cond.
waiting
  (java.lang.Thread)0x1928
pool-1-thread-208                                               cond.
waiting
  (java.lang.Thread)0x1929
pool-1-thread-209                                               cond.
waiting
  (java.lang.Thread)0x192a
pool-1-thread-210                                               cond.
waiting
  (java.lang.Thread)0x192b
pool-1-thread-211                                               cond.
waiting
  (java.lang.Thread)0x192c
pool-1-thread-212                                               cond.
waiting
  (java.lang.Thread)0x192d
pool-1-thread-213                                               cond.
waiting
  (java.lang.Thread)0x192e
pool-1-thread-214                                               cond.
waiting
  (java.lang.Thread)0x192f
pool-1-thread-215                                               cond.
waiting
  (java.lang.Thread)0x1930
pool-1-thread-216                                               cond.
waiting
  (java.lang.Thread)0x1931
pool-1-thread-217                                               cond.
waiting
  (java.lang.Thread)0x1932
pool-1-thread-218                                               cond.
waiting
  (java.lang.Thread)0x1933
pool-1-thread-219                                               cond.
waiting
  (java.lang.Thread)0x1934
pool-1-thread-220                                               cond.
waiting
  (java.lang.Thread)0x1935
pool-1-thread-221                                               cond.
waiting
  (java.lang.Thread)0x1936
pool-1-thread-222                                               cond.
waiting
  (java.lang.Thread)0x1937
pool-1-thread-223                                               cond.
waiting
  (java.lang.Thread)0x1938
pool-1-thread-224                                               cond.
waiting
  (java.lang.Thread)0x1939
pool-1-thread-225                                               cond.
waiting
  (java.lang.Thread)0x193a
pool-1-thread-226                                               cond.
waiting
  (java.lang.Thread)0x193b
pool-1-thread-227                                               cond.
waiting
  (java.lang.Thread)0x193c
pool-1-thread-228                                               cond.
waiting
  (java.lang.Thread)0x193d
pool-1-thread-229                                               cond.
waiting
  (java.lang.Thread)0x193e
pool-1-thread-230                                               cond.
waiting
  (java.lang.Thread)0x193f
pool-1-thread-231                                               cond.
waiting
  (java.lang.Thread)0x1940
pool-1-thread-232                                               cond.
waiting
  (java.lang.Thread)0x1941
pool-1-thread-233                                               cond.
waiting
  (java.lang.Thread)0x1942
pool-1-thread-234                                               cond.
waiting
  (java.lang.Thread)0x1943
pool-1-thread-235                                               cond.
waiting
  (java.lang.Thread)0x1944
pool-1-thread-236                                               cond.
waiting
  (java.lang.Thread)0x1945
pool-1-thread-237                                               cond.
waiting
  (java.lang.Thread)0x1946
pool-1-thread-238                                               cond.
waiting
  (java.lang.Thread)0x1947
pool-1-thread-239                                               cond.
waiting
  (java.lang.Thread)0x1948
pool-1-thread-240                                               cond.
waiting
  (java.lang.Thread)0x1949
pool-1-thread-241                                               cond.
waiting
  (java.lang.Thread)0x194a
pool-1-thread-242                                               cond.
waiting
  (java.lang.Thread)0x194b
pool-1-thread-243                                               cond.
waiting
  (java.lang.Thread)0x194c
pool-1-thread-244                                               cond.
waiting
  (java.lang.Thread)0x194d
pool-1-thread-245                                               cond.
waiting
  (java.lang.Thread)0x194e
pool-1-thread-246                                               cond.
waiting
  (java.lang.Thread)0x194f
pool-1-thread-247                                               cond.
waiting
  (java.lang.Thread)0x1950
pool-1-thread-248                                               cond.
waiting
  (java.lang.Thread)0x1951
pool-1-thread-249                                               cond.
waiting
  (java.lang.Thread)0x1952
pool-1-thread-250                                               cond.
waiting
  (java.lang.Thread)0x1953
pool-1-thread-251                                               cond.
waiting
  (java.lang.Thread)0x1954
pool-1-thread-252                                               cond.
waiting
  (java.lang.Thread)0x1955
pool-1-thread-253                                               cond.
waiting
  (java.lang.Thread)0x1956
pool-1-thread-254                                               cond.
waiting
  (java.lang.Thread)0x1957
pool-1-thread-255                                               cond.
waiting
  (java.lang.Thread)0x1958
pool-1-thread-256                                               cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1959
http-80-Processor552                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195a
http-80-Processor682                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195b
http-80-Processor722                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195c
http-80-Processor729                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195d
http-80-Processor731                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195e
http-80-Processor742                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195f
http-80-Processor749                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1960
http-80-Processor752                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1961
http-80-Processor776                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1962
http-80-Processor778                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1963
http-80-Processor794                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1964
http-80-Processor805                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1965
http-80-Processor841                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1966
http-80-Processor860                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1967
http-80-Processor861                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1968
http-80-Processor866                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1969
http-80-Processor875                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196a
http-80-Processor879                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196b
http-80-Processor882                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196c
http-80-Processor886                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196d
http-80-Processor889                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196e
http-80-Processor896                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x196f
http-80-Processor899                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1970
http-80-Processor900                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1971
http-80-Processor901                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1972
http-80-Processor903                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1973
http-80-Processor906                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1974
http-80-Processor910                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1975
http-80-Processor914                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1976
http-80-Processor915                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1977
http-80-Processor917                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1978
http-80-Processor918                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1979
http-80-Processor919                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197a
http-80-Processor923                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197b
http-80-Processor926                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197c
http-80-Processor936                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197d
http-80-Processor937                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197e
http-80-Processor938                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x197f
http-80-Processor941                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1980
http-80-Processor942                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1981
http-80-Processor943                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1982
http-80-Processor947                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1983
http-80-Processor949                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1984
http-80-Processor950                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1985
http-80-Processor951                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1986
http-80-Processor952                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1987
http-80-Processor953                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1988
http-80-Processor957                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1989
http-80-Processor959                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198a
http-80-Processor960                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198b
http-80-Processor961                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198c
http-80-Processor962                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198d
http-80-Processor963                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198e
http-80-Processor964                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x198f
http-80-Processor965                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1990
http-80-Processor966                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1991
http-80-Processor971                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1992
http-80-Processor974                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1993
http-80-Processor975                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1994
http-80-Processor976                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1995
http-80-Processor978                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1996
http-80-Processor979                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1997
http-80-Processor980                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1998
http-80-Processor981                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1999
http-80-Processor982                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199a
http-80-Processor983                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199b
http-80-Processor984                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199c
http-80-Processor985                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199d
http-80-Processor987                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199e
http-80-Processor988                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x199f
http-80-Processor989                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a0
http-80-Processor990                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a1
http-80-Processor992                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a2
http-80-Processor994                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a3
http-80-Processor996                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a4
http-80-Processor997                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a5
http-80-Processor999                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a6
http-80-Processor1001                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a7
http-80-Processor1002                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a8
http-80-Processor1003                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19a9
http-80-Processor1004                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19aa
http-80-Processor1005                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ab
http-80-Processor1006                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ac
http-80-Processor1007                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ad
http-80-Processor1008                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ae
http-80-Processor1009                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19af
http-80-Processor1010                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b0
http-80-Processor1011                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b1
http-80-Processor1012                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b2
http-80-Processor1013                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b3
http-80-Processor1014                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b4
http-80-Processor1015                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b5
http-80-Processor1016                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b6
http-80-Processor1017                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b7
http-80-Processor1018                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b8
http-80-Processor1019                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19b9
http-80-Processor1020                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ba
http-80-Processor1022                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bb
http-80-Processor1023                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bc
http-80-Processor1024                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bd
http-80-Processor1025                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19be
http-80-Processor1026                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19bf
http-80-Processor1027                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c0
http-80-Processor1028                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c1
http-80-Processor1029                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c2
http-80-Processor1030                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c3
http-80-Processor1031                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c4
http-80-Processor1032                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c5
http-80-Processor1033                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c6
http-80-Processor1034                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c7
http-80-Processor1035                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c8
http-80-Processor1036                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19c9
http-80-Processor1037                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ca
http-80-Processor1038                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cb
http-80-Processor1039                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cc
http-80-Processor1040                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cd
http-80-Processor1041                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ce
http-80-Processor1042                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19cf
http-80-Processor1043                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d0
http-80-Processor1044                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d1
http-80-Processor1045                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d2
http-80-Processor1046                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d3
http-80-Processor1047                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d4
http-80-Processor1048                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d5
http-80-Processor1049                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d6
http-80-Processor1050                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d7
http-80-Processor1051                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d8
http-80-Processor1052                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19d9
http-80-Processor1053                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19da
http-80-Processor1054                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19db
http-80-Processor1055                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19dc
http-80-Processor1056                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19dd
http-80-Processor1057                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19de
http-80-Processor1058                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19df
http-80-Processor1059                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e0
http-80-Processor1060                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e1
http-80-Processor1061                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e2
http-80-Processor1062                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e3
http-80-Processor1063                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e4
http-80-Processor1064                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e5
http-80-Processor1065                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e6
http-80-Processor1066                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e7
http-80-Processor1067                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e8
http-80-Processor1068                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19e9
http-80-Processor1069                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ea
http-80-Processor1070                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19eb
http-80-Processor1071                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ec
http-80-Processor1072                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ed
http-80-Processor1073                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ee
http-80-Processor1074                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ef
http-80-Processor1075                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f0
http-80-Processor1076                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f1
http-80-Processor1077                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f2
http-80-Processor1078                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f3
http-80-Processor1079                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f4
http-80-Processor1080                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f5
http-80-Processor1081                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f6
http-80-Processor1082                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f7
http-80-Processor1083                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f8
http-80-Processor1084                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19f9
http-80-Processor1085                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fa
http-80-Processor1086                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fb
http-80-Processor1087                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fc
http-80-Processor1088                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fd
http-80-Processor1089                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19fe
http-80-Processor1090                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x19ff
http-80-Processor1091                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a00
http-80-Processor1092                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a01
http-80-Processor1093                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a02
http-80-Processor1094                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a03
http-80-Processor1095                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a04
http-80-Processor1096                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a05
http-80-Processor1097                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a06
http-80-Processor1098                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a07
http-80-Processor1099                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a08
http-80-Processor1100                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a09
http-80-Processor1101                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0a
http-80-Processor1102                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0b
http-80-Processor1103                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0c
http-80-Processor1104                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0d
http-80-Processor1105                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0e
http-80-Processor1106                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a0f
http-80-Processor1107                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a10
http-80-Processor1108                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a11
http-80-Processor1109                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a12
http-80-Processor1110                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a13
http-80-Processor1111                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a14
http-80-Processor1112                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a15
http-80-Processor1113                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a16
http-80-Processor1114                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a17
http-80-Processor1115                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a18
http-80-Processor1116                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a19
http-80-Processor1117                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1a
http-80-Processor1118                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1b
http-80-Processor1119                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1c
http-80-Processor1120                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1d
http-80-Processor1121                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1e
http-80-Processor1122                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a1f
http-80-Processor1123                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a20
http-80-Processor1124                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a21
http-80-Processor1125                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a22
http-80-Processor1126                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a23
http-80-Processor1127                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a24
http-80-Processor1128                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a25
http-80-Processor1129                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a26
http-80-Processor1130                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a27
http-80-Processor1131                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a28
http-80-Processor1132                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a29
http-80-Processor1133                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2a
http-80-Processor1134                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2b
http-80-Processor1135                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2c
http-80-Processor1136                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2d
http-80-Processor1137                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2e
http-80-Processor1138                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a2f
http-80-Processor1139                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a30
http-80-Processor1140                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a31
http-80-Processor1141                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a32
http-80-Processor1142                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a33
http-80-Processor1143                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a34
http-80-Processor1144                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a35
http-80-Processor1145                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a36
http-80-Processor1146                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a37
http-80-Processor1147                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a38
http-80-Processor1148                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a39
http-80-Processor1149                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3a
http-80-Processor1150                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3b
http-80-Processor1151                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3c
http-80-Processor1152                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3d
http-80-Processor1153                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3e
http-80-Processor1154                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a3f
http-80-Processor1155                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a40
http-80-Processor1156                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a41
http-80-Processor1157                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a42
http-80-Processor1158                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a43
http-80-Processor1159                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a44
http-80-Processor1160                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a45
http-80-Processor1161                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a46
http-80-Processor1162                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a47
http-80-Processor1163                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a48
http-80-Processor1164                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a49
http-80-Processor1165                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4a
http-80-Processor1166                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4b
http-80-Processor1167                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4c
http-80-Processor1168                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4d
http-80-Processor1169                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4e
http-80-Processor1170                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a4f
http-80-Processor1171                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a50
http-80-Processor1172                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a51
http-80-Processor1173                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a52
http-80-Processor1174                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a53
http-80-Processor1175                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a54
http-80-Processor1176                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a55
http-80-Processor1177                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a56
http-80-Processor1178                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a57
http-80-Processor1179                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a58
http-80-Processor1180                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a59
http-80-Processor1181                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5a
http-80-Processor1182                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5b
http-80-Processor1183                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5c
http-80-Processor1184                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5d
http-80-Processor1185                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5e
http-80-Processor1186                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a5f
http-80-Processor1187                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a60
http-80-Processor1188                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a61
http-80-Processor1189                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a62
http-80-Processor1190                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a63
http-80-Processor1191                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a64
http-80-Processor1192                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a65
http-80-Processor1193                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a66
http-80-Processor1194                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a67
http-80-Processor1195                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a68
http-80-Processor1196                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a69
http-80-Processor1197                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6a
http-80-Processor1198                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6b
http-80-Processor1199                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6c
http-80-Processor1200                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6d
http-80-Processor1201                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6e
http-80-Processor1202                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a6f
http-80-Processor1203                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a70
http-80-Processor1204                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a71
http-80-Processor1205                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a72
http-80-Processor1206                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a73
http-80-Processor1207                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a74
http-80-Processor1208                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a75
http-80-Processor1209                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a76
http-80-Processor1210                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a77
http-80-Processor1211                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a78
http-80-Processor1212                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a79
http-80-Processor1213                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7a
http-80-Processor1214                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7b
http-80-Processor1215                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7c
http-80-Processor1216                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7d
http-80-Processor1217                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7e
http-80-Processor1218                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a7f
http-80-Processor1219                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a80
http-80-Processor1220                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a81
http-80-Processor1221                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a82
http-80-Processor1222                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a83
http-80-Processor1223                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a84
http-80-Processor1224                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a85
http-80-Processor1225                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a86
http-80-Processor1226                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a87
http-80-Processor1227                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a88
http-80-Processor1228                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a89
http-80-Processor1229                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8a
http-80-Processor1230                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8b
http-80-Processor1231                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8c
http-80-Processor1232                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8d
http-80-Processor1233                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8e
http-80-Processor1234                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a8f
http-80-Processor1235                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a90
http-80-Processor1236                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a91
http-80-Processor1237                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a92
http-80-Processor1238                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a93
http-80-Processor1239                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a94
http-80-Processor1240                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a95
http-80-Processor1241                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a96
http-80-Processor1242                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a97
http-80-Processor1243                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a98
http-80-Processor1244                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a99
http-80-Processor1245                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9a
http-80-Processor1246                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9b
http-80-Processor1247                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9c
http-80-Processor1248                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9d
http-80-Processor1249                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9e
http-80-Processor1250                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1a9f
http-80-Processor1251                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa0
http-80-Processor1252                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa1
http-80-Processor1253                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa2
http-80-Processor1254                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa3
http-80-Processor1255                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa4
http-80-Processor1256                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa5
http-80-Processor1257                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa6
http-80-Processor1258                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa7
http-80-Processor1259                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa8
http-80-Processor1260                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aa9
http-80-Processor1261                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aaa
http-80-Processor1262                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aab
http-80-Processor1263                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aac
http-80-Processor1264                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aad
http-80-Processor1265                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aae
http-80-Processor1266                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1aaf
http-80-Processor1267                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab0
http-80-Processor1268                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab1
http-80-Processor1269                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab2
http-80-Processor1270                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab3
http-80-Processor1271                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab4
http-80-Processor1272                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab5
http-80-Processor1273                                           cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1ab6
http-80-Processor1274                                           cond.
waiting
>

-----Original Message-----
From: Filip Hanik - Dev Lists [mailto:devlists@hanik.com] 
Sent: Monday, April 28, 2008 6:44 PM
To: Tomcat Users List
Subject: Re: Tomcat HTTTP Connectior Hangs

you keep with holding information,
post the entire thread dump, in its native format

Filip

Barak Yaish wrote:
> My mistake, you right. There is one thread waiting for a db connection
from
> the pool:
>
>
>   
>> where 0x184e
>>     
>   [1] java.lang.Object.wait (native method)
>   [2] com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable
> (BasicResourcePool.java:1,315)
>   [3] com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource
> (BasicResourcePool.java:557)
>   [4] com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource
> (BasicResourcePool.java:477)
>   [5]
> com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection
> (C3P0PooledConnectionPool.java:525)
>   [6] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection
> (AbstractPoolBackedDataSource.java:128)
>   [7] org.hibernate.connection.C3P0ConnectionProvider.getConnection
> (C3P0ConnectionProvider.java:35)
>   [8] org.hibernate.jdbc.ConnectionManager.openConnection
> (ConnectionManager.java:417)
>   [9] org.hibernate.jdbc.ConnectionManager.getConnection
> (ConnectionManager.java:144)
>   [10] org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement
> (AbstractBatcher.java:139)
>   [11] org.hibernate.loader.Loader.prepareQueryStatement
(Loader.java:1,561)
>   [12] org.hibernate.loader.Loader.doQuery (Loader.java:661)
>   [13] org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections
> (Loader.java:224)
>   [14] org.hibernate.loader.Loader.doList (Loader.java:2,145)
>   [15] org.hibernate.loader.Loader.listIgnoreQueryCache
(Loader.java:2,029)
>   [16] org.hibernate.loader.Loader.list (Loader.java:2,024)
>   [17] org.hibernate.loader.hql.QueryLoader.list (QueryLoader.java:392)
>   [18] org.hibernate.hql.ast.QueryTranslatorImpl.list
> (QueryTranslatorImpl.java:333)
>   [19] org.hibernate.engine.query.HQLQueryPlan.performList
> (HQLQueryPlan.java:172)
>   [20] org.hibernate.impl.SessionImpl.list (SessionImpl.java:1,114)
>   [21] org.hibernate.impl.QueryImpl.list (QueryImpl.java:79)
>   [22] org.hibernate.ejb.QueryImpl.getResultList (QueryImpl.java:53)
>   [23] com.barak.persitence.EntityManagerImpl.all
> (EntityManagerImpl.java:148)
>   [24] com.barak.deamon.lookup.LookupDaemon.execute
(LookupDaemon.java:271)
>   [25] com.barak.daemon.StatefulDaemon.run (StatefulDaemon.java:68)
>
>
> So, my next question is: why this stuck thread causes the entire Tomcat to
> hang? This thread used as a daemon (building a mini cache), and not
> participate when serving an incoming HTTP request.
>
>
> The entire (almost) thread dump of Tomcat:
>
> Group system:
>   (java.lang.ref.Reference$ReferenceHandler)0x1833
> Reference Handler                                               cond.
> waiting
>   (java.lang.ref.Finalizer$FinalizerThread)0x1834
> Finalizer                                                       cond.
> waiting
>   (java.lang.Thread)0x1835
> Signal Dispatcher                                               running
>   (java.lang.Thread)0x1836
> RMI Scheduler(0)                                                cond.
> waiting
>   (java.lang.Thread)0x1837
> RMI RenewClean-[prod29:37355]				    cond. waiting
>   (sun.misc.GC$Daemon)0x1838
> GC Daemon                                                       cond.
> waiting
>   (java.lang.Thread)0x1839
> RMI RenewClean-[prod31:45514]			            cond. waiting
>   (java.lang.Thread)0x183a
> RMI RenewClean-[prod7:46845]			            cond. waiting
>   (java.lang.Thread)0x183b
> RMI RenewClean-[prod15:33128]				    cond. waiting
>   (java.lang.Thread)0x183c
> RMI RenewClean-[prod12:45154]				    cond. waiting
> Group main:
>   (java.lang.Thread)0x183f
> main                                                            running
>   (java.util.TimerThread)0x1840
> Timer-0                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1841
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1842
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1843
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (java.util.TimerThread)0x1845
> Timer-1                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1846
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1847
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1848
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (java.util.TimerThread)0x184a
> Timer-2                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184b
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184c
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184d
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (com.barak.deamon.lookup.LookupDaemon)0x184e                  Thread-18
> cond. waiting
>   (com.barak.deamon.logger.LoggerDaemon2)0x184f                 Thread-19
> sleeping
>   (com.barak.deamon.loadbalancing.LoadBalancerDaemon)0x1850     Thread-20
> sleeping
>   (java.util.TimerThread)0x1851
> Timer-3                                                         cond.
> waiting
>   (java.lang.Thread)0x1852
> ContainerBackgroundProcessor[StandardEngine[Catalina]]          sleeping
>   (java.lang.Thread)0x1853
> http-80-Monitor                                                 cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1854
> TP-Processor1                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1855
> TP-Processor2                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1856
> TP-Processor3                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1857
> TP-Processor4                                                   running
>   (java.lang.Thread)0x1858
> TP-Monitor                                                      cond.
> waiting
>   (java.lang.Thread)0x1859
> pool-1-thread-1                                                 cond.
> waiting
>   (java.lang.Thread)0x185a
> pool-1-thread-2                                                 cond.
> waiting
>   (java.lang.Thread)0x185b
> pool-1-thread-3                                                 cond.
> waiting
>   (java.lang.Thread)0x185c
> pool-1-thread-4                                                 cond.
> waiting
>   (java.lang.Thread)0x185d
> pool-1-thread-5                                                 cond.
> waiting
>   (java.lang.Thread)0x185e
> pool-1-thread-6                                                 cond.
> waiting
>   (java.lang.Thread)0x185f
> pool-1-thread-7                                                 cond.
> waiting
>   (java.lang.Thread)0x1860
> pool-1-thread-8                                                 cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1959
> http-80-Processor552                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195a
> http-80-Processor682                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195b
> http-80-Processor722                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195c
> http-80-Processor729                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195d
> http-80-Processor731                                            cond.
> waiting
>   
>
>
> Thanks for helping quickly!!
>
> Barak.
>
>
> -----Original Message-----
> From: Caldarale, Charles R [mailto:Chuck.Caldarale@unisys.com] 
> Sent: Monday, April 28, 2008 3:35 PM
> To: Tomcat Users List
> Subject: RE: Tomcat HTTTP Connectior Hangs
>
>   
>> From: Barak Yaish [mailto:barak@peer39.com] 
>> Subject: Tomcat HTTTP Connectior Hangs
>>
>> thread dump of the JVM running the tomcat does not show 
>> any stuck thread
>>     
>
> The above is rather hard to believe - you might want to post the thread
> dump, or at least non-duplicate parts of it.
>
> Are your database connections not being returned to the pool, perhaps?
>
>  - Chuck
>
>
> THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY
> MATERIAL and is thus for use only by the intended recipient. If you
> received this in error, please contact the sender and delete the e-mail
> and its attachments from all computers.
>
> ---------------------------------------------------------------------
> To start a new topic, e-mail: users@tomcat.apache.org
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
> ---------------------------------------------------------------------
> To start a new topic, e-mail: users@tomcat.apache.org
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
>
>   


---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


Re: Tomcat HTTTP Connectior Hangs

Posted by Filip Hanik - Dev Lists <de...@hanik.com>.
you keep with holding information,
post the entire thread dump, in its native format

Filip

Barak Yaish wrote:
> My mistake, you right. There is one thread waiting for a db connection from
> the pool:
>
>
>   
>> where 0x184e
>>     
>   [1] java.lang.Object.wait (native method)
>   [2] com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable
> (BasicResourcePool.java:1,315)
>   [3] com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource
> (BasicResourcePool.java:557)
>   [4] com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource
> (BasicResourcePool.java:477)
>   [5]
> com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection
> (C3P0PooledConnectionPool.java:525)
>   [6] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection
> (AbstractPoolBackedDataSource.java:128)
>   [7] org.hibernate.connection.C3P0ConnectionProvider.getConnection
> (C3P0ConnectionProvider.java:35)
>   [8] org.hibernate.jdbc.ConnectionManager.openConnection
> (ConnectionManager.java:417)
>   [9] org.hibernate.jdbc.ConnectionManager.getConnection
> (ConnectionManager.java:144)
>   [10] org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement
> (AbstractBatcher.java:139)
>   [11] org.hibernate.loader.Loader.prepareQueryStatement (Loader.java:1,561)
>   [12] org.hibernate.loader.Loader.doQuery (Loader.java:661)
>   [13] org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections
> (Loader.java:224)
>   [14] org.hibernate.loader.Loader.doList (Loader.java:2,145)
>   [15] org.hibernate.loader.Loader.listIgnoreQueryCache (Loader.java:2,029)
>   [16] org.hibernate.loader.Loader.list (Loader.java:2,024)
>   [17] org.hibernate.loader.hql.QueryLoader.list (QueryLoader.java:392)
>   [18] org.hibernate.hql.ast.QueryTranslatorImpl.list
> (QueryTranslatorImpl.java:333)
>   [19] org.hibernate.engine.query.HQLQueryPlan.performList
> (HQLQueryPlan.java:172)
>   [20] org.hibernate.impl.SessionImpl.list (SessionImpl.java:1,114)
>   [21] org.hibernate.impl.QueryImpl.list (QueryImpl.java:79)
>   [22] org.hibernate.ejb.QueryImpl.getResultList (QueryImpl.java:53)
>   [23] com.barak.persitence.EntityManagerImpl.all
> (EntityManagerImpl.java:148)
>   [24] com.barak.deamon.lookup.LookupDaemon.execute (LookupDaemon.java:271)
>   [25] com.barak.daemon.StatefulDaemon.run (StatefulDaemon.java:68)
>
>
> So, my next question is: why this stuck thread causes the entire Tomcat to
> hang? This thread used as a daemon (building a mini cache), and not
> participate when serving an incoming HTTP request.
>
>
> The entire (almost) thread dump of Tomcat:
>
> Group system:
>   (java.lang.ref.Reference$ReferenceHandler)0x1833
> Reference Handler                                               cond.
> waiting
>   (java.lang.ref.Finalizer$FinalizerThread)0x1834
> Finalizer                                                       cond.
> waiting
>   (java.lang.Thread)0x1835
> Signal Dispatcher                                               running
>   (java.lang.Thread)0x1836
> RMI Scheduler(0)                                                cond.
> waiting
>   (java.lang.Thread)0x1837
> RMI RenewClean-[prod29:37355]				    cond. waiting
>   (sun.misc.GC$Daemon)0x1838
> GC Daemon                                                       cond.
> waiting
>   (java.lang.Thread)0x1839
> RMI RenewClean-[prod31:45514]			            cond. waiting
>   (java.lang.Thread)0x183a
> RMI RenewClean-[prod7:46845]			            cond. waiting
>   (java.lang.Thread)0x183b
> RMI RenewClean-[prod15:33128]				    cond. waiting
>   (java.lang.Thread)0x183c
> RMI RenewClean-[prod12:45154]				    cond. waiting
> Group main:
>   (java.lang.Thread)0x183f
> main                                                            running
>   (java.util.TimerThread)0x1840
> Timer-0                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1841
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1842
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1843
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (java.util.TimerThread)0x1845
> Timer-1                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1846
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1847
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1848
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (java.util.TimerThread)0x184a
> Timer-2                                                         cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184b
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184c
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
> waiting
>   (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184d
> com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
> waiting
>   (com.barak.deamon.lookup.LookupDaemon)0x184e                  Thread-18
> cond. waiting
>   (com.barak.deamon.logger.LoggerDaemon2)0x184f                 Thread-19
> sleeping
>   (com.barak.deamon.loadbalancing.LoadBalancerDaemon)0x1850     Thread-20
> sleeping
>   (java.util.TimerThread)0x1851
> Timer-3                                                         cond.
> waiting
>   (java.lang.Thread)0x1852
> ContainerBackgroundProcessor[StandardEngine[Catalina]]          sleeping
>   (java.lang.Thread)0x1853
> http-80-Monitor                                                 cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1854
> TP-Processor1                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1855
> TP-Processor2                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1856
> TP-Processor3                                                   cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1857
> TP-Processor4                                                   running
>   (java.lang.Thread)0x1858
> TP-Monitor                                                      cond.
> waiting
>   (java.lang.Thread)0x1859
> pool-1-thread-1                                                 cond.
> waiting
>   (java.lang.Thread)0x185a
> pool-1-thread-2                                                 cond.
> waiting
>   (java.lang.Thread)0x185b
> pool-1-thread-3                                                 cond.
> waiting
>   (java.lang.Thread)0x185c
> pool-1-thread-4                                                 cond.
> waiting
>   (java.lang.Thread)0x185d
> pool-1-thread-5                                                 cond.
> waiting
>   (java.lang.Thread)0x185e
> pool-1-thread-6                                                 cond.
> waiting
>   (java.lang.Thread)0x185f
> pool-1-thread-7                                                 cond.
> waiting
>   (java.lang.Thread)0x1860
> pool-1-thread-8                                                 cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1959
> http-80-Processor552                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195a
> http-80-Processor682                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195b
> http-80-Processor722                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195c
> http-80-Processor729                                            cond.
> waiting
>   (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195d
> http-80-Processor731                                            cond.
> waiting
>   
>
>
> Thanks for helping quickly!!
>
> Barak.
>
>
> -----Original Message-----
> From: Caldarale, Charles R [mailto:Chuck.Caldarale@unisys.com] 
> Sent: Monday, April 28, 2008 3:35 PM
> To: Tomcat Users List
> Subject: RE: Tomcat HTTTP Connectior Hangs
>
>   
>> From: Barak Yaish [mailto:barak@peer39.com] 
>> Subject: Tomcat HTTTP Connectior Hangs
>>
>> thread dump of the JVM running the tomcat does not show 
>> any stuck thread
>>     
>
> The above is rather hard to believe - you might want to post the thread
> dump, or at least non-duplicate parts of it.
>
> Are your database connections not being returned to the pool, perhaps?
>
>  - Chuck
>
>
> THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY
> MATERIAL and is thus for use only by the intended recipient. If you
> received this in error, please contact the sender and delete the e-mail
> and its attachments from all computers.
>
> ---------------------------------------------------------------------
> To start a new topic, e-mail: users@tomcat.apache.org
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
> ---------------------------------------------------------------------
> To start a new topic, e-mail: users@tomcat.apache.org
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
>
>   


---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


RE: Tomcat HTTTP Connectior Hangs

Posted by Barak Yaish <ba...@peer39.com>.
My mistake, you right. There is one thread waiting for a db connection from
the pool:


> where 0x184e
  [1] java.lang.Object.wait (native method)
  [2] com.mchange.v2.resourcepool.BasicResourcePool.awaitAvailable
(BasicResourcePool.java:1,315)
  [3] com.mchange.v2.resourcepool.BasicResourcePool.prelimCheckoutResource
(BasicResourcePool.java:557)
  [4] com.mchange.v2.resourcepool.BasicResourcePool.checkoutResource
(BasicResourcePool.java:477)
  [5]
com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection
(C3P0PooledConnectionPool.java:525)
  [6] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection
(AbstractPoolBackedDataSource.java:128)
  [7] org.hibernate.connection.C3P0ConnectionProvider.getConnection
(C3P0ConnectionProvider.java:35)
  [8] org.hibernate.jdbc.ConnectionManager.openConnection
(ConnectionManager.java:417)
  [9] org.hibernate.jdbc.ConnectionManager.getConnection
(ConnectionManager.java:144)
  [10] org.hibernate.jdbc.AbstractBatcher.prepareQueryStatement
(AbstractBatcher.java:139)
  [11] org.hibernate.loader.Loader.prepareQueryStatement (Loader.java:1,561)
  [12] org.hibernate.loader.Loader.doQuery (Loader.java:661)
  [13] org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections
(Loader.java:224)
  [14] org.hibernate.loader.Loader.doList (Loader.java:2,145)
  [15] org.hibernate.loader.Loader.listIgnoreQueryCache (Loader.java:2,029)
  [16] org.hibernate.loader.Loader.list (Loader.java:2,024)
  [17] org.hibernate.loader.hql.QueryLoader.list (QueryLoader.java:392)
  [18] org.hibernate.hql.ast.QueryTranslatorImpl.list
(QueryTranslatorImpl.java:333)
  [19] org.hibernate.engine.query.HQLQueryPlan.performList
(HQLQueryPlan.java:172)
  [20] org.hibernate.impl.SessionImpl.list (SessionImpl.java:1,114)
  [21] org.hibernate.impl.QueryImpl.list (QueryImpl.java:79)
  [22] org.hibernate.ejb.QueryImpl.getResultList (QueryImpl.java:53)
  [23] com.barak.persitence.EntityManagerImpl.all
(EntityManagerImpl.java:148)
  [24] com.barak.deamon.lookup.LookupDaemon.execute (LookupDaemon.java:271)
  [25] com.barak.daemon.StatefulDaemon.run (StatefulDaemon.java:68)


So, my next question is: why this stuck thread causes the entire Tomcat to
hang? This thread used as a daemon (building a mini cache), and not
participate when serving an incoming HTTP request.


The entire (almost) thread dump of Tomcat:

Group system:
  (java.lang.ref.Reference$ReferenceHandler)0x1833
Reference Handler                                               cond.
waiting
  (java.lang.ref.Finalizer$FinalizerThread)0x1834
Finalizer                                                       cond.
waiting
  (java.lang.Thread)0x1835
Signal Dispatcher                                               running
  (java.lang.Thread)0x1836
RMI Scheduler(0)                                                cond.
waiting
  (java.lang.Thread)0x1837
RMI RenewClean-[prod29:37355]				    cond. waiting
  (sun.misc.GC$Daemon)0x1838
GC Daemon                                                       cond.
waiting
  (java.lang.Thread)0x1839
RMI RenewClean-[prod31:45514]			            cond. waiting
  (java.lang.Thread)0x183a
RMI RenewClean-[prod7:46845]			            cond. waiting
  (java.lang.Thread)0x183b
RMI RenewClean-[prod15:33128]				    cond. waiting
  (java.lang.Thread)0x183c
RMI RenewClean-[prod12:45154]				    cond. waiting
Group main:
  (java.lang.Thread)0x183f
main                                                            running
  (java.util.TimerThread)0x1840
Timer-0                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1841
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1842
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1843
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (java.util.TimerThread)0x1845
Timer-1                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1846
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1847
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x1848
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (java.util.TimerThread)0x184a
Timer-2                                                         cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184b
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184c
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1 cond.
waiting
  (com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread)0x184d
com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2 cond.
waiting
  (com.barak.deamon.lookup.LookupDaemon)0x184e                  Thread-18
cond. waiting
  (com.barak.deamon.logger.LoggerDaemon2)0x184f                 Thread-19
sleeping
  (com.barak.deamon.loadbalancing.LoadBalancerDaemon)0x1850     Thread-20
sleeping
  (java.util.TimerThread)0x1851
Timer-3                                                         cond.
waiting
  (java.lang.Thread)0x1852
ContainerBackgroundProcessor[StandardEngine[Catalina]]          sleeping
  (java.lang.Thread)0x1853
http-80-Monitor                                                 cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1854
TP-Processor1                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1855
TP-Processor2                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1856
TP-Processor3                                                   cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1857
TP-Processor4                                                   running
  (java.lang.Thread)0x1858
TP-Monitor                                                      cond.
waiting
  (java.lang.Thread)0x1859
pool-1-thread-1                                                 cond.
waiting
  (java.lang.Thread)0x185a
pool-1-thread-2                                                 cond.
waiting
  (java.lang.Thread)0x185b
pool-1-thread-3                                                 cond.
waiting
  (java.lang.Thread)0x185c
pool-1-thread-4                                                 cond.
waiting
  (java.lang.Thread)0x185d
pool-1-thread-5                                                 cond.
waiting
  (java.lang.Thread)0x185e
pool-1-thread-6                                                 cond.
waiting
  (java.lang.Thread)0x185f
pool-1-thread-7                                                 cond.
waiting
  (java.lang.Thread)0x1860
pool-1-thread-8                                                 cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x1959
http-80-Processor552                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195a
http-80-Processor682                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195b
http-80-Processor722                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195c
http-80-Processor729                                            cond.
waiting
  (org.apache.tomcat.util.threads.ThreadWithAttributes)0x195d
http-80-Processor731                                            cond.
waiting
  


Thanks for helping quickly!!

Barak.


-----Original Message-----
From: Caldarale, Charles R [mailto:Chuck.Caldarale@unisys.com] 
Sent: Monday, April 28, 2008 3:35 PM
To: Tomcat Users List
Subject: RE: Tomcat HTTTP Connectior Hangs

> From: Barak Yaish [mailto:barak@peer39.com] 
> Subject: Tomcat HTTTP Connectior Hangs
> 
> thread dump of the JVM running the tomcat does not show 
> any stuck thread

The above is rather hard to believe - you might want to post the thread
dump, or at least non-duplicate parts of it.

Are your database connections not being returned to the pool, perhaps?

 - Chuck


THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY
MATERIAL and is thus for use only by the intended recipient. If you
received this in error, please contact the sender and delete the e-mail
and its attachments from all computers.

---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org


RE: Tomcat HTTTP Connectior Hangs

Posted by "Caldarale, Charles R" <Ch...@unisys.com>.
> From: Barak Yaish [mailto:barak@peer39.com] 
> Subject: Tomcat HTTTP Connectior Hangs
> 
> thread dump of the JVM running the tomcat does not show 
> any stuck thread

The above is rather hard to believe - you might want to post the thread
dump, or at least non-duplicate parts of it.

Are your database connections not being returned to the pool, perhaps?

 - Chuck


THIS COMMUNICATION MAY CONTAIN CONFIDENTIAL AND/OR OTHERWISE PROPRIETARY
MATERIAL and is thus for use only by the intended recipient. If you
received this in error, please contact the sender and delete the e-mail
and its attachments from all computers.

---------------------------------------------------------------------
To start a new topic, e-mail: users@tomcat.apache.org
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org