You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@tomcat.apache.org by Mohammad Salman <sa...@gmail.com> on 2016/01/21 20:02:38 UTC
Query regarding HAProxy + Embedded Tomcat(8.0.20)
Hi,
I am seeing periodic latency spikes in HAProxy logs. Latency spike
correspond to high *TC* (Backend connect time ) times (all ranging from
*1000-1010* ms). Suspecting some kind of timeout happening but doesnt know
which one.
Following is the HAProxy configuration
Current HAProxy config timeouts:
retries 3
timeout http-request 10s
timeout queue 1m
timeout connect 10s
timeout client 1m
timeout server 5m
timeout http-keep-alive 100s
timeout check 10s
maxconn 10000
while analyzing HAProxy logs, i have seen a pattern in TC occurances.
each tomcat server have TC for all HAproxy at some second.
so issues seems to be with tomcat config.
i am using default config of embedded tomcat (8.0.20)
in my infra,
there are 3 HAProxy servers(for load balancing)
3 embedded tomcat servers
Please suggest if someone knows whats going wrong in the system ?
Thanks,
Salman
Re: Query regarding HAProxy + Embedded Tomcat(8.0.20)
Posted by Christopher Schultz <ch...@christopherschultz.net>.
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
Mohammad,
On 1/24/16 12:11 PM, Mohammad Salman wrote:
> Hi Chris, i am using Embedded-tomcat via spring-boot. So most the
> configuration is automatically done by it.
>
> i have configured only maxThread value to 1000 thread per host.
You can't set the maximum number of threads for a host, only for a
connector (which must be attached to a service, not a host).
I don't see any 1s timeouts that you have configured in HAproxy.
That's why I was wondering what is being configured on the Tomcat side
(specifically, the keep-alive timeout).
If you have 10000 connections from HAProxy ( x 3 ) then each Tomcat
server should have 30000 connections available. The number of threads
is not important unless you are really using a significant number of
those 30000 connections simultaneously, or if you are using the BIO
connector (which requires one thread for each connection).
> I have managed to get some configuration via jConsole. PFA
> screenshot.
Non-text attachments are stripped from the list, so nothing came through
.
- -chris
> On Sat, Jan 23, 2016 at 2:07 AM, Christopher Schultz
> <chris@christopherschultz.net
> <ma...@christopherschultz.net>> wrote:
>
> Mohammad,
>
> On 1/21/16 2:02 PM, Mohammad Salman wrote:
>> Hi, I am seeing periodic latency spikes in HAProxy logs. Latency
>> spike correspond to high *TC* (Backend connect time ) times (all
>> ranging
> from
>> *1000-1010* ms). Suspecting some kind of timeout happening but
> doesnt know
>> which one.
>>
>> Following is the HAProxy configuration Current HAProxy config
>> timeouts:
>>
>> retries 3 timeout http-request 10s timeout
>> queue 1m timeout connect 10s timeout client
>> 1m timeout server 5m timeout http-keep-alive 100s
>> timeout check 10s maxconn 10000
>>
>> while analyzing HAProxy logs, i have seen a pattern in TC
>> occurances. each tomcat server have TC for all HAproxy at some
>> second. so issues seems to be with tomcat config.
>>
>>
>> i am using default config of embedded tomcat (8.0.20)
>>
>> in my infra, there are 3 HAProxy servers(for load balancing) 3
>> embedded tomcat servers
>>
>> Please suggest if someone knows whats going wrong in the system
>> ?
>
> What is your Tomcat <Connector> configuration?
>
> -chris
>
> ---------------------------------------------------------------------
>
>
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> <ma...@tomcat.apache.org> For additional
> commands, e-mail: users-help@tomcat.apache.org
> <ma...@tomcat.apache.org>
>
>
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iEYEARECAAYFAlamsPUACgkQ9CaO5/Lv0PB6CQCfVzLrw7m9jZ5u7Ohd5zMhzCmO
GZAAn1JER6i00uYdJeQ1AOaUQ5ci2fkM
=+1YU
-----END PGP SIGNATURE-----
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org
Re: Query regarding HAProxy + Embedded Tomcat(8.0.20)
Posted by Mohammad Salman <sa...@gmail.com>.
Hi Chris,
i am using Embedded-tomcat via spring-boot.
So most the configuration is automatically done by it.
i have configured only maxThread value to 1000 thread per host.
I have managed to get some configuration via jConsole. PFA screenshot.
On Sat, Jan 23, 2016 at 2:07 AM, Christopher Schultz <
chris@christopherschultz.net> wrote:
> Mohammad,
>
> On 1/21/16 2:02 PM, Mohammad Salman wrote:
> > Hi,
> > I am seeing periodic latency spikes in HAProxy logs. Latency spike
> > correspond to high *TC* (Backend connect time ) times (all ranging from
> > *1000-1010* ms). Suspecting some kind of timeout happening but doesnt
> know
> > which one.
> >
> > Following is the HAProxy configuration
> > Current HAProxy config timeouts:
> >
> > retries 3
> > timeout http-request 10s
> > timeout queue 1m
> > timeout connect 10s
> > timeout client 1m
> > timeout server 5m
> > timeout http-keep-alive 100s
> > timeout check 10s
> > maxconn 10000
> >
> > while analyzing HAProxy logs, i have seen a pattern in TC occurances.
> > each tomcat server have TC for all HAproxy at some second.
> > so issues seems to be with tomcat config.
> >
> >
> > i am using default config of embedded tomcat (8.0.20)
> >
> > in my infra,
> > there are 3 HAProxy servers(for load balancing)
> > 3 embedded tomcat servers
> >
> > Please suggest if someone knows whats going wrong in the system ?
>
> What is your Tomcat <Connector> configuration?
>
> -chris
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
> For additional commands, e-mail: users-help@tomcat.apache.org
>
>
Re: Query regarding HAProxy + Embedded Tomcat(8.0.20)
Posted by Christopher Schultz <ch...@christopherschultz.net>.
Mohammad,
On 1/21/16 2:02 PM, Mohammad Salman wrote:
> Hi,
> I am seeing periodic latency spikes in HAProxy logs. Latency spike
> correspond to high *TC* (Backend connect time ) times (all ranging from
> *1000-1010* ms). Suspecting some kind of timeout happening but doesnt know
> which one.
>
> Following is the HAProxy configuration
> Current HAProxy config timeouts:
>
> retries 3
> timeout http-request 10s
> timeout queue 1m
> timeout connect 10s
> timeout client 1m
> timeout server 5m
> timeout http-keep-alive 100s
> timeout check 10s
> maxconn 10000
>
> while analyzing HAProxy logs, i have seen a pattern in TC occurances.
> each tomcat server have TC for all HAproxy at some second.
> so issues seems to be with tomcat config.
>
>
> i am using default config of embedded tomcat (8.0.20)
>
> in my infra,
> there are 3 HAProxy servers(for load balancing)
> 3 embedded tomcat servers
>
> Please suggest if someone knows whats going wrong in the system ?
What is your Tomcat <Connector> configuration?
-chris
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@tomcat.apache.org
For additional commands, e-mail: users-help@tomcat.apache.org