You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@trafficserver.apache.org by Danny Shporer <Da...@Radware.com> on 2011/10/12 15:48:09 UTC

ATS crashes under heavy load

Hi

 

I have been experiencing ATS crashes under heavy load testing - around
25,000 HTTP transactions per second.

The environment is a 4 core desktop running Centos 5.6, kernel 2.6.39.2
compiled with TPROXY support. ATS runs as a transparent proxy.

ATS was compiled with the following options:  ./configure
--enable-tproxy --enable-libev

ATS version of this info is 3.0.0 (I have tested it on 3.0.1 as well and
the same happens).

 

Attached is the records.config of ATS

 

 

Following is the gdb info:

 

Program received signal SIGSEGV, Segmentation fault.

[Switching to Thread 0x42174940 (LWP 6663)]

0x000000000068fd4b in modify (this=0x2aaaab12c628, event=<value
optimized out>, e=<value optimized out>) at P_UnixNet.h:536

536         fd_change(event_loop->eio, eio.fd, 0);

(gdb) bt

#0  0x000000000068fd4b in modify (this=0x2aaaab12c628, event=<value
optimized out>, e=<value optimized out>) at P_UnixNet.h:536

#1  NetHandler::mainNetEvent (this=0x2aaaab12c628, event=<value
optimized out>, e=<value optimized out>) at UnixNet.cc:432

#2  0x00000000006bfc4f in EThread::process_event (this=0x2aaaab12b010,
e=0xf44570, calling_code=5) at I_Continuation.h:146

#3  0x00000000006c055c in EThread::execute (this=0x2aaaab12b010) at
UnixEThread.cc:262

#4  0x00000000006bef8e in spawn_thread_internal (a=0xf35c90) at
Thread.cc:88

#5  0x0000003e9dc0673d in start_thread () from /lib64/libpthread.so.0

#6  0x0000003e9d0d44bd in clone () from /lib64/libc.so.6

(gdb) info f

Stack level 0, frame at 0x42174030:

rip = 0x68fd4b in modify (P_UnixNet.h:536); saved rip 0x6bfc4f

inlined into frame 1

source language c++.

Arglist at unknown address.

Locals at unknown address, Previous frame's sp in rsp

 

 

Thanks

Danny

 

 


RE: ATS crashes under heavy load

Posted by Danny Shporer <Da...@Radware.com>.
Hi Igor

Just did about an hour ago - TS-981

Thanks
Danny

-----Original Message-----
From: Igor Galić [mailto:i.galic@brainsware.org] 
Sent: Thursday, October 13, 2011 9:42 AM
To: users@trafficserver.apache.org
Subject: Re: ATS crashes under heavy load



----- Original Message -----
> 
> 
> 
> Hi

Hi Danny,

> I have been experiencing ATS crashes under heavy load testing –
> around 25,000 HTTP transactions per second.
> 
> The environment is a 4 core desktop running Centos 5.6, kernel
> 2.6.39.2 compiled with TPROXY support. ATS runs as a transparent
> proxy.
> 
> ATS was compiled with the following options: ./configure
> --enable-tproxy --enable-libev
> 
> ATS version of this info is 3.0.0 (I have tested it on 3.0.1 as well
> and the same happens).

Thanks for making us aware of this.
Did you open a Bug for this Jira?

  https://issues.apache.org/jira/browse/TS


If not, can you please do this, we like to track *everything* in Jira.

> Attached is the records.config of ATS
> 
> 
> 
> 
> 
> Following is the gdb info:
> 
> 
> 
> Program received signal SIGSEGV, Segmentation fault.
> 
> [Switching to Thread 0x42174940 (LWP 6663)]
> 
> 0x000000000068fd4b in modify (this=0x2aaaab12c628, event=<value
> optimized out>, e=<value optimized out>) at P_UnixNet.h:536
> 
> 536 fd_change(event_loop->eio, eio.fd, 0);
> 
> (gdb) bt
> 
> #0 0x000000000068fd4b in modify (this=0x2aaaab12c628, event=<value
> optimized out>, e=<value optimized out>) at P_UnixNet.h:536
> 
> #1 NetHandler::mainNetEvent (this=0x2aaaab12c628, event=<value
> optimized out>, e=<value optimized out>) at UnixNet.cc:432
> 
> #2 0x00000000006bfc4f in EThread::process_event (this=0x2aaaab12b010,
> e=0xf44570, calling_code=5) at I_Continuation.h:146
> 
> #3 0x00000000006c055c in EThread::execute (this=0x2aaaab12b010) at
> UnixEThread.cc:262
> 
> #4 0x00000000006bef8e in spawn_thread_internal (a=0xf35c90) at
> Thread.cc:88
> 
> #5 0x0000003e9dc0673d in start_thread () from /lib64/libpthread.so.0
> 
> #6 0x0000003e9d0d44bd in clone () from /lib64/libc.so.6
> 
> (gdb) info f
> 
> Stack level 0, frame at 0x42174030:
> 
> rip = 0x68fd4b in modify (P_UnixNet.h:536); saved rip 0x6bfc4f
> 
> inlined into frame 1
> 
> source language c++.
> 
> Arglist at unknown address.
> 
> Locals at unknown address, Previous frame's sp in rsp
> 
> 
> 
> 
> 
> Thanks
> 
> Danny

So long,
i

-- 
Igor Galić

Tel: +43 (0) 664 886 22 883
Mail: i.galic@brainsware.org
URL: http://brainsware.org/
GPG: 571B 8B8A FC97 266D BDA3  EF6F 43AD 80A4 5779 3257

Re: ATS crashes under heavy load

Posted by Igor Galić <i....@brainsware.org>.

----- Original Message -----
> 
> 
> 
> Hi

Hi Danny,

> I have been experiencing ATS crashes under heavy load testing –
> around 25,000 HTTP transactions per second.
> 
> The environment is a 4 core desktop running Centos 5.6, kernel
> 2.6.39.2 compiled with TPROXY support. ATS runs as a transparent
> proxy.
> 
> ATS was compiled with the following options: ./configure
> --enable-tproxy --enable-libev
> 
> ATS version of this info is 3.0.0 (I have tested it on 3.0.1 as well
> and the same happens).

Thanks for making us aware of this.
Did you open a Bug for this Jira?

  https://issues.apache.org/jira/browse/TS


If not, can you please do this, we like to track *everything* in Jira.

> Attached is the records.config of ATS
> 
> 
> 
> 
> 
> Following is the gdb info:
> 
> 
> 
> Program received signal SIGSEGV, Segmentation fault.
> 
> [Switching to Thread 0x42174940 (LWP 6663)]
> 
> 0x000000000068fd4b in modify (this=0x2aaaab12c628, event=<value
> optimized out>, e=<value optimized out>) at P_UnixNet.h:536
> 
> 536 fd_change(event_loop->eio, eio.fd, 0);
> 
> (gdb) bt
> 
> #0 0x000000000068fd4b in modify (this=0x2aaaab12c628, event=<value
> optimized out>, e=<value optimized out>) at P_UnixNet.h:536
> 
> #1 NetHandler::mainNetEvent (this=0x2aaaab12c628, event=<value
> optimized out>, e=<value optimized out>) at UnixNet.cc:432
> 
> #2 0x00000000006bfc4f in EThread::process_event (this=0x2aaaab12b010,
> e=0xf44570, calling_code=5) at I_Continuation.h:146
> 
> #3 0x00000000006c055c in EThread::execute (this=0x2aaaab12b010) at
> UnixEThread.cc:262
> 
> #4 0x00000000006bef8e in spawn_thread_internal (a=0xf35c90) at
> Thread.cc:88
> 
> #5 0x0000003e9dc0673d in start_thread () from /lib64/libpthread.so.0
> 
> #6 0x0000003e9d0d44bd in clone () from /lib64/libc.so.6
> 
> (gdb) info f
> 
> Stack level 0, frame at 0x42174030:
> 
> rip = 0x68fd4b in modify (P_UnixNet.h:536); saved rip 0x6bfc4f
> 
> inlined into frame 1
> 
> source language c++.
> 
> Arglist at unknown address.
> 
> Locals at unknown address, Previous frame's sp in rsp
> 
> 
> 
> 
> 
> Thanks
> 
> Danny

So long,
i

-- 
Igor Galić

Tel: +43 (0) 664 886 22 883
Mail: i.galic@brainsware.org
URL: http://brainsware.org/
GPG: 571B 8B8A FC97 266D BDA3  EF6F 43AD 80A4 5779 3257