You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@trafficserver.apache.org by 骷髅猫 <sb...@vip.qq.com> on 2012/09/26 08:17:56 UTC

回复: cluster mode crash on 3.2.0?

It still crashed no matter change proxy.config.http.share_server_sessions=1 or 0 . But not very often 


cat traffic.out |c++filt 
NOTE: Traffic Server received Sig 11: Segmentation fault
/usr/local/ATS/bin/traffic_server - STACK TRACE: 
/lib64/libpthread.so.0(+0xf4c0)[0x2b27344ab4c0]
/usr/local/ATS/bin/traffic_server(HttpTunnel::consumer_handler(int, HttpTunnelConsumer*)+0x188)[0x56ea68]
/usr/local/ATS/bin/traffic_server(HttpTunnel::main_handler(int, void*)+0x11d)[0x56f1cd]
/usr/local/ATS/bin/traffic_server[0x6758ab]
/usr/local/ATS/bin/traffic_server(write_to_net_io(NetHandler*, UnixNetVConnection*, EThread*)+0x353)[0x677f83]
/usr/local/ATS/bin/traffic_server(NetHandler::mainNetEvent(int, Event*)+0x286)[0x670ef6]
/usr/local/ATS/bin/traffic_server(EThread::process_event(Event*, int)+0xb4)[0x699b44]
/usr/local/ATS/bin/traffic_server(EThread::execute()+0x4c3)[0x69a4d3]
/usr/local/ATS/bin/traffic_server[0x698b12]
/lib64/libpthread.so.0(+0x77e1)[0x2b27344a37e1]
/lib64/libc.so.6(clone+0x6d)[0x2b273694552d]
[Sep 26 14:02:42.162] Manager {0x7fc9f2d327e0} ERROR: [LocalManager::pollMgmtProcessServer] Server Process terminated due to Sig 11: Segmentation fault
[Sep 26 14:02:42.163] Manager {0x7fc9f2d327e0} ERROR:  (last system error 2: No such file or directory)
[Sep 26 14:02:42.163] Manager {0x7fc9f2d327e0} ERROR: [Alarms::signalAlarm] Server Process was reset
[Sep 26 14:02:42.163] Manager {0x7fc9f2d327e0} ERROR:  (last system error 2: No such file or directory)
[Sep 26 14:02:43.170] Manager {0x7fc9f2d327e0} NOTE: [LocalManager::startProxy] Launching ts process
[TrafficServer] using root directory '/usr/local/ATS/'




------------------ 原始邮件 ------------------
发件人: "ming.zym@gmail.com"<mi...@gmail.com>;
发送时间: 2012年9月25日(星期二) 晚上9:49
收件人: "users"<us...@trafficserver.apache.org>; 

主题: Re: cluster mode crash on 3.2.0?



please change the following option:
CONFIG proxy.config.http.share_server_sessions INT 1

the default '2', which is thread pool, is not safe in some case in this
version.

and feed back please 

在 2012-09-25二的 18:16 +0800,骷髅猫写道:
> Hi All
> 
> 
> When I enable cluster mode 3 on my centOS6 , I found 2 servers crash
> always.
> and I got following info
> 
> 
> 
> 
> NOTE: Traffic Server received Sig 11: Segmentation fault
> /usr/local/ATS/bin/traffic_server - STACK TRACE: 
> /lib64/libpthread.so.0(+0xf4c0)[0x2b4472c444c0]
> /usr/local/ATS/bin/traffic_server(HttpSessionManager::release_session(HttpServerSession*)+0x67)[0x51c297]
> /usr/local/ATS/bin/traffic_server(HttpServerSession::release()+0x3d)[0x518ffd]
> /usr/local/ATS/bin/traffic_server(HttpSM::tunnel_handler_server(int,
> HttpTunnelProducer*)+0x1e7)[0x525f37]
> /usr/local/ATS/bin/traffic_server(HttpTunnel::producer_handler(int,
> HttpTunnelProducer*)+0x1a6)[0x56e426]
> /usr/local/ATS/bin/traffic_server(HttpTunnel::consumer_handler(int,
> HttpTunnelConsumer*)+0x666)[0x56ef46]
> /usr/local/ATS/bin/traffic_server(HttpTunnel::main_handler(int,
> void*)+0x11d)[0x56f1cd]
> /usr/local/ATS/bin/traffic_server(ClusterHandler::cluster_signal_and_update(int, ClusterVConnection*, ClusterVConnState*)+0x33)[0x60f6d3]
> /usr/local/ATS/bin/traffic_server(ClusterHandler::valid_for_data_write(ClusterVConnection*)+0x636)[0x60cd56]
> /usr/local/ATS/bin/traffic_server(ClusterHandler::build_write_descriptors()+0xbd)[0x60d0ad]
> /usr/local/ATS/bin/traffic_server[0x60e1a0]
> /usr/local/ATS/bin/traffic_server(ClusterHandler::mainClusterEvent(int, Event*)+0x1e4)[0x60e554]
> /usr/local/ATS/bin/traffic_server(EThread::process_event(Event*,
> int)+0xb4)[0x699b44]
> /usr/local/ATS/bin/traffic_server(EThread::execute()+0x4c3)[0x69a4d3]
> /usr/local/ATS/bin/traffic_server[0x698b12]
> /lib64/libpthread.so.0(+0x77e1)[0x2b4472c3c7e1]
> /lib64/libc.so.6(clone+0x6d)[0x2b44750de52d]
> 
> 
> Is there any wrong config value can cause this problem ?
> 
> 
> Thanks
> Bin
> 
> 
> 
>

Re: 回复: cluster mode crash on 3.2.0?

Posted by "ming.zym@gmail.com" <mi...@gmail.com>.
I am not sure what is your use case, but as far as we know, in some
situation TS is unsafe, for example: the transform usage & Range etc.

we are using the following codes in the production, which don't crash
that much. we do not use any plugin.

https://gitorious.org/trafficserver/taobao/commits/3.2

please try it if you just want a working cluster :D

we will make more codes into git/master if we are ready, some of the
performance patches is not in the official tree right now.


FYI

在 2012-09-26三的 14:17 +0800,骷髅猫写道:
> It still crashed no matter
> change proxy.config.http.share_server_sessions=1 or 0 . But not very
> often 
> 
> 
> cat traffic.out |c++filt 
> NOTE: Traffic Server received Sig 11: Segmentation fault
> /usr/local/ATS/bin/traffic_server - STACK TRACE: 
> /lib64/libpthread.so.0(+0xf4c0)[0x2b27344ab4c0]
> /usr/local/ATS/bin/traffic_server(HttpTunnel::consumer_handler(int,
> HttpTunnelConsumer*)+0x188)[0x56ea68]
> /usr/local/ATS/bin/traffic_server(HttpTunnel::main_handler(int,
> void*)+0x11d)[0x56f1cd]
> /usr/local/ATS/bin/traffic_server[0x6758ab]
> /usr/local/ATS/bin/traffic_server(write_to_net_io(NetHandler*,
> UnixNetVConnection*, EThread*)+0x353)[0x677f83]
> /usr/local/ATS/bin/traffic_server(NetHandler::mainNetEvent(int,
> Event*)+0x286)[0x670ef6]
> /usr/local/ATS/bin/traffic_server(EThread::process_event(Event*,
> int)+0xb4)[0x699b44]
> /usr/local/ATS/bin/traffic_server(EThread::execute()+0x4c3)[0x69a4d3]
> /usr/local/ATS/bin/traffic_server[0x698b12]
> /lib64/libpthread.so.0(+0x77e1)[0x2b27344a37e1]
> /lib64/libc.so.6(clone+0x6d)[0x2b273694552d]
> [Sep 26 14:02:42.162] Manager {0x7fc9f2d327e0} ERROR:
> [LocalManager::pollMgmtProcessServer] Server Process terminated due to
> Sig 11: Segmentation fault
> [Sep 26 14:02:42.163] Manager {0x7fc9f2d327e0} ERROR:  (last system
> error 2: No such file or directory)
> [Sep 26 14:02:42.163] Manager {0x7fc9f2d327e0} ERROR:
> [Alarms::signalAlarm] Server Process was reset
> [Sep 26 14:02:42.163] Manager {0x7fc9f2d327e0} ERROR:  (last system
> error 2: No such file or directory)
> [Sep 26 14:02:43.170] Manager {0x7fc9f2d327e0} NOTE:
> [LocalManager::startProxy] Launching ts process
> [TrafficServer] using root directory '/usr/local/ATS/'
> 
> 
> 
> 
> ------------------ 原始邮件 ------------------
> 发件人: "ming.zym@gmail.com"<mi...@gmail.com>;
> 发送时间: 2012年9月25日(星期二) 晚上9:49
> 收件人: "users"<us...@trafficserver.apache.org>; 
> 
> 主题: Re: cluster mode crash on 3.2.0?
> 
> 
> please change the following option:
> CONFIG proxy.config.http.share_server_sessions INT 1
> 
> the default '2', which is thread pool, is not safe in some case in
> this
> version.
> 
> and feed back please 
> 
> 在 2012-09-25二的 18:16 +0800,骷髅猫写道:
> > Hi All
> > 
> > 
> > When I enable cluster mode 3 on my centOS6 , I found 2 servers crash
> > always.
> > and I got following info
> > 
> > 
> > 
> > 
> > NOTE: Traffic Server received Sig 11: Segmentation fault
> > /usr/local/ATS/bin/traffic_server - STACK TRACE: 
> > /lib64/libpthread.so.0(+0xf4c0)[0x2b4472c444c0]
> > /usr/local/ATS/bin/traffic_server(HttpSessionManager::release_session(HttpServerSession*)+0x67)[0x51c297]
> > /usr/local/ATS/bin/traffic_server(HttpServerSession::release()+0x3d)[0x518ffd]
> > /usr/local/ATS/bin/traffic_server(HttpSM::tunnel_handler_server(int,
> > HttpTunnelProducer*)+0x1e7)[0x525f37]
> > /usr/local/ATS/bin/traffic_server(HttpTunnel::producer_handler(int,
> > HttpTunnelProducer*)+0x1a6)[0x56e426]
> > /usr/local/ATS/bin/traffic_server(HttpTunnel::consumer_handler(int,
> > HttpTunnelConsumer*)+0x666)[0x56ef46]
> > /usr/local/ATS/bin/traffic_server(HttpTunnel::main_handler(int,
> > void*)+0x11d)[0x56f1cd]
> > /usr/local/ATS/bin/traffic_server(ClusterHandler::cluster_signal_and_update(int, ClusterVConnection*, ClusterVConnState*)+0x33)[0x60f6d3]
> > /usr/local/ATS/bin/traffic_server(ClusterHandler::valid_for_data_write(ClusterVConnection*)+0x636)[0x60cd56]
> > /usr/local/ATS/bin/traffic_server(ClusterHandler::build_write_descriptors()+0xbd)[0x60d0ad]
> > /usr/local/ATS/bin/traffic_server[0x60e1a0]
> > /usr/local/ATS/bin/traffic_server(ClusterHandler::mainClusterEvent(int, Event*)+0x1e4)[0x60e554]
> > /usr/local/ATS/bin/traffic_server(EThread::process_event(Event*,
> > int)+0xb4)[0x699b44]
> > /usr/local/ATS/bin/traffic_server(EThread::execute()+0x4c3)[0x69a4d3]
> > /usr/local/ATS/bin/traffic_server[0x698b12]
> > /lib64/libpthread.so.0(+0x77e1)[0x2b4472c3c7e1]
> > /lib64/libc.so.6(clone+0x6d)[0x2b44750de52d]
> > 
> > 
> > Is there any wrong config value can cause this problem ?
> > 
> > 
> > Thanks
> > Bin
> > 
> > 
> > 
> > 
> 
> 
>