traffic server 2.0.1 process crash?

[Sascha Klose <Sa...@cewecolor.de>]

Hi,

we use traffic server 2.0.1 in reverse proxy mode only. One or two at
day the traffic server process crash with the following error in
"traffic.log":

===Cut===
FATAL: MIME.cc:1250: failed assert `j < block_count`
/PRODUCTION/trafficserver/bin/traffic_server - STACK TRACE:
/PRODUCTION/trafficserver/bin/traffic_server(ink_fatal+0x86)[0x6ed006]
/PRODUCTION/trafficserver/bin/traffic_server(_ink_assert+0xab)[0x6eb98b]
/PRODUCTION/trafficserver/bin/traffic_server(_Z32mime_hdr_field_block_list_adjustiP18MIMEFieldBlockImplS0_+0x18f)[0x5fdfaf]
/PRODUCTION/trafficserver/bin/traffic_server(_Z18http_hdr_copy_ontoP11HTTPHdrImplP7HdrHeapS0_S2_b+0x8a)[0x5f795a]
/PRODUCTION/trafficserver/bin/traffic_server(_Z14http_hdr_cloneP11HTTPHdrImplP7HdrHeapS2_+0x90)[0x5f87d0]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN12HttpTransact41merge_and_update_headers_for_cache_updateEPNS_5StateE+0x184)[0x56c704]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN12HttpTransact49handle_cache_operation_on_forward_server_responseEPNS_5StateE+0xad9)[0x56d4c9]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN12HttpTransact37handle_forward_server_connection_openEPNS_5StateE+0x339)[0x56e889]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN12HttpTransact27handle_response_from_serverEPNS_5StateE+0x290)[0x578430]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN12HttpTransact14HandleResponseEPNS_5StateE+0x2bd)[0x57893d]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN6HttpSM32call_transact_and_set_next_stateEPFvPN12HttpTransact5StateEE+0xc5)[0x534455]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN6HttpSM33state_read_server_response_headerEiPv+0x410)[0x549a70]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN6HttpSM12main_handlerEiPv+0x15b)[0x547e0b]
/PRODUCTION/trafficserver/bin/traffic_server[0x6c14b7]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN10NetHandler12mainNetEventEiP5Event+0x5b2)[0x6b8f12]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN7EThread13process_eventEP5Eventi+0xb4)[0x6e30d4]
/PRODUCTION/trafficserver/bin/traffic_server(_ZN7EThread7executeEv+0x440)[0x6e3910]
/PRODUCTION/trafficserver/bin/traffic_server[0x6e1532]
/lib/libpthread.so.0[0x2b2b1fdd3fc7]
/lib/libc.so.6(clone+0x6d)[0x2b2b2154464d]
[Sep 29 18:21:49.446] Manager {140576554424048} ERROR:
[LocalManager::pollMgmtProcessServer] Server Process terminated due to
Sig 6: Aborted
[Sep 29 18:21:49.446] Manager {140576554424048} ERROR:  (last system
error 2: No such file or directory)
[Sep 29 18:21:49.446] Manager {140576554424048} ERROR:
[Alarms::signalAlarm] Server Process was reset
[Sep 29 18:21:49.446] Manager {140576554424048} ERROR:  (last system
error 2: No such file or directory)
[TrafficServer] using root directory '/PRODUCTION/trafficserver'
[Sep 29 18:21:51.468] {47547064931200} STATUS: opened
var/log/trafficserver/diags.log
NOTE: Traffic Server received Sig 11: Segmentation fault
/PRODUCTION/trafficserver/bin/traffic_server - STACK TRACE:
[Sep 29 21:04:27.565] Manager {140576554424048} FATAL:
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Sep 29 21:04:27.565] Manager {140576554424048} FATAL:  (last system
error 104: Connection reset by peer)
[Sep 29 21:04:27.565] Manager {140576554424048} ERROR:
[LocalManager::sendMgmtMsgToProcesses] Error writing message
[Sep 29 21:04:27.565] Manager {140576554424048} ERROR:  (last system
error 32: Broken pipe)
[E. Mgmt] log ==> [TrafficManager] using root directory
'/PRODUCTION/trafficserver'
[Sep 29 21:04:27.579] {139800135517936} STATUS: opened
var/log/trafficserver/manager.log
[TrafficServer] using root directory '/PRODUCTION/trafficserver'
[Sep 29 21:04:29.934] {47684330038144} STATUS: opened
var/log/trafficserver/diags.log
===Cut===

/var/log/syslog:
===Cut===
Sep 29 18:21:48 dlscache2001 traffic_server[3688]: FATAL: MIME.cc:1250:
failed assert `j < block_count`
Sep 29 18:21:49 dlscache2001 traffic_manager[3659]: {140576554424048}
ERROR: [LocalManager::pollMgmtProcessServer] Server Process terminated
due to Sig 6: Aborted
Sep 29 18:21:49 dlscache2001 traffic_manager[3659]: {140576554424048}
ERROR:  (last system error 2: No such file or directory)
Sep 29 18:21:49 dlscache2001 traffic_manager[3659]: {140576554424048}
ERROR: [Alarms::signalAlarm] Server Process was reset
Sep 29 18:21:49 dlscache2001 traffic_manager[3659]: {140576554424048}
ERROR:  (last system error 2: No such file or directory)
Sep 29 18:21:50 dlscache2001 traffic_manager[3659]: {140576554424048}
NOTE: [LocalManager::startProxy] Launching ts process
Sep 29 18:21:50 dlscache2001 traffic_manager[3659]: {140576554424048}
NOTE: [LocalManager::pollMgmtProcessServer] New process connecting fd
'9'
Sep 29 18:21:50 dlscache2001 traffic_manager[3659]: {140576554424048}
NOTE: [Alarms::signalAlarm] Server Process born
Sep 29 18:21:51 dlscache2001 traffic_server[4156]: NOTE: --- Server
Starting ---
Sep 29 18:21:51 dlscache2001 traffic_server[4156]: NOTE: Server
Version: Apache Traffic Server - traffic_server - 2.0.1 - (build # 82215
on Sep 22 2010 at 15:04:22)
Sep 29 18:21:51 dlscache2001 traffic_server[4156]: {47547064931200}
STATUS: opened var/log/trafficserver/diags.log
Sep 29 18:21:51 dlscache2001 traffic_server[4156]: {47547064931200}
NOTE: updated diags config
Sep 29 18:21:51 dlscache2001 traffic_server[4156]: {47547064931200}
NOTE: cache clustering disabled
Sep 29 18:21:51 dlscache2001 traffic_server[4156]: {47547064931200}
NOTE: cache clustering disabled
Sep 29 18:21:51 dlscache2001 traffic_server[4156]: {47547064931200}
NOTE: logging initialized[7], logging_mode = 3
Sep 29 18:21:51 dlscache2001 traffic_server[4156]: {47547064931200}
NOTE: traffic server running
Sep 29 18:22:10 dlscache2001 traffic_server[4156]: {1092176208} NOTE:
cache enabled
===Cut==

some parameter from records.config:

CONFIG proxy.config.cache.ram_cache.size LLONG 40000000000
CONFIG proxy.config.cache.ram_cache_cutoff LLONG 1000000000

on linux:
/etc/sysctl.conf:
vm.max_map_count = 4000000



Any ideas?

Sascha


_______________________________________________________________________________________
Ihre Digitalfotos als echtes Buch – jetzt neue Bestellsoftware sichern:

Mein CEWE FOTOBUCH – erstellt in 3 Minuten!
Riesenauswahl an Formaten und Einbänden

In drei Schritten sind Sie am Ziel:
- Software kostenlos unter http://www.cewe-fotobuch.de downloaden
- Ihr CEWE FOTOBUCH schnell und komfortabel am PC gestalten
- Auftrag im Geschäft Ihrer Wahl abgeben – oder online bestellen

Das CEWE FOTOBUCH: Für jeden Anlass das Richtige! Neu. Schon ab 7,95 €*

*unverbindliche Preisempfehlung für ein CEWE FOTOBUCH klein/14x13cm
inkl. MwSt zzgl. Bearbeitungspauschale und etwaig anfallender
Versandkosten, gemäß Preisliste.




___________________________________________________________________

OHG mit Sitz in Oldenburg; Registergericht Oldenburg HR A 1548;

persönlich haftende geschäftsführende Gesellschafterin: Neumüller CeWe
Color Stiftung, Oldenburg
Vorstand: Dr. Rolf Hollander, Vorsitzender;
Harald H. Pirwitz, Felix Thalmann, Frank Zweigle, Dr. Michael Fries;
Geschäftsführer: Dr. Reiner Fageth, Thomas Grunau,
Andreas F.L. Heydemann, Dr. Olaf Holzkämper


Persönlich haftende Gesellschafterin: CeWe Color Holding AG, Oldenburg,
Registergericht Oldenburg HR B 2956
Vorstand: Dr. Rolf Hollander, Vorsitzender;
Andreas F.L. Heydemann, Dr. Reiner Fageth, Dr. Olaf Holzkämper
Aufsichtsrat: Hubert Rothärmel, Vorsitzender

Re: traffic server 2.0.1 process crash?

[Leif Hedstrom <zw...@apache.org>]

  On 09/30/2010 06:43 AM, Sascha Klose wrote:
> Hi,
>
> we use traffic server 2.0.1 in reverse proxy mode only. One or two at
> day the traffic server process crash with the following error in
> "traffic.log":

Any chance that you could try v2.1.3 ? It's miles ahead of the 2.0 branch.

-- leif