[jira] [Created] (TS-2670) trafficserver process dies with SEGFAULT (failed assert `masksum == mh->m_presence_bits`)

["Timur Irmatov (JIRA)" <ji...@apache.org>]

Timur Irmatov created TS-2670:
---------------------------------

             Summary: trafficserver process dies with SEGFAULT (failed assert `masksum == mh->m_presence_bits`)
                 Key: TS-2670
                 URL: https://issues.apache.org/jira/browse/TS-2670
             Project: Traffic Server
          Issue Type: Bug
          Components: HTTP
            Reporter: Timur Irmatov


I have upgraded our installation of TrafficServer from 4.1.2 to 4.2.0. ATS is running as a forward proxy (to save internet bandwidth). As soon as traffic grows to our normal levels ATS crashes because of segmentation fault:

{noformat}
[ET_NET 0][11682]: segfault at 1c ip 00000000005c2d50 sp 00007fff35b5a168 error 4 in traffic_server[400000+35f000]
{noformat}

I have recompiled ATS with --enable-debug. Then ATS dies with failed assertion:

{noformat}
traffic_server[4003]: FATAL: MIME.cc:599: failed assert `masksum == mh->m_presence_bits`
{noformat}

Stack trace:

{noformat}
% sudo gdb /opt/ts/bin/traffic_server /opt/ts/core
GNU gdb (GDB) 7.6.1-ubuntu
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /opt/ts/bin/traffic_server...done.

warning: core file may not match specified executable file.
[New LWP 4003]
[New LWP 4004]
[New LWP 4021]
[New LWP 4022]
[New LWP 4023]
[New LWP 4024]
[New LWP 4025]
[New LWP 4026]

warning: Can't read pathname for load map: Input/output error.
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/opt/ts/bin/traffic_server -M --httpport 3129:fd=7:tr-full'.
Program terminated with signal 6, Aborted.
#0  0x00002b222a363f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
56      ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory.
(gdb) bt
#0  0x00002b222a363f77 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1  0x00002b222a3675e8 in __GI_abort () at abort.c:90
#2  0x00002b222830d25e in ink_die_die_die (retval=1) at ink_error.cc:43
#3  0x00002b222830d349 in ink_fatal_va(int, const char *, typedef __va_list_tag __va_list_tag *) (return_code=1, message_format=0x2b222831b6c8 "%s:%d: failed assert `%s`", ap=0x7fff793cc408)
    at ink_error.cc:65
#4  0x00002b222830d3f4 in ink_fatal (return_code=1, message_format=0x2b222831b6c8 "%s:%d: failed assert `%s`") at ink_error.cc:73
#5  0x00002b222830bf37 in _ink_assert (expression=0x7409e8 "masksum == mh->m_presence_bits", file=0x74075f "MIME.cc", line=599) at ink_assert.cc:37
#6  0x00000000006127cd in mime_hdr_sanity_check (mh=0x2b2233aeb588) at MIME.cc:599
#7  0x00000000006140fa in mime_hdr_copy_onto (s_mh=0x2b2233aeb588, s_heap=0x2b2233aeb4d0, d_mh=0x2b2233a138c8, d_heap=0x2b2233a13810, inherit_strs=false) at MIME.cc:1102
#8  0x0000000000606a0e in http_hdr_copy_onto (s_hh=0x2b2233aeb558, s_heap=0x2b2233aeb4d0, d_hh=0x2b2233a13898, d_heap=0x2b2233a13810, inherit_strs=true) at HTTP.cc:357
#9  0x0000000000606a7f in http_hdr_clone (s_hh=0x2b2233aeb558, s_heap=0x2b2233aeb4d0, d_heap=0x2b2233a13810) at HTTP.cc:375
#10 0x00000000005086ce in HTTPHdr::copy (this=0x2765bb0, hdr=0x2b2233aeaea8) at ./hdrs/HTTP.h:866
#11 0x0000000000508dba in HTTPInfo::response_set (this=0x2b22339f3868, resp=0x2b2233aeaea8) at ./hdrs/HTTP.h:1403
#12 0x000000000059ccf4 in HttpTransact::merge_and_update_headers_for_cache_update (s=0x2b22339f3800) at HttpTransact.cc:4657
#13 0x000000000059bde6 in HttpTransact::handle_cache_operation_on_forward_server_response (s=0x2b22339f3800) at HttpTransact.cc:4463
#14 0x0000000000599cf6 in HttpTransact::handle_forward_server_connection_open (s=0x2b22339f3800) at HttpTransact.cc:3966
#15 0x0000000000598440 in HttpTransact::handle_response_from_server (s=0x2b22339f3800) at HttpTransact.cc:3643
#16 0x0000000000596e28 in HttpTransact::HandleResponse (s=0x2b22339f3800) at HttpTransact.cc:3334
#17 0x000000000057d4f1 in HttpSM::call_transact_and_set_next_state (this=0x2b22339f3790, f=0x0) at HttpSM.cc:6779
#18 0x000000000056a7f3 in HttpSM::handle_api_return (this=0x2b22339f3790) at HttpSM.cc:1555
#19 0x000000000056a59a in HttpSM::state_api_callout (this=0x2b22339f3790, event=0, data=0x0) at HttpSM.cc:1487
#20 0x0000000000576999 in HttpSM::do_api_callout_internal (this=0x2b22339f3790) at HttpSM.cc:4770
#21 0x00000000005833e6 in HttpSM::do_api_callout (this=0x2b22339f3790) at HttpSM.cc:500
#22 0x000000000056b957 in HttpSM::state_read_server_response_header (this=0x2b22339f3790, event=100, data=0x2b223400c790) at HttpSM.cc:1902
#23 0x000000000056dee5 in HttpSM::main_handler (this=0x2b22339f3790, event=100, data=0x2b223400c790) at HttpSM.cc:2532
#24 0x00000000004eb160 in Continuation::handleEvent (this=0x2b22339f3790, event=100, data=0x2b223400c790) at ../iocore/eventsystem/I_Continuation.h:146
#25 0x00000000006d062a in read_signal_and_update (event=100, vc=0x2b223400c680) at UnixNetVConnection.cc:138
#26 0x00000000006d107c in read_from_net (nh=0x2b222b33ac10, vc=0x2b223400c680, thread=0x2b222b337010) at UnixNetVConnection.cc:320
#27 0x00000000006d2e01 in UnixNetVConnection::net_read_io (this=0x2b223400c680, nh=0x2b222b33ac10, lthread=0x2b222b337010) at UnixNetVConnection.cc:835
#28 0x00000000006ca7c6 in NetHandler::mainNetEvent (this=0x2b222b33ac10, event=5, e=0x23bde80) at UnixNet.cc:384
#29 0x00000000004eb160 in Continuation::handleEvent (this=0x2b222b33ac10, event=5, data=0x23bde80) at ../iocore/eventsystem/I_Continuation.h:146
#30 0x00000000006f3559 in EThread::process_event (this=0x2b222b337010, e=0x23bde80, calling_code=5) at UnixEThread.cc:145
#31 0x00000000006f3b12 in EThread::execute (this=0x2b222b337010) at UnixEThread.cc:269
#32 0x0000000000513ccf in main (argv=0x7fff793d3018) at Main.cc:1659
{noformat}

Operating system is Ubuntu 13.10, 64 bit. ATS version is 4.2.0. Compile options: --prefix=/opt/ts --with-user=ts --disable-hwloc --enable-linux-native-aio --enable-debug



--
This message was sent by Atlassian JIRA
(v6.2#6252)