[jira] [Commented] (TS-2680) Occasional crash in HdrHeap

["Daniel Marino (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TS-2680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975035#comment-13975035 ] 

Daniel Marino commented on TS-2680:
-----------------------------------

I can reproduce this while using web polygraph to generate heavy load. I'm using Traffic Server 4.0.2.

Here's a backtrace and some state from gdb.  The block (b) passed into attach_block is null.  No time now to debug further...perhaps someone more familiar with the code can spot the problem!  Thanks.

(gdb) bt
#0  attach_block (this=0x7ffea2fcb028, parser=0x7ffea2fccbb8, r=0x7fff742b9168, bytes_used=0x7ffff3ce7bcc, eof=true)
    at HdrTSOnly.cc:177
#1  HTTPHdr::parse_resp (this=0x7ffea2fcb028, parser=0x7ffea2fccbb8, r=0x7fff742b9168, bytes_used=0x7ffff3ce7bcc, eof=true)
    at HdrTSOnly.cc:113
#2  0x000000000052f845 in HttpSM::state_read_server_response_header (this=0x7ffea2fca870, event=104, data=0x7fffbc51d310)
    at HttpSM.cc:1768
#3  0x0000000000532248 in HttpSM::main_handler (this=0x7ffea2fca870, event=104, data=0x7fffbc51d310) at HttpSM.cc:2501
#4  0x00000000004d054a in PluginVC::process_read_side (this=0x7fffbc51d220, other_side_call=false) at PluginVC.cc:635
#5  0x00000000004d2562 in PluginVC::main_handler (this=0x7fffbc51d220, event=<value optimized out>, data=0x7fffc424ecd0)
    at PluginVC.cc:206
#6  0x00000000006a313f in handleEvent (this=0x7ffff5905010, e=0x7fffc424ecd0, calling_code=1) at I_Continuation.h:146
#7  EThread::process_event (this=0x7ffff5905010, e=0x7fffc424ecd0, calling_code=1) at UnixEThread.cc:141
#8  0x00000000006a3cbb in EThread::execute (this=0x7ffff5905010) at UnixEThread.cc:192
#9  0x00000000006a1fda in spawn_thread_internal (a=0xfdafc0) at Thread.cc:88
#10 0x000000338d4079d1 in start_thread () from /lib64/libpthread.so.0
#11 0x000000338d0e8b6d in clone () from /lib64/libc.so.6

(gdb) f 0
#0  attach_block (this=0x7ffea2fcb028, parser=0x7ffea2fccbb8, r=0x7fff742b9168, bytes_used=0x7ffff3ce7bcc, eof=true)
    at HdrTSOnly.cc:177
177           m_ronly_heap[i].m_heap_len = (int) (b->end() - b->start());
(gdb) p m_ronly_heap
value has been optimized out
(gdb) p b
$1 = (IOBufferBlock *) 0x0
(gdb) f 1
#1  HTTPHdr::parse_resp (this=0x7ffea2fcb028, parser=0x7ffea2fccbb8, r=0x7fff742b9168, bytes_used=0x7ffff3ce7bcc, eof=true)
    at HdrTSOnly.cc:113
113         int heap_slot = m_heap->attach_block(r->get_current_block(), start);
(gdb) p b_avail
$2 = 0
(gdb) p eof
$3 = true
(gdb) p *r
$5 = {accessor = 0x0, mbuf = 0x0, block = {m_ptr = 0x0}, start_offset = 0, size_limit = 9223372036854775807}
(gdb) p *bytes_used
$6 = 0
(gdb) p *parser
$7 = {m_parsing_http = true, m_mime_parser = {m_scanner = {m_line = 0x0, m_line_length = 0, m_line_size = 0,
      m_state = MIME_PARSE_BEFORE}, m_field = 0, m_field_flags = 0, m_value = -1}}



> Occasional crash in HdrHeap
> ---------------------------
>
>                 Key: TS-2680
>                 URL: https://issues.apache.org/jira/browse/TS-2680
>             Project: Traffic Server
>          Issue Type: Bug
>            Reporter: Peter Walsh
>              Labels: crash
>             Fix For: sometime
>
>
> Every few days we are seeing a crash in HdrHeap.  We have not been able to reproduce in test environments, but will attach additional information when we do. 
> NOTE: Traffic Server received Sig 11: Segmentation fault
> /usr/local/bin/traffic_server - STACK TRACE:
> /lib64/libpthread.so.0[0x3583c0eca0]
> /usr/local/bin/traffic_server(HdrHeap::attach_block(IOBufferBlock*, char const*)+0x80)[0x5c13f0]
> /usr/local/bin/traffic_server(HTTPHdr::parse_resp(HTTPParser*, IOBufferReader*, int*, bool)+0x15d)[0x5c15fd]
> /usr/local/bin/traffic_server(HttpSM::state_read_server_response_header(int, void*)+0x138)[0x52eea8]
> /usr/local/bin/traffic_server(HttpSM::main_handler(int, void*)+0xdc)[0x530fec]
> /usr/local/bin/traffic_server[0x69415b]
> /usr/local/bin/traffic_server(NetHandler::mainNetEvent(int, Event*)+0x479)[0x68a2c9]
> /usr/local/bin/traffic_server(EThread::process_event(Event*, int)+0x22f)[0x6b9bbf]
> /usr/local/bin/traffic_server(EThread::execute()+0x5bc)[0x6ba4cc]
> /usr/local/bin/traffic_server[0x6b900e]
> /lib64/libpthread.so.0[0x3583c0683d]
> /lib64/libc.so.6(clone+0x6d)[0x35834d526d]
>   



--
This message was sent by Atlassian JIRA
(v6.2#6252)