You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by "Zhao Yongming (JIRA)" <ji...@apache.org> on 2011/06/10 08:42:58 UTC

[jira] [Created] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
---------------------------------------------------------------------------------------

                 Key: TS-833
                 URL: https://issues.apache.org/jira/browse/TS-833
             Project: Traffic Server
          Issue Type: Bug
          Components: Core
    Affects Versions: 3.1.0
         Environment: current trunk, with --enable-debug
            Reporter: Zhao Yongming


bt #1
{code}
#0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
146         return (this->*handler) (event, data);
(gdb) bt
#0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
#1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
#2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
#3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
(gdb) info f
Stack level 0, frame at 0x7fff76c40e40:
 rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
 called by frame at 0x7fff76c40eb0
 source language c++.
 Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
 Saved registers:
  rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
(gdb) x/40x this
0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
{code}

bt #2
{code}
#0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
146         return (this->*handler) (event, data);
(gdb) bt
#0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
#1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
#2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
#3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
(gdb) p *this
$1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
  handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
      next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
(gdb) 
{code}

bt #3
{code}
#0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
146         return (this->*handler) (event, data);
(gdb) bt
#0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
#1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
#2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
#3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
(gdb) info f
Stack level 0, frame at 0x7fff421f01f0:
 rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
 called by frame at 0x7fff421f0260
 source language c++.
 Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
 Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
 Saved registers:
  rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
(gdb) p this->handler
$1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
{code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050836#comment-13050836 ] 

mohan_zl commented on TS-833:
-----------------------------

@John yeah, i use TS-833-3.diff with the latest trunk.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048892#comment-13048892 ] 

John Plevyak commented on TS-833:
---------------------------------

The previous comments are really for TS-834.  For this bug, the first value "this" is a pointer to the next element in the freelist.
It just so happens that

0x19581df0 -    0x19581900 = 1264

which probably not coincidentally is the same as sizeof(DNSEntry)... so this patch is really for 834 and the blasted DNSEntry is very likely the
cause of this second issue. 

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051351#comment-13051351 ] 

John Plevyak commented on TS-833:
---------------------------------

I think these are related.  The DNSEntry is trashed or the timeout is bad.  We are in write_dns_event writing an entry which
is not the new one.  This is an odd state to be in as entries are written immediately unless we are over 2K entries in flight
or if there has been a failover (bad DNS server).  You could be able to check that in the stats.  I think it more likely that
the DNSEntry is trashed.   If you see this again, try printing out "e" within write_dns_event.  Also check to see if you are getting
failovers.  There should be warnings in the logs: 

"failover: connection to DNS server %d.%d.%d.%d lost, retrying"

Also the number in flight is stored in DNSHandler::in_flight available in h->in_flight in write_dns_event.

Most likely the DNSEntry has been free'd.  But how that could possibly happen is beyond me.  The only code path goes
through DNSEntry::post() which is after removing the DNSEntry from the DNSHandler::entries queue which is the same
queue which is walked in write_dns() to call write_dns_entry() which is where the crash happens.  It is also after
code which cancels any timeout.

I just can't see the problem, but perhaps someone else can.



> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051761#comment-13051761 ] 

mohan_zl commented on TS-833:
-----------------------------

@John, when i use your patch TS-833-3.diff in latest trunk, with debug enabled, then one assert fail in openReadFromWriter, i file a bug in TS-844.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Leif Hedstrom (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Leif Hedstrom resolved TS-833.
------------------------------

    Resolution: Fixed

I believe this is resolved and on both trunk and 3.0.x, so closing.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>            Assignee: John Plevyak
>              Labels: freelist
>             Fix For: 3.1.0, 3.0.1
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050174#comment-13050174 ] 

mohan_zl commented on TS-833:
-----------------------------

@John I think this bug has not been fixed yet.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050604#comment-13050604 ] 

John Plevyak commented on TS-833:
---------------------------------

Bloody unbelievable.  This is event == 2 which is a schedule_in and the size of the object is the same as DNSEntry, so a schedule_in on a DNSEntry.  There are only a couple of those and I have checked those paths.  Anyone else want to take a look?

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050620#comment-13050620 ] 

John Plevyak commented on TS-833:
---------------------------------

mohan_zl, this latest crash is with TS-833-3.diff ??

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Zhao Yongming (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053027#comment-13053027 ] 

Zhao Yongming commented on TS-833:
----------------------------------

John:
after the testing with your patch from TS-833 TS-834, on the trunk, we find out that the following crash rise up:
{code}
[New process 3496]
#0  0x00000000004d302c in Continuation::handleEvent (this=0xa993e40, event=2, data=0xae09210) at I_Continuation.h:146
146	    return (this->*handler) (event, data);
(gdb) bt
#0  0x00000000004d302c in Continuation::handleEvent (this=0xa993e40, event=2, data=0xae09210) at I_Continuation.h:146
#1  0x00000000006f9978 in EThread::process_event (this=0x2aaaaae29010, e=0xae09210, calling_code=2) at UnixEThread.cc:140
#2  0x00000000006f9cba in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
#3  0x00000000004ff74d in main (argc=3, argv=0x7fff464b6438) at Main.cc:1958
(gdb) info f
Stack level 0, frame at 0x7fff464b5d50:
 rip = 0x4d302c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f9978
 called by frame at 0x7fff464b5dc0
 source language c++.
 Arglist at 0x7fff464b5d40, args: this=0xa993e40, event=2, data=0xae09210
 Locals at 0x7fff464b5d40, Previous frame's sp is 0x7fff464b5d50
 Saved registers:
  rbp at 0x7fff464b5d40, rip at 0x7fff464b5d48
(gdb) 
{code}

I have got a small core dump file, about 2GB, at http://people.apache.org/~zym/cores/ along with the packages I used, and logs etc. please check if it is useful for you. the rpm is running on rhel 5.4 x86_64.

thanks

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Zhao Yongming (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13063760#comment-13063760 ] 

Zhao Yongming commented on TS-833:
----------------------------------

we have testing the patch in trunk for 24hours without any crash, I'd like conclude that we have fix the issue. I will call for more testing.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Zhao Yongming (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050947#comment-13050947 ] 

Zhao Yongming commented on TS-833:
----------------------------------

we have got another rare Seg Fault, not sure if it is this bug related, here is the stack trace:

traffic.out:
{code}
NOTE: Traffic Server received Sig 11: Segmentation fault
/usr/bin/traffic_server - STACK TRACE:
/usr/bin/traffic_server[0x51ba3e]
/lib64/libpthread.so.0[0x30ec20e7c0]
[0x122802e65b371fd0]
/usr/bin/traffic_server(DNSEntry::mainEvent(int, Event*)+0x595)[0x643b65]
/usr/bin/traffic_server(Continuation::handleEvent(int, void*)+0x6f)[0x4d302f]
/usr/bin/traffic_server(DNSProcessor::getby(char const*, int, int, Continuation*, DNSHandler*, int)+0x250)[0x641472]
/usr/bin/traffic_server(DNSProcessor::gethostbyname(Continuation*, char const*, DNSHandler*, int)+0x47)[0x6378c7]
/usr/bin/traffic_server(HostDBContinuation::do_dns()+0x2b9)[0x630125]
/usr/bin/traffic_server(HostDBContinuation::probeEvent(int, Event*)+0x341)[0x6313b3]
/usr/bin/traffic_server(Continuation::handleEvent(int, void*)+0x6f)[0x4d302f]
/usr/bin/traffic_server(EThread::process_event(Event*, int)+0x11e)[0x6f9978]
/usr/bin/traffic_server(EThread::execute()+0x1e4)[0x6f9cba]
/usr/bin/traffic_server[0x6f92c9]
/lib64/libpthread.so.0[0x30ec2064a7]
/lib64/libc.so.6(clone+0x6d)[0x30eb6d3c2d]
/lib64/libc.so.6(clone+0x6d)[0x30eb6d3c2d]
[Jun 17 16:22:52.570] Manager {47840561255424} FATAL: [LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
{code}

gdb:
{code}
(gdb) bt
#0  0x00000000006424b0 in write_dns_event (h=0x1e3c1fb0, e=0x2aaab006a690) at DNS.cc:898
#1  0x00000000006427b6 in write_dns (h=0x1e3c1fb0) at DNS.cc:804
#2  0x0000000000643b65 in DNSEntry::mainEvent (this=0x2aaab006ba50, event=1, e=0x0) at DNS.cc:965
#3  0x00000000004d302f in Continuation::handleEvent (this=0x2aaab006ba50, event=1, data=0x0) at I_Continuation.h:146
#4  0x0000000000641472 in DNSProcessor::getby (this=0xac22e0, x=0x1e3dda14 "img04.taobaocdn.com", len=0, type=1, cont=0x1e3dd960, adnsH=0x0, timeout=0)
    at DNS.cc:999
#5  0x00000000006378c7 in DNSProcessor::gethostbyname (this=0xac22e0, cont=0x1e3dd960, name=0x1e3dda14 "img04.taobaocdn.com", adnsH=0x0, timeout=0)
    at I_DNSProcessor.h:123
#6  0x0000000000630125 in HostDBContinuation::do_dns (this=0x1e3dd960) at HostDB.cc:1771
#7  0x00000000006313b3 in HostDBContinuation::probeEvent (this=0x1e3dd960, event=2, e=0x215c9980) at HostDB.cc:1696
#8  0x00000000004d302f in Continuation::handleEvent (this=0x1e3dd960, event=2, data=0x215c9980) at I_Continuation.h:146
#9  0x00000000006f9978 in EThread::process_event (this=0x2aaaaaf2a010, e=0x215c9980, calling_code=2) at UnixEThread.cc:140
#10 0x00000000006f9cba in EThread::execute (this=0x2aaaaaf2a010) at UnixEThread.cc:217
#11 0x00000000006f92c9 in spawn_thread_internal (a=0x1e393b40) at Thread.cc:88
#12 0x00000030ec2064a7 in start_thread () from /lib64/libpthread.so.0
#13 0x00000030eb6d3c2d in clone () from /lib64/libc.so.6
(gdb) info f
Stack level 0, frame at 0x40ee0a70:
 rip = 0x6424b0 in write_dns_event (DNS.cc:898); saved rip 0x6427b6
 called by frame at 0x40ee0ac0
 source language c++.
 Arglist at 0x40ee0a60, args: h=0x1e3c1fb0, e=0x2aaab006a690
 Locals at 0x40ee0a60, Previous frame's sp is 0x40ee0a70
 Saved registers:
  rbx at 0x40ee0a48, rbp at 0x40ee0a60, r12 at 0x40ee0a50, r13 at 0x40ee0a58, rip at 0x40ee0a68

{code}

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Leif Hedstrom (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Leif Hedstrom updated TS-833:
-----------------------------

    Fix Version/s: 3.1.0

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Igor Galić (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Igor Galić updated TS-833:
--------------------------

    Backport to Version: 3.0.1

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13049666#comment-13049666 ] 

mohan_zl commented on TS-833:
-----------------------------

John, i wanna know where can i get your theory paper?

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050173#comment-13050173 ] 

mohan_zl commented on TS-833:
-----------------------------

{quote}

#0  0x00000000004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, data=0xdb212d0) at I_Continuation.h:146
146         return (this->*handler) (event, data);
(gdb) bt
#0  0x00000000004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, data=0xdb212d0) at I_Continuation.h:146
#1  0x00000000006f58c8 in EThread::process_event (this=0x2aaaaae29010, e=0xdb212d0, calling_code=2) at UnixEThread.cc:140
#2  0x00000000006f5c0a in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
#3  0x00000000004ff37d in main (argc=3, argv=0x7fff0e981f48) at Main.cc:1958
(gdb) x/40x this
0xda48180:      0x0da477a1      0x00000000      0xefbeadde      0xefbeadde
0xda48190:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481a0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481b0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481c0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481d0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481e0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481f0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda48200:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda48210:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
(gdb) info f
Stack level 0, frame at 0x7fff0e981860:
 rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f58c8
 called by frame at 0x7fff0e9818d0
 source language c++.
 Arglist at 0x7fff0e981850, args: this=0xda48180, event=2, data=0xdb212d0
 Locals at 0x7fff0e981850, Previous frame's sp is 0x7fff0e981860
 Saved registers:
  rbp at 0x7fff0e981850, rip at 0x7fff0e981858
(gdb) info args
this = (Continuation * const) 0xda48180
event = 2
data = (void *) 0xdb212d0
(gdb) p this->handler_name
$1 = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>
(gdb) p *this
$2 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0xda477a1}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
  handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
      next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
{quote}

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Issue Comment Edited] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050173#comment-13050173 ] 

mohan_zl edited comment on TS-833 at 6/16/11 1:08 AM:
------------------------------------------------------

{code}

#0  0x00000000004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, data=0xdb212d0) at I_Continuation.h:146
146         return (this->*handler) (event, data);
(gdb) bt
#0  0x00000000004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, data=0xdb212d0) at I_Continuation.h:146
#1  0x00000000006f58c8 in EThread::process_event (this=0x2aaaaae29010, e=0xdb212d0, calling_code=2) at UnixEThread.cc:140
#2  0x00000000006f5c0a in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
#3  0x00000000004ff37d in main (argc=3, argv=0x7fff0e981f48) at Main.cc:1958
(gdb) x/40x this
0xda48180:      0x0da477a1      0x00000000      0xefbeadde      0xefbeadde
0xda48190:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481a0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481b0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481c0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481d0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481e0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481f0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda48200:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda48210:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
(gdb) info f
Stack level 0, frame at 0x7fff0e981860:
 rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f58c8
 called by frame at 0x7fff0e9818d0
 source language c++.
 Arglist at 0x7fff0e981850, args: this=0xda48180, event=2, data=0xdb212d0
 Locals at 0x7fff0e981850, Previous frame's sp is 0x7fff0e981860
 Saved registers:
  rbp at 0x7fff0e981850, rip at 0x7fff0e981858
(gdb) info args
this = (Continuation * const) 0xda48180
event = 2
data = (void *) 0xdb212d0
(gdb) p this->handler_name
$1 = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>
(gdb) p *this
$2 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0xda477a1}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
  handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
      next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
{code}

      was (Author: wahu0315210):
    {quote}

#0  0x00000000004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, data=0xdb212d0) at I_Continuation.h:146
146         return (this->*handler) (event, data);
(gdb) bt
#0  0x00000000004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, data=0xdb212d0) at I_Continuation.h:146
#1  0x00000000006f58c8 in EThread::process_event (this=0x2aaaaae29010, e=0xdb212d0, calling_code=2) at UnixEThread.cc:140
#2  0x00000000006f5c0a in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
#3  0x00000000004ff37d in main (argc=3, argv=0x7fff0e981f48) at Main.cc:1958
(gdb) x/40x this
0xda48180:      0x0da477a1      0x00000000      0xefbeadde      0xefbeadde
0xda48190:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481a0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481b0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481c0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481d0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481e0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda481f0:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda48200:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
0xda48210:      0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
(gdb) info f
Stack level 0, frame at 0x7fff0e981860:
 rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f58c8
 called by frame at 0x7fff0e9818d0
 source language c++.
 Arglist at 0x7fff0e981850, args: this=0xda48180, event=2, data=0xdb212d0
 Locals at 0x7fff0e981850, Previous frame's sp is 0x7fff0e981860
 Saved registers:
  rbp at 0x7fff0e981850, rip at 0x7fff0e981858
(gdb) info args
this = (Continuation * const) 0xda48180
event = 2
data = (void *) 0xdb212d0
(gdb) p this->handler_name
$1 = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>
(gdb) p *this
$2 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0xda477a1}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
  handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
      next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
{quote}
  
> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13051784#comment-13051784 ] 

mohan_zl commented on TS-833:
-----------------------------

By the way, now we found an interesting problem, we use 20 machines for testing, and each node use single mode. We found if the nodes have run for a while, then some machine have a very very low qps, but not crash, and if one node crashed, then when it restart, it can run well as before. I think maybe this problem is not caused by cache, but the proxy or net module.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Plevyak updated TS-833:
----------------------------

    Attachment: TS-833.diff

Potential patch for InactivityCop

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053568#comment-13053568 ] 

mohan_zl commented on TS-833:
-----------------------------

{code}
#0  ink_stack_trace_get (stack=<value optimized out>, len=<value optimized out>, signalhandler_frame=<value optimized out>) at ink_stack_trace.cc:68
68          fp = (void **) (*fp);
(gdb) bt
#0  ink_stack_trace_get (stack=<value optimized out>, len=<value optimized out>, signalhandler_frame=<value optimized out>) at ink_stack_trace.cc:68
#1  0x00002ab9bd500ef1 in ink_stack_trace_dump (sighandler_frame=<value optimized out>) at ink_stack_trace.cc:114
#2  0x00000000004df020 in signal_handler (sig=<value optimized out>) at signals.cc:225
#3  <signal handler called>
#4  HostDBContinuation::dnsEvent (this=0x1f5d7b30, event=600, e=0x0) at HostDB.cc:1337
#5  0x0000000000607417 in DNSEntry::postEvent (this=0x20dad940, event=<value optimized out>, e=<value optimized out>) at ../../iocore/eventsystem/I_Continuation.h:146
#6  0x00000000006cdccf in EThread::process_event (this=0x2aaaaae29010, e=0x29c3f220, calling_code=2) at I_Continuation.h:146
#7  0x00000000006ce3fb in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
#8  0x00000000004bf5fe in main (argc=<value optimized out>, argv=<value optimized out>) at Main.cc:1962
(gdb) info f
Stack level 0, frame at 0x7fff382da560:
 rip = 0x2ab9bd500df3 in ink_stack_trace_get(void**, int, int) (ink_stack_trace.cc:68); saved rip 0x2ab9bd500ef1
 called by frame at 0x7fff382da9b0
 source language c++.
 Arglist at 0x7fff382da540, args: stack=<value optimized out>, len=<value optimized out>, signalhandler_frame=<value optimized out>
 Locals at 0x7fff382da540, Previous frame's sp is 0x7fff382da560
 Saved registers:
  rbx at 0x7fff382da548, rbp at 0x7fff382da550, rip at 0x7fff382da558
(gdb) info args
stack = <value optimized out>
len = <value optimized out>
signalhandler_frame = <value optimized out>
{code}

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Zhao Yongming (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053038#comment-13053038 ] 

Zhao Yongming commented on TS-833:
----------------------------------

John:
I got the case you comment on 17/Jun/11 22:07, the gdb shows:

{code}

[New process 12674]
#0  0x000000000063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
752	    if (e->once_written_flag)
(gdb) bt
#0  0x000000000063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
#1  0x0000000000643e33 in dns_process (handler=0x18ea3070, buf=0x2aaab1292010, len=159) at DNS.cc:1170
#2  0x0000000000645cfc in DNSHandler::recv_dns (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:690
#3  0x000000000064655f in DNSHandler::mainEvent (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:703
#4  0x00000000004d302f in Continuation::handleEvent (this=0x18ea3070, event=5, data=0x18e7df50) at I_Continuation.h:146
#5  0x00000000006f9978 in EThread::process_event (this=0x2aaaaae29010, e=0x18e7df50, calling_code=5) at UnixEThread.cc:140
#6  0x00000000006f9e96 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:262
#7  0x00000000004ff74d in main (argc=3, argv=0x7fff21439ac8) at Main.cc:1958
(gdb) print e
$1 = (DNSEntry *) 0xefbeaddeefbeadde
(gdb) print h->in_flight
$2 = 4
(gdb) 
{code}

and the traffic.out looks
{code}
[TrafficServer] using root directory '/usr'
[Jun 20 10:47:48.118] Manager {47791815218176} NOTE: [LocalManager::pollMgmtProcessServer] New process connecting fd '9'
[Jun 20 10:47:48.118] Manager {47791815218176} NOTE: [Alarms::signalAlarm] Server Process born
[Jun 20 10:47:49.141] {47286116713584} STATUS: opened /var/log/trafficserver/diags.log
[Jun 20 10:47:49.142] {47286116713584} NOTE: updated diags config
[Jun 20 10:47:49.146] Server {47286116713584} NOTE: cache clustering disabled
[Jun 20 10:47:49.169] Server {47286116713584} NOTE: cache clustering disabled
[Jun 20 10:47:49.639] Server {47286116713584} NOTE: logging initialized[7], logging_mode = 3
[Jun 20 10:47:49.680] Server {47286116713584} NOTE: traffic server running
[Jun 20 10:47:49.735] Server {1099794752} WARNING: failover: connection to DNS server 127.0.0.1 lost, move to 121.14.89.156
[Jun 20 10:47:50.243] Server {1124858176} WARNING: Access logging to local log directory suspended - configured space allocation exhausted.
[Jun 20 10:47:55.446] Server {47286116713584} NOTE: cache enabled
[Jun 20 10:47:56.001] Server {47286116713584} NOTE: [log-coll] host up [121.14.89.156:8085]
[Jun 21 00:00:00.001] Server {1124858176} STATUS: The logfile /var/log/trafficserver/error.log was rolled to /var/log/trafficserver/error.log_cache174.cn62.20110620.10h47m49s-20110621.00h00m00s.old.
[Jun 21 00:00:05.001] Server {1124858176} STATUS: The rolled logfile, /var/log/trafficserver/error.log_cache174.cn62.20110620.10h47m49s-20110621.00h00m00s.old, was auto-deleted; 0 bytes were reclaimed.
NOTE: Traffic Server received Sig 11: Segmentation fault
/usr/bin/traffic_server - STACK TRACE: 
/usr/bin/traffic_server[0x51ba3e]
/lib64/libpthread.so.0[0x36af20e7c0]
[0x2aaab015ac70]
/usr/bin/traffic_server(_ZN10DNSHandler8recv_dnsEiP5Event+0x6a0)[0x645cfc]
/usr/bin/traffic_server(_ZN10DNSHandler9mainEventEiP5Event+0x39)[0x64655f]
/usr/bin/traffic_server(_ZN12Continuation11handleEventEiPv+0x6f)[0x4d302f]
/usr/bin/traffic_server(_ZN7EThread13process_eventEP5Eventi+0x11e)[0x6f9978]
/usr/bin/traffic_server(_ZN7EThread7executeEv+0x3c0)[0x6f9e96]
/usr/bin/traffic_server(main+0x10c7)[0x4ff74d]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x36ae61d994]
/usr/bin/traffic_server(__gxx_personality_v0+0x491)[0x4b2149]
/usr/bin/traffic_server(__gxx_personality_v0+0x491)[0x4b2149]
[Jun 21 01:02:34.760] Manager {47791815218176} FATAL: [LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Jun 21 01:02:36.778] Manager {47791815218176} FATAL:  (last system error 104: Connection reset by peer)
[Jun 21 01:02:36.778] Manager {47791815218176} NOTE: [LocalManager::mgmtShutdown] Executing shutdown request.
[Jun 21 01:02:36.778] Manager {47791815218176} NOTE: [LocalManager::processShutdown] Executing process shutdown request.
[Jun 21 01:02:36.784] Manager {47791815218176} ERROR: [LocalManager::sendMgmtMsgToProcesses] Error writing message
[Jun 21 01:02:36.785] Manager {47791815218176} ERROR:  (last system error 32: Broken pipe)
[E. Mgmt] log ==> [TrafficManager] using root directory '/usr'
[Jun 21 01:02:40.791] {46942772802560} NOTE: updated diags config
[Jun 21 01:02:51.503] Manager {46942772802560} NOTE: [ClusterCom::ClusterCom] Node running on OS: 'Linux' Release: '2.6.18-164.11.1.el5'
[Jun 21 01:02:51.531] Manager {46942772802560} NOTE: [LocalManager::listenForProxy] Listening on port: 8080
[Jun 21 01:02:51.531] Manager {46942772802560} NOTE: [LocalManager::listenForProxy] Listening on port: 80
[Jun 21 01:02:51.531] Manager {46942772802560} NOTE: [TrafficManager] Setup complete
[Jun 21 01:02:52.594] Manager {46942772802560} NOTE: [LocalManager::startProxy] Launching ts process
{code}

I need to figure out that I have just two nameserver configured in records.config, the 127.0.0.1 and 121.14.89.156. and at the meantime the 127.0.0.1 is not active which is a fault.

that is all I can figure out, FYI

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Igor Galić (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Igor Galić updated TS-833:
--------------------------

    Fix Version/s: 3.0.1

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0, 3.0.1
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048750#comment-13048750 ] 

John Plevyak commented on TS-833:
---------------------------------

I have a theory about this, but I am not sure why the problem has only manifest now as it seems to have been in the codebase for a while.  The theory is that the vc_next is bad because it has been closed as a result of the inactivity callback.   This could be checked by walking down nh->open_list in the debugger (or code) to see if next_vc is in the list.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13052302#comment-13052302 ] 

mohan_zl commented on TS-833:
-----------------------------

{code}
#0  0x000000000063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
752         if (e->once_written_flag)
(gdb) bt
#0  0x000000000063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
#1  0x0000000000643e33 in dns_process (handler=0x18ea3070, buf=0x2aaab1292010, len=159) at DNS.cc:1170
#2  0x0000000000645cfc in DNSHandler::recv_dns (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:690
#3  0x000000000064655f in DNSHandler::mainEvent (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:703
#4  0x00000000004d302f in Continuation::handleEvent (this=0x18ea3070, event=5, data=0x18e7df50) at I_Continuation.h:146
#5  0x00000000006f9978 in EThread::process_event (this=0x2aaaaae29010, e=0x18e7df50, calling_code=5) at UnixEThread.cc:140
#6  0x00000000006f9e96 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:262
#7  0x00000000004ff74d in main (argc=3, argv=0x7fff21439ac8) at Main.cc:1958
(gdb) info f
Stack level 0, frame at 0x7fff214382c0:
 rip = 0x63f9f5 in get_dns (DNS.cc:752); saved rip 0x643e33
 called by frame at 0x7fff214390a0
 source language c++.
 Arglist at 0x7fff214382b0, args: h=0x18ea3070, id=27816
 Locals at 0x7fff214382b0, Previous frame's sp is 0x7fff214382c0
 Saved registers:
  rbp at 0x7fff214382b0, rip at 0x7fff214382b8
(gdb) info args
h = (DNSHandler *) 0x18ea3070
id = 27816
(gdb) p h
$1 = (DNSHandler *) 0x18ea3070
(gdb) p h->handler_name
$2 = 0x755f55 "&DNSHandler::mainEvent"
{code}

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Plevyak updated TS-833:
----------------------------

    Attachment: TS-833-2.diff

This is a possible patch which deals with DNS issues.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "mohan_zl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13050861#comment-13050861 ] 

mohan_zl commented on TS-833:
-----------------------------

@John, is there any possibilities that these problem is caused by some deep bug?

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Leif Hedstrom (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Leif Hedstrom updated TS-833:
-----------------------------

    Backport to Version:   (was: 3.0.1)
               Assignee: John Plevyak

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>            Assignee: John Plevyak
>              Labels: freelist
>             Fix For: 3.1.0, 3.0.1
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "John Plevyak (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Plevyak updated TS-833:
----------------------------

    Attachment: TS-833-3.diff

Even more conservative coding style.

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

Posted by "Zhao Yongming (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13053138#comment-13053138 ] 

Zhao Yongming commented on TS-833:
----------------------------------

http://people.apache.org/~zym/cores/core.12673 is a full traffic_server core dump file, with the following bt:
{code}
#0  0x000000000063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
752	    if (e->once_written_flag)
(gdb) bt
#0  0x000000000063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
#1  0x0000000000643e33 in dns_process (handler=0x18ea3070, buf=0x2aaab1292010, len=159) at DNS.cc:1170
#2  0x0000000000645cfc in DNSHandler::recv_dns (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:690
#3  0x000000000064655f in DNSHandler::mainEvent (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:703
#4  0x00000000004d302f in Continuation::handleEvent (this=0x18ea3070, event=5, data=0x18e7df50) at I_Continuation.h:146
#5  0x00000000006f9978 in EThread::process_event (this=0x2aaaaae29010, e=0x18e7df50, calling_code=5) at UnixEThread.cc:140
#6  0x00000000006f9e96 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:262
#7  0x00000000004ff74d in main (argc=3, argv=0x7fff21439ac8) at Main.cc:1958
(gdb) 
{code}

> Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
> ---------------------------------------------------------------------------------------
>
>                 Key: TS-833
>                 URL: https://issues.apache.org/jira/browse/TS-833
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 3.1.0
>         Environment: current trunk, with --enable-debug
>            Reporter: Zhao Yongming
>              Labels: freelist
>             Fix For: 3.1.0
>
>         Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff
>
>
> bt #1
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff76c40e40:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff76c40eb0
>  source language c++.
>  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
>  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
>  Saved registers:
>   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
> (gdb) x/40x this
> 0x19581df0:     0x19581901      0x00000000      0xefbeadde      0xefbeadde
> 0x19581e00:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e10:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e20:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e30:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e40:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e50:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e60:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e70:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> 0x19581e80:     0xefbeadde      0xefbeadde      0xefbeadde      0xefbeadde
> {code}
> bt #2
> {code}
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146
> #1  0x000000000070364c in EThread::process_event (this=0x2aaaaae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
> #2  0x000000000070398e in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x0000000000502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
> (gdb) p *this
> $1 = {<force_VFPT_to_top> = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
>   handler_name = 0xefbeaddeefbeadde <Address 0xefbeaddeefbeadde out of bounds>, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {<SLink<Continuation>> = {
>       next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
> (gdb) 
> {code}
> bt #3
> {code}
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> 146         return (this->*handler) (event, data);
> (gdb) bt
> #0  0x00000000004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146
> #1  0x00000000006f5830 in EThread::process_event (this=0x2aaaaae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
> #2  0x00000000006f5b72 in EThread::execute (this=0x2aaaaae29010) at UnixEThread.cc:217
> #3  0x00000000004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
> (gdb) info f
> Stack level 0, frame at 0x7fff421f01f0:
>  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830
>  called by frame at 0x7fff421f0260
>  source language c++.
>  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570
>  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
>  Saved registers:
>   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
> (gdb) p this->handler
> $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
> {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira