You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by GitBox <gi...@apache.org> on 2021/05/07 06:22:53 UTC

[GitHub] [trafficserver] masaori335 opened a new issue #7796: Intermittent assertion failure `captive_action.cancelled == 0`

masaori335 opened a new issue #7796:
URL: https://github.com/apache/trafficserver/issues/7796


   On the current master branch (ed89b7b694908b12f21452195e2bbfd4e0fbb156), I observed below assertion failure intermittently.
   
   ```
   2021-05-07 15:17:51.924268+0900 traffic_server[20019:1779140] Fatal: HttpCacheSM.cc:161: failed assertion `captive_action.cancelled == 0`
   Process 20019 stopped
   * thread #2, name = '[ET_NET 0]', stop reason = signal SIGABRT
       frame #0: 0x00007fff20394946 libsystem_kernel.dylib`__pthread_kill + 10
   libsystem_kernel.dylib`__pthread_kill:
   ->  0x7fff20394946 <+10>: jae    0x7fff20394950            ; <+20>
       0x7fff20394948 <+12>: movq   %rax, %rdi
       0x7fff2039494b <+15>: jmp    0x7fff2038eb49            ; cerror_nocancel
       0x7fff20394950 <+20>: retq
   Target 0: (traffic_server) stopped.
   (lldb) bt
   * thread #2, name = '[ET_NET 0]', stop reason = signal SIGABRT
     * frame #0: 0x00007fff20394946 libsystem_kernel.dylib`__pthread_kill + 10
       frame #1: 0x00007fff203c3615 libsystem_pthread.dylib`pthread_kill + 263
       frame #2: 0x00007fff20318411 libsystem_c.dylib`abort + 120
       frame #3: 0x00000001012202ae libtscore.10.dylib`ink_abort(message_format="%s:%d: failed assertion `%s`") at ink_error.cc:99:3
       frame #4: 0x000000010121c3cc libtscore.10.dylib`::_ink_assert(expression="captive_action.cancelled == 0", file="HttpCacheSM.cc", line=161) at ink_assert.cc:37:3
       frame #5: 0x00000001000a69c0 traffic_server`HttpCacheSM::state_cache_open_write(this=0x0000000109001990, event=1108, data=0x000000013004e840) at HttpCacheSM.cc:161:3
       frame #6: 0x0000000100005aff traffic_server`Continuation::handleEvent(this=0x0000000109001990, event=1108, data=0x000000013004e840) at I_Continuation.h:219:12
       frame #7: 0x0000000100338a33 traffic_server`CacheVC::callcont(this=0x000000013004e840, event=1108) at P_CacheInternal.h:640:25
       frame #8: 0x0000000100339633 traffic_server`CacheVC::openWriteStartDone(this=0x000000013004e840, event=3900, e=0x0000000000000000) at CacheWrite.cc:1627:10
       frame #9: 0x0000000100005aff traffic_server`Continuation::handleEvent(this=0x000000013004e840, event=3900, data=0x0000000000000000) at I_Continuation.h:219:12
       frame #10: 0x000000010033acef traffic_server`Cache::open_write(this=0x0000000101c415e0, cont=0x0000000109001990, key=0x00000001082c5c38, info=0x000000013004ed88, apin_in_cache=0, (null)=0x0000000000000000, type=CACHE_FRAG_TYPE_HTTP, hostname="localhost8001http100kblocalhost:8001http://localhost:8001/100kb", host_len=9) at CacheWrite.cc:1868:10
       frame #11: 0x00000001002f9ca9 traffic_server`CacheProcessor::open_write(this=0x000000010069da00, cont=0x0000000109001990, expected_size=0, key=0x00000001082c5c28, request=0x0000000109000370, old_info=0x000000013004ed88, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3254:24
       frame #12: 0x00000001000a768f traffic_server`HttpCacheSM::open_write(this=0x0000000109001990, key=0x00000001082c5c28, url=0x0000000109000388, request=0x0000000109000370, old_info=0x000000013004ed88, pin_in_cache=0, retry=true, allow_multiple=false) at HttpCacheSM.cc:363:20
       frame #13: 0x000000010010257f traffic_server`HttpSM::do_cache_prepare_action(this=0x0000000108fffbc0, c_sm=0x0000000109001990, object_read_info=0x000000013004ed88, retry=true, allow_multiple=false) at HttpSM.cc:4795:11
       frame #14: 0x0000000100109208 traffic_server`HttpSM::do_cache_prepare_write(this=0x0000000108fffbc0) at HttpSM.cc:4724:3
       frame #15: 0x000000010010896c traffic_server`HttpSM::set_next_state(this=0x0000000108fffbc0) at HttpSM.cc:7608:5
       frame #16: 0x00000001000df33a traffic_server`HttpSM::call_transact_and_set_next_state(this=0x0000000108fffbc0, f=0x0000000000000000)(HttpTransact::State*)) at HttpSM.cc:7339:3
       frame #17: 0x00000001000e8094 traffic_server`HttpSM::handle_api_return(this=0x0000000108fffbc0) at HttpSM.cc:1691:5
       frame #18: 0x00000001000dad8f traffic_server`HttpSM::do_api_callout(this=0x0000000108fffbc0) at HttpSM.cc:436:5
       frame #19: 0x00000001001071b4 traffic_server`HttpSM::set_next_state(this=0x0000000108fffbc0) at HttpSM.cc:7373:5
       frame #20: 0x00000001000df33a traffic_server`HttpSM::call_transact_and_set_next_state(this=0x0000000108fffbc0, f=0x0000000000000000)(HttpTransact::State*)) at HttpSM.cc:7339:3
       frame #21: 0x00000001000f3aa7 traffic_server`HttpSM::state_hostdb_lookup(this=0x0000000108fffbc0, event=500, data=0x0000000102839f80) at HttpSM.cc:2348:5
       frame #22: 0x00000001000da6d8 traffic_server`HttpSM::main_handler(this=0x0000000108fffbc0, event=500, data=0x0000000102839f80) at HttpSM.cc:2701:5
       frame #23: 0x0000000100005aff traffic_server`Continuation::handleEvent(this=0x0000000108fffbc0, event=500, data=0x0000000102839f80) at I_Continuation.h:219:12
       frame #24: 0x00000001002b39ef traffic_server`reply_to_cont(cont=0x0000000108fffbc0, r=0x0000000102839f80, is_srv=false) at HostDB.cc:503:9
       frame #25: 0x00000001002b9e7d traffic_server`HostDBContinuation::dnsEvent(this=0x000000011818f5e0, event=600, e=0x0000000109449a00) at HostDB.cc:1366:11
       frame #26: 0x0000000100005aff traffic_server`Continuation::handleEvent(this=0x000000011818f5e0, event=600, data=0x0000000109449a00) at I_Continuation.h:219:12
       frame #27: 0x00000001002da3bd traffic_server`DNSEntry::postOneEvent(this=0x0000000120958800, (null)=0, (null)=0x0000000000000000) at DNS.cc:1449:26
       frame #28: 0x00000001002da0fc traffic_server`DNSEntry::post(this=0x0000000120958800, h=0x0000000118118000, ent=0x0000000109449a00) at DNS.cc:1435:5
       frame #29: 0x00000001002d9d72 traffic_server`DNSEntry::postAllEvent(this=0x0000000120958800, (null)=0, (null)=0x0000000000000000) at DNS.cc:1412:7
       frame #30: 0x0000000100005aff traffic_server`Continuation::handleEvent(this=0x0000000120958800, event=0, data=0x0000000000000000) at I_Continuation.h:219:12
       frame #31: 0x00000001002d959a traffic_server`dns_result(h=0x0000000118118000, e=0x0000000120958800, ent=0x0000000109449a00, retry=false, tcp_retry=false) at DNS.cc:1379:6
       frame #32: 0x00000001002d74d6 traffic_server`dns_process(handler=0x0000000118118000, buf=0x0000000109449a00, len=43) at DNS.cc:1792:7
       frame #33: 0x00000001002d434c traffic_server`DNSHandler::recv_dns(this=0x0000000118118000, (null)=0, (null)=0x0000000000000000) at DNS.cc:927:11
       frame #34: 0x00000001002d138a traffic_server`DNSHandler::mainEvent(this=0x0000000118118000, event=0, e=0x0000000000000000) at DNS.cc:940:3
       frame #35: 0x0000000100005aff traffic_server`Continuation::handleEvent(this=0x0000000118118000, event=0, data=0x0000000000000000) at I_Continuation.h:219:12
       frame #36: 0x00000001002df6c4 traffic_server`DNSConnection::trigger(this=0x000000011812d678) at DNSConnection.cc:87:12
       frame #37: 0x000000010043da46 traffic_server`NetHandler::waitForActivity(this=0x00000001080bc0f0, timeout=60000000) at UnixNet.cc:534:27
       frame #38: 0x0000000100484f01 traffic_server`EThread::execute_regular(this=0x00000001080b8000) at UnixEThread.cc:303:14
       frame #39: 0x000000010048537d traffic_server`EThread::execute(this=0x00000001080b8000) at UnixEThread.cc:364:11
       frame #40: 0x000000010048353b traffic_server`spawn_thread_internal(a=0x0000000101c3d770) at Thread.cc:92:12
       frame #41: 0x00007fff203c3954 libsystem_pthread.dylib`_pthread_start + 224
       frame #42: 0x00007fff203bf4a7 libsystem_pthread.dylib`thread_start + 15
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] cukiernik commented on issue #7796: Intermittent assertion failure `captive_action.cancelled == 0`

Posted by GitBox <gi...@apache.org>.
cukiernik commented on issue #7796:
URL: https://github.com/apache/trafficserver/issues/7796#issuecomment-836246458


   The commit without this fail is a8b6746d303c4fafdc2e609941750fc4c2ac9b14


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] maskit commented on issue #7796: Intermittent assertion failure `captive_action.cancelled == 0`

Posted by GitBox <gi...@apache.org>.
maskit commented on issue #7796:
URL: https://github.com/apache/trafficserver/issues/7796#issuecomment-834162683


   Probably #7705 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] masaori335 commented on issue #7796: Intermittent assertion failure `captive_action.cancelled == 0`

Posted by GitBox <gi...@apache.org>.
masaori335 commented on issue #7796:
URL: https://github.com/apache/trafficserver/issues/7796#issuecomment-834891642


   Duplicated.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] masaori335 closed issue #7796: Intermittent assertion failure `captive_action.cancelled == 0`

Posted by GitBox <gi...@apache.org>.
masaori335 closed issue #7796:
URL: https://github.com/apache/trafficserver/issues/7796


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] masaori335 commented on issue #7796: Intermittent assertion failure `captive_action.cancelled == 0`

Posted by GitBox <gi...@apache.org>.
masaori335 commented on issue #7796:
URL: https://github.com/apache/trafficserver/issues/7796#issuecomment-834103520


   ```
   (lldb) frame select 13
   (lldb) p this->history
   (History<65>) $0 = {
     history = {
       [0] = {
         location = (file = "HttpSM.cc", func = "state_read_client_request_header", line = 697)
         event = 100
         reentrancy = 2
       }
       [1] = {
         location = (file = "HttpSM.cc", func = "set_next_state", line = 7497)
         event = 34463
         reentrancy = 2
       }
       [2] = {
         location = (file = "HttpSM.cc", func = "do_cache_lookup_and_read", line = 4699)
         event = 6656
         reentrancy = 2
       }
       [3] = {
         location = (file = "HttpCacheSM.cc", func = "state_cache_open_read", line = 100)
         event = 1102
         reentrancy = -31073
       }
       [4] = {
         location = (file = "HttpSM.cc", func = "state_cache_open_read", line = 2612)
         event = 1102
         reentrancy = 1
       }
       [5] = {
         location = (file = "HttpSM.cc", func = "set_next_state", line = 7457)
         event = 34463
         reentrancy = 1
       }
       [6] = {
         location = (file = "HttpSM.cc", func = "state_hostdb_lookup", line = 2337)
         event = 500
         reentrancy = 1
       }
       [7] = {
         location = (file = "HttpSM.cc", func = "set_next_state", line = 7606)
         event = 34463
         reentrancy = 1
       }
       [8] = {
         location = (file = "HttpCacheSM.cc", func = "state_cache_open_write", line = 160)
         event = 1108
         reentrancy = -31073
       }
       [9] = {
         location = (file = 0x0000000000000000, func = 0x0000000000000000, line = 0)
         event = 0
         reentrancy = 0
       }
       ...
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org