You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by GitBox <gi...@apache.org> on 2021/05/13 23:39:31 UTC

[GitHub] [trafficserver] shinrich opened a new issue #7838: HPACK crash in 9.0.1

shinrich opened a new issue #7838:
URL: https://github.com/apache/trafficserver/issues/7838


   We have been getting some background crashes with variations of the following stack since we moved from a 9.0.0 based build to a 9.0.1 based build.
   
   ```
   [ 00 ] traffic_server               get_header_field                                                      ( HPACK.cc:357 )
   [ 01 ] traffic_server               HpackIndexingTable::lookup(char const*, int, char const*, int) const  ( HPACK.cc:251 )
   [ 02 ] traffic_server               hpack_encode_header_block                                             ( HPACK.cc:908 )
   [ 03 ] traffic_server               http2_encode_header_blocks                                            ( HTTP2.cc:669 )
   [ 04 ] traffic_server               Http2ConnectionState::send_headers_frame(Http2Stream*)                ( Http2ConnectionState.cc:1651 )
   [ 05 ] traffic_server               Http2Stream::update_write_request(IOBufferReader*, long, bool)        ( Http2Stream.cc:626 )
   [ 06 ] traffic_server               Http2Stream::do_io_write(Continuation*, long, IOBufferReader*, bool)  ( Http2Stream.cc:348 )
   [ 07 ] traffic_server               HttpTunnel::producer_run(HttpTunnelProducer*)                         ( HttpTunnel.cc:958 )
   [ 08 ] traffic_server               HttpTunnel::tunnel_run(HttpTunnelProducer*)                           ( HttpTunnel.cc:700 )
   [ 09 ] traffic_server               HttpSM::state_api_callout(int, void*)                                 ( HttpSM.cc:1543 )
   [ 10 ] traffic_server               HttpSM::state_api_callback(int, void*)                                ( HttpSM.cc:1350 )
   [ 11 ] traffic_server               TSHttpTxnReenable                                                     ( InkAPI.cc:6230 )
   [ 12 ] header_rewrite.so (deleted)                                                                                                                   
   ```
   
   I will try to dig into an actual core file to get some more details.  From what I can see in backtracio, the HPACK table looks ok and the index seems reasonable given the size of the map.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] shinrich commented on issue #7838: HPACK crash in 9.0.1

Posted by GitBox <gi...@apache.org>.
shinrich commented on issue #7838:
URL: https://github.com/apache/trafficserver/issues/7838#issuecomment-869784135


   Also seeing this issue in 9.1.x branch.  At this point I'm suspecting the HpackDynamicTable::_evict_overflowed_entries logic.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] maskit commented on issue #7838: HPACK crash in 9.0.1

Posted by GitBox <gi...@apache.org>.
maskit commented on issue #7838:
URL: https://github.com/apache/trafficserver/issues/7838#issuecomment-840929498


   Just to make sure, you literally mean 9.0.1 but not 9.1.0?
   
   `git diff 9.0.0 9.0.1 --stat` says there was no change under `/proxy/http2` nor `/proxy/hdr` between 9.0.0 and 9.0.1.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] shinrich commented on issue #7838: HPACK crash in 9.0.1

Posted by GitBox <gi...@apache.org>.
shinrich commented on issue #7838:
URL: https://github.com/apache/trafficserver/issues/7838#issuecomment-869784135


   Also seeing this issue in 9.1.x branch.  At this point I'm suspecting the HpackDynamicTable::_evict_overflowed_entries logic.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] shinrich commented on issue #7838: HPACK crash in 9.0.1

Posted by GitBox <gi...@apache.org>.
shinrich commented on issue #7838:
URL: https://github.com/apache/trafficserver/issues/7838#issuecomment-840898452


   Appears to be a corruption of the _headers container.
   
   ```
   (gdb) print _headers
   $1 = std::deque with 514 elements = {0x2b52f5849dd8, 0x2b52f5849db8, 0x2b52f5849d98, 0x2b52f5849d78, 0x2b52f5849d58, 0x2b52f5849d38, 
     0x2b52f5849d18, 0x2b52f5849cf8, 0x2b52f5849cd8, 0x2b52f5849cb8, 0x2b52f5849c98, 0x2b52f5849c78, 0x2b52f5849c48, 0x2b52f5849c28, 
     0x2b52f5849c08, 0x2b52f5849be8, 0x2b52f5849bc8, 0x2b52f5849ba8, 0x2b52f5849b88, Cannot access memory at address 0x45443d5354444950
   (gdb) print index
   $2 = 19
   ```
   The 19th (20th really) entry is an invalid pointer.  Looks like maybe an ascii string.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] shinrich closed issue #7838: HPACK crash in 9.0.1

Posted by GitBox <gi...@apache.org>.
shinrich closed issue #7838:
URL: https://github.com/apache/trafficserver/issues/7838


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [trafficserver] shinrich commented on issue #7838: HPACK crash in 9.0.1

Posted by GitBox <gi...@apache.org>.
shinrich commented on issue #7838:
URL: https://github.com/apache/trafficserver/issues/7838#issuecomment-842624436


   I do mean 9.0.1.  Since it is a memory override, the issue could have come from elsewhere.  Or the issue was present before as well and something else changed in our environment around that time.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org