You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by "ant5 (via GitHub)" <gi...@apache.org> on 2026/07/15 15:45:26 UTC

[I] ATS closed connections while data from origin not exhausted [trafficserver]

ant5 opened a new issue, #13389:
URL: https://github.com/apache/trafficserver/issues/13389

   I have a big delay from (quite many) sites when using ATS. In a browser the issue appeared as "hanging" for 5-20 seconds before page appears.
   
   Corresponding error in ATS log is something like
   ```
   20260715.17h54m42s CONNECT: attempt fail [CONNECTION_ERROR] to 72.167.35.147:443 for host='docs.trafficserver.apache.org' sm_id=2098 connection_result=ETIMEDOUT [60] error=ETIMEDOUT [60] retry_attempts=0 url='https://docs.trafficserver.apache.org/en/latest/_static/override.css?v=cbacab0b'
   ```
   Connections to origin (alpn) is http/1.1,http/1.0.
   
   In the access.log nothing but large times for problematic request:
   ```
   1784129931.310 6289 fd05:562e:5a23::212:2e01 TCP_MISS/200 67779 GET https://docs.trafficserver.apache.org/en/latest/_static/css/fonts/Roboto-Slab-Bold.woff2?9984f4a9bda09be08e83f2506954adbe - DIRECT/docs.trafficserver.apache.org font/woff2
   ```
   
   The strange things is on the wire. This is a tcpdump file:
   
   [ats-orig-15.07.zip](https://github.com/user-attachments/files/30054806/ats-orig-15.07.zip)
   
   Typical TCP dialog is:
   
   ```
   No.	Time	Source	Destination	Protocol	Length	Info
   17	0.627632	89.125.138.120	72.167.35.147	TCP	74	23383 → 443 [SYN] Seq=0 Win=65535 Len=0 MSS=1460 WS=64 SACK_PERM TSval=1348780720 TSecr=0
   27	0.795626	72.167.35.147	89.125.138.120	TCP	74	443 → 23383 [SYN, ACK] Seq=0 Ack=1 Win=65160 Len=0 MSS=1460 SACK_PERM TSval=1151516899 TSecr=1348780720 WS=128
   28	0.795766	89.125.138.120	72.167.35.147	TCP	66	23383 → 443 [ACK] Seq=1 Ack=1 Win=65728 Len=0 TSval=1348780890 TSecr=1151516899
   29	0.796264	89.125.138.120	72.167.35.147	TLSv1.3	808	Client Hello (SNI=docs.trafficserver.apache.org)
   42	0.964264	72.167.35.147	89.125.138.120	TCP	66	443 → 23383 [ACK] Seq=1 Ack=743 Win=64512 Len=0 TSval=1151517067 TSecr=1348780890
   43	0.965923	72.167.35.147	89.125.138.120	TLSv1.3	348	Server Hello, Change Cipher Spec, Application Data, Application Data
   44	0.966773	89.125.138.120	72.167.35.147	TLSv1.3	146	Change Cipher Spec, Application Data
   46	0.967454	89.125.138.120	72.167.35.147	TLSv1.3	759	Application Data
   63	1.134677	72.167.35.147	89.125.138.120	TCP	66	443 → 23383 [ACK] Seq=283 Ack=823 Win=64512 Len=0 TSval=1151517238 TSecr=1348781060
   64	1.135241	72.167.35.147	89.125.138.120	TLSv1.3	409	Application Data
   65	1.159851	72.167.35.147	89.125.138.120	TLSv1.3	1893	Application Data, Application Data
   66	1.159891	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   67	1.159911	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   68	1.159961	89.125.138.120	72.167.35.147	TCP	66	23383 → 443 [ACK] Seq=1516 Ack=2453 Win=63936 Len=0 TSval=1348781260 TSecr=1151517239
   69	1.159979	89.125.138.120	72.167.35.147	TCP	66	23383 → 443 [ACK] Seq=1516 Ack=5349 Win=61056 Len=0 TSval=1348781260 TSecr=1151517263
   70	1.160084	72.167.35.147	89.125.138.120	TLSv1.3	2962	Application Data, Application Data
   71	1.160100	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   72	1.160102	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   73	1.160256	89.125.138.120	72.167.35.147	TLSv1.3	90	Application Data
   74	1.160315	89.125.138.120	72.167.35.147	TCP	66	23383 → 443 [FIN, ACK] Seq=1540 Ack=5349 Win=65728 Len=0 TSval=1348781260 TSecr=1151517263
   75	1.160482	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   76	1.160675	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1516 Win=0 Len=0
   77	1.160683	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1516 Win=0 Len=0
   78	1.160686	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1516 Win=0 Len=0
   79	1.160690	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1516 Win=0 Len=0
   118	1.327955	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   119	1.327969	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   120	1.328080	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   121	1.328098	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data, Application Data
   122	1.328100	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   123	1.328103	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   124	1.328124	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1516 Win=0 Len=0
   125	1.328136	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1516 Win=0 Len=0
   126	1.328140	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1516 Win=0 Len=0
   127	1.328143	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1516 Win=0 Len=0
   128	1.328145	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1541 Win=0 Len=0
   129	1.328147	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1541 Win=0 Len=0
   130	1.328366	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   131	1.328380	72.167.35.147	89.125.138.120	TLSv1.3	1514	Application Data
   132	1.328402	72.167.35.147	89.125.138.120	TLSv1.3	738	Application Data
   133	1.328403	72.167.35.147	89.125.138.120	TCP	66	443 → 23383 [FIN, ACK] Seq=24845 Ack=1541 Win=64128 Len=0 TSval=1151517432 TSecr=1348781260
   134	1.328512	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1541 Win=0 Len=0
   135	1.328524	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1541 Win=0 Len=0
   136	1.328527	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1541 Win=0 Len=0
   137	1.328529	89.125.138.120	72.167.35.147	TCP	54	23383 → 443 [RST] Seq=1541 Win=0 Len=0
   
   ```
   
   ATS closed connection while data still arrive. Consequently TCP connection goes to TCP_FINWAIT_1 state and the system sends RST until FIN/ACK from origin.
   
   I don't fully understand how to debug this because there is no issue when browser goes to origin directly without ATS proxy.
   
   P.S. ATS 10.2.X, FreeBSD 14-STABLE.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] ATS closed connections while data from origin not exhausted [trafficserver]

Posted by "ant5 (via GitHub)" <gi...@apache.org>.
ant5 commented on issue #13389:
URL: https://github.com/apache/trafficserver/issues/13389#issuecomment-5911252002

   I have a feeling that this is the https://github.com/apache/trafficserver/issues/13605
   But it's hard to test while commit not in the main repository.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] ATS closed connections while data from origin not exhausted [trafficserver]

Posted by "ant5 (via GitHub)" <gi...@apache.org>.
ant5 commented on issue #13389:
URL: https://github.com/apache/trafficserver/issues/13389#issuecomment-4990151938

   I think this is a problematic request (from attached tcpdump):
   ```
   50	1.012233	89.125.138.120	72.167.35.147	TCP	74	17183 → 443 [SYN] Seq=0 Win=65535 Len=0 MSS=1460 WS=64 SACK_PERM TSval=3150110415 TSecr=0
   81	1.178293	72.167.35.147	89.125.138.120	TCP	74	443 → 17183 [SYN, ACK] Seq=0 Ack=1 Win=65160 Len=0 MSS=1460 SACK_PERM TSval=1151517282 TSecr=3150110415 WS=128
   82	1.178338	89.125.138.120	72.167.35.147	TCP	66	17183 → 443 [ACK] Seq=1 Ack=1 Win=65728 Len=0 TSval=3150110584 TSecr=1151517282
   84	1.178958	89.125.138.120	72.167.35.147	TLSv1.3	808	Client Hello (SNI=docs.trafficserver.apache.org)
   138	1.345052	72.167.35.147	89.125.138.120	TCP	66	443 → 17183 [ACK] Seq=1 Ack=743 Win=64512 Len=0 TSval=1151517448 TSecr=3150110584
   139	1.346444	72.167.35.147	89.125.138.120	TLSv1.3	348	Server Hello, Change Cipher Spec, Application Data, Application Data
   147	1.387015	89.125.138.120	72.167.35.147	TCP	66	17183 → 443 [ACK] Seq=743 Ack=283 Win=65472 Len=0 TSval=3150110785 TSecr=1151517450
   227	6.174034	89.125.138.120	72.167.35.147	TCP	66	17183 → 443 [FIN, ACK] Seq=743 Ack=283 Win=65728 Len=0 TSval=3150115574 TSecr=1151517450
   231	6.359658	72.167.35.147	89.125.138.120	TLSv1.3	90	Application Data
   232	6.359671	72.167.35.147	89.125.138.120	TCP	66	443 → 17183 [FIN, ACK] Seq=307 Ack=744 Win=64512 Len=0 TSval=1151522462 TSecr=3150115574
   233	6.359910	89.125.138.120	72.167.35.147	TCP	54	17183 → 443 [RST] Seq=744 Win=0 Len=0
   234	6.359929	89.125.138.120	72.167.35.147	TCP	54	17183 → 443 [RST] Seq=744 Win=0 Len=0
   ```
   
   The frustrating thing that ATS seems to send no data (request) to origin after TLS handshake and after ~5 seconds closed the connection.
   May be 5 seconds related to config "connect_attempts_timeout: 5". But connection exist.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org