You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by "Solarisbf (via GitHub)" <gi...@apache.org> on 2024/08/19 08:04:42 UTC
[I] ATS 9.2.5, TCP_MISS always on event log [trafficserver]
Solarisbf opened a new issue, #11714:
URL: https://github.com/apache/trafficserver/issues/11714
hi
i am using apache traffic server 9.2.5 with apache traffic control 8.0.1
i did curl command below many times
### **but i got TCP_MISS on event log ONLY**
**I don't know what is problem is at all
Please give me some any informations
Thank you!!!!!**
@bneradt @calavera @janfrode @biilmann @jpeach @sekimura
----------------------------------------------------------------------------------------------------------------------------------
[root@edge trafficserver]# curl -v http://127.0.0.1/bird/bird2.jpg
* Trying 127.0.0.1...
* TCP_NODELAY set
* Connected to 127.0.0.1 (127.0.0.1) port 80 (#0)
> GET /bird/bird2.jpg HTTP/1.1
> Host: 127.0.0.1
> User-Agent: curl/7.61.1
> Accept: */*
>
< HTTP/1.1 200 OK
< x-amz-id-2: luydl4Uo6K5IJgQMbFOfFOaK/GB89PWctYRUS8Js/pmrSNI8LO9DdIi8wEJHpF5tAVxL1cSCQF47cT8wzdNnoPSP0mPttcUlg9jABN8xsMg=
< x-amz-request-id: W063REMBJDKFXGNB
< Date: Mon, 19 Aug 2024 07:59:58 GMT
< Last-Modified: Mon, 29 Jul 2024 08:32:55 GMT
< ETag: "4548ff7cc8cd9263585ab163ad319391"
< x-amz-server-side-encryption: AES256
< Accept-Ranges: bytes
< Content-Type: image/jpeg
< Server: 16.1bd69fa20.el8
< Content-Length: 5240
< Age: 0
< Connection: keep-alive
< Via: https/1.1 edge.infra.ciab.test (16.1bd69fa20.el8 [uScMsSf pSeN:t cCMp sS])
<
Warning: Binary output can mess up your terminal. Use "--output -" to tell
Warning: curl to output it to your terminal anyway, or consider "--output
Warning: <FILE>" to save to a file.
* Failed writing body (0 != 5240)
* Closing connection 0
----------------------------------------------------------------------------------------------------------------------------------
1724054436.781 115 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
1724054437.248 58 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
1724054437.585 33 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
1724054437.882 31 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
1724054438.132 27 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
1724054438.403 28 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
1724054438.627 26 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
1724054438.891 29 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
1724054439.129 34 127.0.0.1 TCP_MISS/200 5757 GET https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/bird/bird2.jpg - DIRECT/jinyong-test-2.s3.ap-northeast-2.amazonaws.com image/jpeg
all my configurations are below
records.config
----------------------------------------------------------------------------------------------------------------------------------
# DO NOT EDIT - Generated for edge by t3c-generate 8.0.1..ad667bb9 from https://trafficops.infra.ciab.test:443 ips (172.20.0.15:443) on 2024-08-19T05:01:02.282879861Z
CONFIG proxy.config.admin.user_id STRING ats
CONFIG proxy.config.body_factory.template_sets_dir STRING /opt/trafficserver/etc/trafficserver/body_factory
CONFIG proxy.config.diags.debug.enabled INT 1
CONFIG proxy.config.diags.debug.tags STRING cache|http|dns
CONFIG proxy.config.dns.round_robin_nameservers INT 0
CONFIG proxy.config.exec_thread.autoconfig INT 0
CONFIG proxy.config.http.cache.http INT 1
CONFIG proxy.config.http.cache.required_headers INT 0
CONFIG proxy.config.http.connect_attempts_timeout INT 10
CONFIG proxy.config.http.enable_http_stats INT 1
CONFIG proxy.config.http.insert_response_via_str INT 3
CONFIG proxy.config.http.server_ports STRING 80 80:ipv6 443:proto=http:ssl 443:ipv6:proto=http:ssl
CONFIG proxy.config.http.slow.log.threshold INT 10000
CONFIG proxy.config.http.transaction_active_timeout_in INT 0
CONFIG proxy.config.log.logfile_dir STRING /opt/trafficserver/var/log/trafficserver
CONFIG proxy.config.log.logging_enabled INT 3
CONFIG proxy.config.log.max_space_mb_for_logs INT 512
CONFIG proxy.config.log.max_space_mb_headroom INT 50
CONFIG proxy.config.log.rolling_allow_empty INT 1
CONFIG proxy.config.log.rolling_enabled INT 1
CONFIG proxy.config.log.rolling_interval_sec INT 300
CONFIG proxy.config.log.rolling_max_count INT 10
CONFIG proxy.config.output.logfile.rolling_enabled INT 1
CONFIG proxy.config.output.logfile.rolling_min_count INT 2
CONFIG proxy.config.output.logfile.rolling_size_mb INT 500
CONFIG proxy.config.proxy_name STRING edge.infra.ciab.test
CONFIG proxy.config.reverse_proxy.enabled INT 1
CONFIG proxy.config.ssl.CA.cert.path STRING /opt/trafficserver/etc/trafficserver/ssl
CONFIG proxy.config.ssl.client.CA.cert.path STRING /opt/trafficserver/etc/trafficserver/ssl
CONFIG proxy.config.ssl.client.cert.path STRING /opt/trafficserver/etc/trafficserver/ssl
CONFIG proxy.config.ssl.client.certification_level INT 1
CONFIG proxy.config.ssl.client.private_key.path STRING /opt/trafficserver/etc/trafficserver/ssl
CONFIG proxy.config.ssl.client.verify.server.policy STRING PERMISSIVE
CONFIG proxy.config.ssl.ocsp.enabled INT 1
CONFIG proxy.config.ssl.server.cert.path STRING /opt/trafficserver/etc/trafficserver/ssl
CONFIG proxy.config.ssl.server.private_key.path STRING /opt/trafficserver/etc/trafficserver/ssl
CONFIG proxy.config.ssl.server.ticket_key.filename STRING NULL
CONFIG proxy.config.url_remap.pristine_host_hdr INT 0
CONFIG proxy.config.url_remap.remap_required INT 1
LOCAL proxy.local.outgoing_ip_to_bind STRING 172.20.0.16
CONFIG proxy.config.http.request_via_str STRING 16.1bd69fa20.el8
CONFIG proxy.config.http.response_via_str STRING 16.1bd69fa20.el8
CONFIG proxy.config.http.response_server_str STRING 16.1bd69fa20.el8
----------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------
remap.config
# DO NOT EDIT - Generated for edge by t3c-generate 8.0.1..ad667bb9 from https://trafficops.infra.ciab.test:443 ips (172.20.0.15:443) on 2024-08-16T07:51:01.584418133Z
map http://edge.demo1.mycdn.ciab.test/ http://origin.infra.ciab.test/ @plugin=header_rewrite.so @pparam=dscp/set_dscp_0.config # ds 'demo1' topology 'demo1-top'
map https://edge.demo1.mycdn.ciab.test/ http://origin.infra.ciab.test/ @plugin=header_rewrite.so @pparam=dscp/set_dscp_0.config # ds 'demo1' topology 'demo1-top'
map http://edge.test8282.mycdn.ciab.test/ https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/ @plugin=header_rewrite.so @pparam=dscp/set_dscp_0.config # ds 'test8282' topology 'test1234-topology'
map https://edge.test8282.mycdn.ciab.test/ https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/ @plugin=header_rewrite.so @pparam=dscp/set_dscp_0.config # ds 'test8282' topology 'test1234-topology'
map http://edge.test9999.mycdn.ciab.test/ https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/ @plugin=header_rewrite.so @pparam=dscp/set_dscp_0.config # ds 'test9999' topology 'test1234-topology'
map https://edge.test9999.mycdn.ciab.test/ https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com/ @plugin=header_rewrite.so @pparam=dscp/set_dscp_0.config # ds 'test9999' topology 'test1234-topology'
map http://video.demo2.mycdn.ciab.test/ http://origin.infra.ciab.test/ @plugin=header_rewrite.so @pparam=dscp/set_dscp_0.config # ds 'demo2' topology 'demo1-top'
map https://video.demo2.mycdn.ciab.test/ http://origin.infra.ciab.test/ @plugin=header_rewrite.so @pparam=dscp/set_dscp_0.config # ds 'demo2' topology 'demo1-top'
map http://127.0.0.1/ https://jinyong-test-2.s3.ap-northeast-2.amazonaws.com
----------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------
storage.config is below
# DO NOT EDIT - Generated for edge by t3c-generate 8.0.1..ad667bb9 from https://trafficops.infra.ciab.test:443 ips (172.20.0.15:443) on 2024-08-19T06:05:03.042930916Z
/var/trafficserver/cache volume=1
----------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------
hosting.config
# DO NOT EDIT - Generated for edge by t3c-generate 8.0.1..ad667bb9 from https://trafficops.infra.ciab.test:443 ips (172.20.0.15:443) on 2024-08-13T04:06:48.56340875Z
hostname=* volume=1
----------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------
volume.config
# DO NOT EDIT - Generated for edge by t3c-generate 8.0.1..ad667bb9 from https://trafficops.infra.ciab.test:443 ips (172.20.0.15:443) on 2024-08-19T05:54:01.922219978Z
# TRAFFIC OPS NOTE: This is running with forced volumes - the size is irrelevant
volume=1 scheme=http size=100%
----------------------------------------------------------------------------------------------------------------------------------
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ATS 9.2.5, `TCP_MISS` always on event log [trafficserver]
Posted by "bneradt (via GitHub)" <gi...@apache.org>.
bneradt commented on issue #11714:
URL: https://github.com/apache/trafficserver/issues/11714#issuecomment-2297622461
> CONFIG proxy.config.diags.debug.enabled INT 1
> CONFIG proxy.config.diags.debug.tags STRING cache|http|dns
Can you check these cache/http debug logs? That should be pretty explicit about ATS caching logic for these transactions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ATS 9.2.5, `TCP_MISS` always on event log [trafficserver]
Posted by "Solarisbf (via GitHub)" <gi...@apache.org>.
Solarisbf commented on issue #11714:
URL: https://github.com/apache/trafficserver/issues/11714#issuecomment-2297682241
hello @bneradt
i checked diags.log as you mention
------------------------------------------------------------------------------------------------------------------------
[Aug 19 23:08:12.916] traffic_server STATUS: opened /opt/trafficserver/var/log/trafficserver/diags.log
[Aug 19 23:08:12.916] traffic_server NOTE: updated diags config
[Aug 19 23:08:12.919] traffic_server NOTE: storage.config loading ...
[Aug 19 23:08:12.920] traffic_server WARNING: unable to open '/opt/trafficserver/var/trafficserver/cache': No such file or directory
[Aug 19 23:08:12.920] traffic_server WARNING: could not initialize storage "/opt/trafficserver/var/trafficserver/cache" [file not found]
[Aug 19 23:08:12.921] traffic_server NOTE: storage.config finished loading
[Aug 19 23:08:12.922] traffic_server NOTE: ip_allow.yaml loading ...
[Aug 19 23:08:12.923] traffic_server NOTE: ip_allow.yaml finished loading
[Aug 19 23:08:12.923] traffic_server NOTE: parent.config loading ...
[Aug 19 23:08:12.923] traffic_server NOTE: parent.config finished loading
[Aug 19 23:08:12.924] traffic_server NOTE: /opt/trafficserver/etc/trafficserver/logging.yaml loading ...
[Aug 19 23:08:12.925] traffic_server NOTE: /opt/trafficserver/etc/trafficserver/logging.yaml finished loading
[Aug 19 23:08:12.927] traffic_server NOTE: logging initialized[3], logging_mode = 3
[Aug 19 23:08:12.927] traffic_server NOTE: Initialized plugin_dynamic_reload_mode: 1
[Aug 19 23:08:12.927] traffic_server NOTE: plugin.config loading ...
[Aug 19 23:08:12.927] traffic_server NOTE: loading plugin '/opt/trafficserver/libexec/trafficserver/astats_over_http.so'
[Aug 19 23:08:12.927] traffic_server NOTE: loading plugin '/opt/trafficserver/libexec/trafficserver/regex_revalidate.so'
[Aug 19 23:08:12.927] traffic_server NOTE: loading plugin '/opt/trafficserver/libexec/trafficserver/remap_stats.so'
[Aug 19 23:08:12.928] traffic_server NOTE: plugin.config finished loading
[Aug 19 23:08:12.929] traffic_server NOTE: /opt/trafficserver/etc/trafficserver/sni.yaml loading ...
[Aug 19 23:08:12.929] traffic_server NOTE: /opt/trafficserver/etc/trafficserver/sni.yaml finished loading
[Aug 19 23:08:12.929] traffic_server NOTE: ssl_multicert.config loading ...
[Aug 19 23:08:12.930] traffic_server NOTE: cannot get issuer certificate from /opt/trafficserver/etc/trafficserver/ssl/cdn_test8282_mycdn_ciab_test_cert.cer
[Aug 19 23:08:12.930] traffic_server WARNING: failed to configure SSL_CTX for OCSP Stapling info for certificate at /opt/trafficserver/etc/trafficserver/ssl/cdn_test8282_mycdn_ciab_test_cert.cer
[Aug 19 23:08:12.936] traffic_server NOTE: cannot get issuer certificate from /opt/trafficserver/etc/trafficserver/ssl/cdn_test9999_mycdn_ciab_test_cert.cer
[Aug 19 23:08:12.936] traffic_server WARNING: failed to configure SSL_CTX for OCSP Stapling info for certificate at /opt/trafficserver/etc/trafficserver/ssl/cdn_test9999_mycdn_ciab_test_cert.cer
[Aug 19 23:08:12.942] traffic_server NOTE: cannot get issuer certificate from /opt/trafficserver/etc/trafficserver/ssl/video_demo1_mycdn_ciab_test_cert.cer
[Aug 19 23:08:12.942] traffic_server WARNING: failed to configure SSL_CTX for OCSP Stapling info for certificate at /opt/trafficserver/etc/trafficserver/ssl/video_demo1_mycdn_ciab_test_cert.cer
[Aug 19 23:08:12.949] traffic_server NOTE: cannot get issuer certificate from /opt/trafficserver/etc/trafficserver/ssl/video_demo2_mycdn_ciab_test_cert.cer
[Aug 19 23:08:12.949] traffic_server WARNING: failed to configure SSL_CTX for OCSP Stapling info for certificate at /opt/trafficserver/etc/trafficserver/ssl/video_demo2_mycdn_ciab_test_cert.cer
[Aug 19 23:08:12.960] traffic_server NOTE: /opt/trafficserver/etc/trafficserver/ssl_multicert.config finished loading
[Aug 19 23:08:12.962] traffic_server NOTE: volume.config loading ...
[Aug 19 23:08:12.962] [ET_OCSP 0] NOTE: OCSP refresh started
[Aug 19 23:08:12.962] traffic_server NOTE: volume.config finished loading
[Aug 19 23:08:12.962] [ET_OCSP 0] NOTE: OCSP refresh finished
### **[Aug 19 23:08:12.962] traffic_server WARNING: unable to open cache disk(s): Cache Disabled**
[Aug 19 23:08:12.963] traffic_server NOTE: remap.config loading ...
[Aug 19 23:08:12.963] traffic_server NOTE: strategies.yaml loading ...
[Aug 19 23:08:12.964] traffic_server NOTE: strategies.yaml finished loading
[Aug 19 23:08:12.967] traffic_server NOTE: remap.config finished loading
[Aug 19 23:08:12.970] traffic_server NOTE: Traffic Server is fully initialized.
[Aug 19 23:08:12.971] [TS_MAIN] NOTE: traffic server running
------------------------------------------------------------------------------------------------------------------------
i found Cache Disabled !!
so i created `/var/trafficserver` directory
and executed `chown ats:ats /var/trafficserver`
[root@edge var]# pwd
/var
[root@edge var]# ls -al
total 4
drwxr-xr-x 1 root root 86 Aug 19 23:15 .
drwxr-xr-x 1 root root 127 Aug 13 04:05 ..
drwxr-xr-x 2 root root 6 Oct 11 2021 adm
drwxr-xr-x 1 root root 17 Nov 19 2023 cache
drwxr-xr-x 2 root root 6 Oct 11 2021 db
drwxr-xr-x 2 root root 6 Oct 11 2021 empty
drwxr-xr-x 2 root root 6 Oct 11 2021 ftp
drwxr-xr-x 2 root root 6 Oct 11 2021 games
drwxr-xr-x 2 root root 6 Oct 11 2021 gopher
drwxr-xr-x 1 root root 18 Jul 2 20:48 kerberos
drwxr-xr-x 1 root root 80 Aug 13 03:40 lib
drwxr-xr-x 2 root root 6 Oct 11 2021 local
lrwxrwxrwx 1 root root 11 Nov 19 2023 lock -> ../run/lock
drwxr-xr-x 1 root root 4096 Aug 19 15:53 log
lrwxrwxrwx 1 root root 10 Oct 11 2021 mail -> spool/mail
drwxr-xr-x 2 root root 6 Oct 11 2021 nis
drwxr-xr-x 2 root root 6 Oct 11 2021 opt
drwxr-xr-x 2 root root 6 Oct 11 2021 preserve
lrwxrwxrwx 1 root root 6 Nov 19 2023 run -> ../run
drwxr-xr-x 1 root root 33 Aug 13 03:39 spool
drwxrwxrwt 1 root root 6 Aug 19 23:18 tmp
### drwxr-xr-x 2 ats ats 6 Aug 19 23:15 trafficserver
and i restarted traffic server ( systemctl restart trafficserver )
but same as well
[Aug 19 23:20:28.498] traffic_server WARNING: unable to open cache disk(s): Cache Disabled
[Aug 19 23:20:28.499] traffic_server NOTE: remap.config loading ...
[Aug 19 23:20:28.499] traffic_server NOTE: strategies.yaml loading ...
[Aug 19 23:20:28.501] traffic_server NOTE: strategies.yaml finished loading
[Aug 19 23:20:28.503] traffic_server NOTE: remap.config finished loading
[Aug 19 23:20:28.506] traffic_server NOTE: Traffic Server is fully initialized.
[Aug 19 23:20:28.508] [TS_MAIN] NOTE: traffic server running
### i don't know why apache traffic server 9.2.5 cannot create cache file.
thanks a lot @bneradt
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ATS 9.2.5, `TCP_MISS` always on event log [trafficserver]
Posted by "Solarisbf (via GitHub)" <gi...@apache.org>.
Solarisbf closed issue #11714: ATS 9.2.5, `TCP_MISS` always on event log
URL: https://github.com/apache/trafficserver/issues/11714
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ATS 9.2.5, `TCP_MISS` always on event log [trafficserver]
Posted by "bneradt (via GitHub)" <gi...@apache.org>.
bneradt commented on issue #11714:
URL: https://github.com/apache/trafficserver/issues/11714#issuecomment-2297734330
@Solarisbf : actually, the debug logs will be not be in diags.log. It's generally in traffic.out, but may simply be in stdout/stderr depending upon configuration. Those debug tag logs will have pretty explicit caching logic.
Thank you for the quick reply.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] ATS 9.2.5, `TCP_MISS` always on event log [trafficserver]
Posted by "Solarisbf (via GitHub)" <gi...@apache.org>.
Solarisbf commented on issue #11714:
URL: https://github.com/apache/trafficserver/issues/11714#issuecomment-2300253603
> @Solarisbf : actually, the debug logs will be not be in diags.log. It's generally in traffic.out, but may simply be in stdout/stderr depending upon configuration. Those debug tag logs will have pretty explicit caching logic.
>
> Thank you for the quick reply.
hello @bneradt
i checked traffic.out as you metion
and i got what is the problem exactly
it was memory allocation issue about ats 9.2.5 on docker container by apache traffic control 8.0.1 cdn-in-a-box
thank you for your clear help !! @bneradt
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@trafficserver.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org