You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@trafficserver.apache.org by Milos Dodic <2b...@gmail.com> on 2021/02/17 00:37:43 UTC
Basic caching setup?
Basic caching setup?
I am trying to have the most basic caching setup for a forward caching
proxy. Initially I tried changing the following options only:
CONFIG proxy.config.http.cache.http INT 1
CONFIG proxy.config.reverse_proxy.enabled INT 0
CONFIG proxy.config.url_remap.remap_required INT 0
I had no luck. After trying out a few things, I ended with something like
this:
CONFIG proxy.config.http.cache.http INT 1
CONFIG proxy.config.reverse_proxy.enabled INT 0
CONFIG proxy.config.url_remap.remap_required INT 0
CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
CONFIG proxy.config.http.cache.ignore_authentication INT 1
CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and 2)
CONFIG proxy.config.http.push_method_enabled INT 1
Again, no luck. All I got was lots of MISS, and nothing was cached.
I tried to cache by using the custom app with a forward proxy set to target
the ATS, and later by simply trying to curl na object from AWS S3 (https).
In the end, I brought up an Apache web server, and tried curling the basic
http index page. Still, nothing was cached.
How can I have the most basic setup in place (at least for now), that will
cache stuff like me pulling the index page from the apache web server? Or
cache everything even?
What am I missing?
Thanks!
Re: [E] Basic caching setup?
Posted by Leif Hedstrom <zw...@apache.org>.
Like I said, the default HTTPD would not send cache-control headers.
— leif
> On Feb 17, 2021, at 8:16 AM, Alan Carroll <so...@verizonmedia.com> wrote:
>
> Hmmm. I would enable debug tags and add the "cache" tag. That should give you information on why the cache isn't caching. You can also chat with us at the-asf.slack.com <http://the-asf.slack.com/>, channel "#trafficserver".
>
> On Wed, Feb 17, 2021 at 9:13 AM Milos Dodic <2bearqloza@gmail.com <ma...@gmail.com>> wrote:
> I already had cache defined in storage.config. As for volume.config, I've added volumes, but it didn't change much (seems like an option to segment the overall storage for cache).
>
> On Wed, Feb 17, 2021 at 3:57 PM Alan Carroll <solidwallofcode@verizonmedia.com <ma...@verizonmedia.com>> wrote:
> You need to set up the "storage.config" and "volume.config" files to specify the storage used to cache the objects.
>
> On Tue, Feb 16, 2021 at 6:38 PM Milos Dodic <2bearqloza@gmail.com <ma...@gmail.com>> wrote:
> Basic caching setup?
>
>
> I am trying to have the most basic caching setup for a forward caching proxy. Initially I tried changing the following options only:
>
> CONFIG proxy.config.http.cache.http INT 1
> CONFIG proxy.config.reverse_proxy.enabled INT 0
> CONFIG proxy.config.url_remap.remap_required INT 0
>
> I had no luck. After trying out a few things, I ended with something like this:
>
> CONFIG proxy.config.http.cache.http INT 1
> CONFIG proxy.config.reverse_proxy.enabled INT 0
> CONFIG proxy.config.url_remap.remap_required INT 0
> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
> CONFIG proxy.config.http.cache.ignore_authentication INT 1
> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and 2)
> CONFIG proxy.config.http.push_method_enabled INT 1
>
> Again, no luck. All I got was lots of MISS, and nothing was cached.
> I tried to cache by using the custom app with a forward proxy set to target the ATS, and later by simply trying to curl na object from AWS S3 (https). In the end, I brought up an Apache web server, and tried curling the basic http index page. Still, nothing was cached.
>
> How can I have the most basic setup in place (at least for now), that will cache stuff like me pulling the index page from the apache web server? Or cache everything even?
> What am I missing?
>
>
> Thanks!
Re: [E] Basic caching setup?
Posted by Alan Carroll <so...@verizonmedia.com>.
Setting
https://docs.trafficserver.apache.org/en/9.0.x/admin-guide/files/records.config.en.html#proxy-config-http-cache-required-headers
proxy.config.http.cache.required_headers to "INT 0" should enable caching
of those objects.
On Wed, Feb 17, 2021 at 9:49 AM Milos Dodic <2b...@gmail.com> wrote:
> So this is the issue on http server side, not being configured for caching
> basically?
> Nothing to do with the ATS itself?
>
> On Wed, Feb 17, 2021 at 4:41 PM Alan Carroll <
> solidwallofcode@verizonmedia.com> wrote:
>
>> It looks like you enabled the "http" debug tag but not the "cache" debug
>> tag. That said, given the "Will NOT do cache lookup", I suspect Leif is
>> correct. OTOH I do see
>>
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4696
>> (do_cache_prepare_action)> (http_cache_write) [35] writing to cache with
>> URL http://10.10.0.213/
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <P_CacheInternal.h:566 (new_CacheVC)> (cache_new) new 0x7fa8b8284bb0
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
>> (key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
>> 10.10.0.213
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:177
>> (state_cache_open_write)> (http_cache) [35]
>> [&HttpCacheSM::state_cache_open_write, CACHE_EVENT_OPEN_WRITE]
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
>> (main_handler)> (http) [35] [HttpSM::main_handler, CACHE_EVENT_OPEN_WRITE]
>>
>> which indicates an attempt to write to cache, but then
>>
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:6423 (is_response_cacheable)> (http_trans) [35]
>> [is_response_cacheable] NO by default
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4264 (handle_cache_operation_on_forward_server_response)>
>> (http_trans) [35] [hcoofsr] response is not cacheable
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4407 (handle_cache_operation_on_forward_server_response)>
>> (http_trans) [35] [hcoofsr] response code: 403
>>
>> which indicates it's not being cached because it's a negative response.
>>
>>
>> On Wed, Feb 17, 2021 at 9:34 AM Milos Dodic <2b...@gmail.com> wrote:
>>
>>> I have enabled cache tags for debugging, here is the parsed traffic.out
>>> log (looking at cache lines only):
>>>
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1996 (DecideCacheLookup)> (http_trans) [31]
>>> [DecideCacheLookup] Will NOT do cache lookup.
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1997 (DecideCacheLookup)> (http_seq) [31]
>>> [DecideCacheLookup] Will NOT do cache lookup
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:2019 (DecideCacheLookup)> (http_trans) Next action
>>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [31] State Transition:
>>> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [31] State Transition:
>>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:7953 (build_request)> (http_trans) [31] [build_request]
>>> request like cacheable and conditional headers removed
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4145 (handle_forward_server_connection_open)> (http_trans)
>>> [31] [hfsco] cache action: CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4708
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
>>> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4709
>>> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [31]
>>> [handle_no_cache_operation_on_forward_server_response]
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4716
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
>>> [hncoofsr] server sent back 200
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4723
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
>>> [hncoofsr] next action will be OS_READ_CACHE_NOOP
>>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>>> (perform_cache_write_action)> (http) [31] perform_cache_write_action
>>> CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1996 (DecideCacheLookup)> (http_trans) [32]
>>> [DecideCacheLookup] Will NOT do cache lookup.
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1997 (DecideCacheLookup)> (http_seq) [32]
>>> [DecideCacheLookup] Will NOT do cache lookup
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:2019 (DecideCacheLookup)> (http_trans) Next action
>>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [32] State Transition:
>>> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [32] State Transition:
>>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:7953 (build_request)> (http_trans) [32] [build_request]
>>> request like cacheable and conditional headers removed
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4145 (handle_forward_server_connection_open)> (http_trans)
>>> [32] [hfsco] cache action: CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4708
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
>>> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4709
>>> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [32]
>>> [handle_no_cache_operation_on_forward_server_response]
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4716
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
>>> [hncoofsr] server sent back 200
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4723
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
>>> [hncoofsr] next action will be OS_READ_CACHE_NOOP
>>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>>> (perform_cache_write_action)> (http) [32] perform_cache_write_action
>>> CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1048
>>> (mainEvent)> (cache_dir_sync) sync started
>>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1056
>>> (mainEvent)> (cache_dir_sync) Dir /test/cache/cache.db 16384:65536 not dirty
>>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1048
>>> (mainEvent)> (cache_dir_sync) sync started
>>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1056
>>> (mainEvent)> (cache_dir_sync) Dir /test/cache/cache.db 536887296:32768 not
>>> dirty
>>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1006
>>> (mainEvent)> (cache_dir_sync) sync done
>>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1996 (DecideCacheLookup)> (http_trans) [33]
>>> [DecideCacheLookup] Will NOT do cache lookup.
>>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1997 (DecideCacheLookup)> (http_seq) [33]
>>> [DecideCacheLookup] Will NOT do cache lookup
>>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:2019 (DecideCacheLookup)> (http_trans) Next action
>>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
>>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [33] State Transition:
>>> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
>>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [33] State Transition:
>>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
>>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:7953 (build_request)> (http_trans) [33] [build_request]
>>> request like cacheable and conditional headers removed
>>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4145 (handle_forward_server_connection_open)> (http_trans)
>>> [33] [hfsco] cache action: CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4708
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
>>> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
>>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4709
>>> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [33]
>>> [handle_no_cache_operation_on_forward_server_response]
>>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4716
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
>>> [hncoofsr] server sent back 200
>>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4723
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
>>> [hncoofsr] next action will be OS_READ_CACHE_NOOP
>>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>>> (perform_cache_write_action)> (http) [33] perform_cache_write_action
>>> CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1996 (DecideCacheLookup)> (http_trans) [34]
>>> [DecideCacheLookup] Will NOT do cache lookup.
>>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1997 (DecideCacheLookup)> (http_seq) [34]
>>> [DecideCacheLookup] Will NOT do cache lookup
>>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:2019 (DecideCacheLookup)> (http_trans) Next action
>>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
>>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [34] State Transition:
>>> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
>>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [34] State Transition:
>>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
>>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:7953 (build_request)> (http_trans) [34] [build_request]
>>> request like cacheable and conditional headers removed
>>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4145 (handle_forward_server_connection_open)> (http_trans)
>>> [34] [hfsco] cache action: CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4708
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
>>> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
>>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4709
>>> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [34]
>>> [handle_no_cache_operation_on_forward_server_response]
>>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4716
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
>>> [hncoofsr] server sent back 200
>>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4723
>>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
>>> [hncoofsr] next action will be OS_READ_CACHE_NOOP
>>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>>> (perform_cache_write_action)> (http) [34] perform_cache_write_action
>>> CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1948 (DecideCacheLookup)> (http_trans) [35]
>>> [DecideCacheLookup] Will do cache lookup.
>>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1949 (DecideCacheLookup)> (http_seq) [35]
>>> [DecideCacheLookup] Will do cache lookup
>>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1992 (DecideCacheLookup)> (http_trans) Next action
>>> SM_ACTION_CACHE_LOOKUP; nullptr
>>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [35] State Transition:
>>> SM_ACTION_API_POST_REMAP -> SM_ACTION_CACHE_LOOKUP
>>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4569
>>> (do_cache_lookup_and_read)> (http_seq) [HttpSM::do_cache_lookup_and_read]
>>> [35] Issuing cache lookup for URL http://10.10.0.213/
>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
>>> (key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
>>> 10.10.0.213
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:118
>>> (state_cache_open_read)> (http_cache) [35]
>>> [&HttpCacheSM::state_cache_open_read, CACHE_EVENT_OPEN_READ_FAILED]
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
>>> (main_handler)> (http) [35] [HttpSM::main_handler,
>>> CACHE_EVENT_OPEN_READ_FAILED]
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2607
>>> (state_cache_open_read)> (http) [35] [&HttpSM::state_cache_open_read,
>>> CACHE_EVENT_OPEN_READ_FAILED]
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2641
>>> (state_cache_open_read)> (http) [35] cache_open_read -
>>> CACHE_EVENT_OPEN_READ_FAILED with ECACHE_NO_DOC (-20400)
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2643
>>> (state_cache_open_read)> (http) [state_cache_open_read] open read failed.
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:2205 (HandleCacheOpenRead)> (http_trans) [35]
>>> [HttpTransact::HandleCacheOpenRead]
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:2235 (HandleCacheOpenRead)> (http_trans) [35]
>>> CacheOpenRead -- miss
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:3122 (HandleCacheOpenReadMiss)> (http_trans) [35]
>>> [HandleCacheOpenReadMiss] --- MISS
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:3124 (HandleCacheOpenReadMiss)> (http_seq) [35]
>>> [HttpTransact::HandleCacheOpenReadMiss] Miss in cache
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:3200 (HandleCacheOpenReadMiss)> (http_trans) Next action
>>> SM_ACTION_DNS_LOOKUP; OSDNSLookup
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [35] State Transition:
>>> SM_ACTION_CACHE_LOOKUP -> SM_ACTION_DNS_LOOKUP
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:1846 (OSDNSLookup)> (http_trans) Next action
>>> SM_ACTION_API_OS_DNS; HandleCacheOpenReadMiss
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:3122 (HandleCacheOpenReadMiss)> (http_trans) [35]
>>> [HandleCacheOpenReadMiss] --- MISS
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:3124 (HandleCacheOpenReadMiss)> (http_seq) [35]
>>> [HttpTransact::HandleCacheOpenReadMiss] Miss in cache
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:7953 (build_request)> (http_trans) [35] [build_request]
>>> request like cacheable and conditional headers removed
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [35] State Transition:
>>> SM_ACTION_API_OS_DNS -> SM_ACTION_CACHE_ISSUE_WRITE
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4696
>>> (do_cache_prepare_action)> (http_cache_write) [35] writing to cache with
>>> URL http://10.10.0.213/
>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <P_CacheInternal.h:566 (new_CacheVC)> (cache_new) new 0x7fa8b8284bb0
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
>>> (key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
>>> 10.10.0.213
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:177
>>> (state_cache_open_write)> (http_cache) [35]
>>> [&HttpCacheSM::state_cache_open_write, CACHE_EVENT_OPEN_WRITE]
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
>>> (main_handler)> (http) [35] [HttpSM::main_handler, CACHE_EVENT_OPEN_WRITE]
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2488
>>> (state_cache_open_write)> (http) [35] [&HttpSM : state_cache_open_write,
>>> CACHE_EVENT_OPEN_WRITE]
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:3088 (handle_cache_write_lock)> (http_trans) Next action
>>> next; nullptr
>>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>>> (call_transact_and_set_next_state)> (http) [35] State Transition:
>>> SM_ACTION_CACHE_ISSUE_WRITE -> SM_ACTION_ORIGIN_SERVER_OPEN
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4124 (handle_forward_server_connection_open)> (http_trans)
>>> [35] [hfsco] cache action: CACHE_DO_WRITE
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4254 (handle_cache_operation_on_forward_server_response)>
>>> (http_trans) [35] [handle_cache_operation_on_forward_server_response]
>>> (hcoofsr)
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4255 (handle_cache_operation_on_forward_server_response)>
>>> (http_seq) [35] [handle_cache_operation_on_forward_server_response]
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:6308 (is_response_cacheable)> (http_trans) [35]
>>> [is_response_cacheable] client permits storing
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:6423 (is_response_cacheable)> (http_trans) [35]
>>> [is_response_cacheable] NO by default
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4264 (handle_cache_operation_on_forward_server_response)>
>>> (http_trans) [35] [hcoofsr] response is not cacheable
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>>> <HttpTransact.cc:4407 (handle_cache_operation_on_forward_server_response)>
>>> (http_trans) [35] [hcoofsr] response code: 403
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>>> (perform_cache_write_action)> (http) [35] perform_cache_write_action
>>> CACHE_DO_NO_ACTION
>>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>>> <P_CacheInternal.h:578 (free_CacheVC)> (cache_free) free 0x7fa8b8284bb0
>>>
>>>
>>>
>>> I see CACHE_DO_NO_ACTION and response is not cacheable. I am curling an
>>> index page (default index) on Apache web server, fresh install.
>>>
>>> On Wed, Feb 17, 2021 at 4:17 PM Alan Carroll <
>>> solidwallofcode@verizonmedia.com> wrote:
>>>
>>>> Hmmm. I would enable debug tags and add the "cache" tag. That should
>>>> give you information on why the cache isn't caching. You can also chat with
>>>> us at the-asf.slack.com
>>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__the-2Dasf.slack.com&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=irsYt8PCQN3eRwH3Lz4lsWSyZ4Ln4hwNog9_VgFJ8U8&e=>,
>>>> channel "#trafficserver".
>>>>
>>>> On Wed, Feb 17, 2021 at 9:13 AM Milos Dodic <2b...@gmail.com>
>>>> wrote:
>>>>
>>>>> I already had cache defined in storage.config. As for volume.config,
>>>>> I've added volumes, but it didn't change much (seems like an option to
>>>>> segment the overall storage for cache).
>>>>>
>>>>> On Wed, Feb 17, 2021 at 3:57 PM Alan Carroll <
>>>>> solidwallofcode@verizonmedia.com> wrote:
>>>>>
>>>>>> You need to set up the "storage.config" and "volume.config" files to
>>>>>> specify the storage used to cache the objects.
>>>>>>
>>>>>> On Tue, Feb 16, 2021 at 6:38 PM Milos Dodic <2b...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Basic caching setup?
>>>>>>>
>>>>>>>
>>>>>>> I am trying to have the most basic caching setup for a forward
>>>>>>> caching proxy. Initially I tried changing the following options only:
>>>>>>>
>>>>>>> CONFIG proxy.config.http.cache.http INT 1
>>>>>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>>>>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>>>>>
>>>>>>> I had no luck. After trying out a few things, I ended with something
>>>>>>> like this:
>>>>>>>
>>>>>>> CONFIG proxy.config.http.cache.http INT 1
>>>>>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>>>>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>>>>> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
>>>>>>> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
>>>>>>> CONFIG proxy.config.http.cache.ignore_authentication INT 1
>>>>>>> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
>>>>>>> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
>>>>>>> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and
>>>>>>> 2)
>>>>>>> CONFIG proxy.config.http.push_method_enabled INT 1
>>>>>>>
>>>>>>> Again, no luck. All I got was lots of MISS, and nothing was cached.
>>>>>>> I tried to cache by using the custom app with a forward proxy set to
>>>>>>> target the ATS, and later by simply trying to curl na object from AWS S3
>>>>>>> (https). In the end, I brought up an Apache web server, and tried curling
>>>>>>> the basic http index page. Still, nothing was cached.
>>>>>>>
>>>>>>> How can I have the most basic setup in place (at least for now),
>>>>>>> that will cache stuff like me pulling the index page from the apache web
>>>>>>> server? Or cache everything even?
>>>>>>> What am I missing?
>>>>>>>
>>>>>>>
>>>>>>> Thanks!
>>>>>>>
>>>>>>
Re: [E] Basic caching setup?
Posted by Milos Dodic <2b...@gmail.com>.
So this is the issue on http server side, not being configured for caching
basically?
Nothing to do with the ATS itself?
On Wed, Feb 17, 2021 at 4:41 PM Alan Carroll <
solidwallofcode@verizonmedia.com> wrote:
> It looks like you enabled the "http" debug tag but not the "cache" debug
> tag. That said, given the "Will NOT do cache lookup", I suspect Leif is
> correct. OTOH I do see
>
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4696
> (do_cache_prepare_action)> (http_cache_write) [35] writing to cache with
> URL http://10.10.0.213/
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
> <P_CacheInternal.h:566 (new_CacheVC)> (cache_new) new 0x7fa8b8284bb0
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
> (key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
> 10.10.0.213
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:177
> (state_cache_open_write)> (http_cache) [35]
> [&HttpCacheSM::state_cache_open_write, CACHE_EVENT_OPEN_WRITE]
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
> (main_handler)> (http) [35] [HttpSM::main_handler, CACHE_EVENT_OPEN_WRITE]
>
> which indicates an attempt to write to cache, but then
>
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:6423
> (is_response_cacheable)> (http_trans) [35] [is_response_cacheable] NO by
> default
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4264
> (handle_cache_operation_on_forward_server_response)> (http_trans) [35]
> [hcoofsr] response is not cacheable
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4407
> (handle_cache_operation_on_forward_server_response)> (http_trans) [35]
> [hcoofsr] response code: 403
>
> which indicates it's not being cached because it's a negative response.
>
>
> On Wed, Feb 17, 2021 at 9:34 AM Milos Dodic <2b...@gmail.com> wrote:
>
>> I have enabled cache tags for debugging, here is the parsed traffic.out
>> log (looking at cache lines only):
>>
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1996 (DecideCacheLookup)> (http_trans) [31]
>> [DecideCacheLookup] Will NOT do cache lookup.
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1997 (DecideCacheLookup)> (http_seq) [31]
>> [DecideCacheLookup] Will NOT do cache lookup
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:2019 (DecideCacheLookup)> (http_trans) Next action
>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [31] State Transition:
>> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [31] State Transition:
>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:7953 (build_request)> (http_trans) [31] [build_request]
>> request like cacheable and conditional headers removed
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4145 (handle_forward_server_connection_open)> (http_trans)
>> [31] [hfsco] cache action: CACHE_DO_NO_ACTION
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4708
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
>> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4709
>> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [31]
>> [handle_no_cache_operation_on_forward_server_response]
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4716
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
>> [hncoofsr] server sent back 200
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4723
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
>> [hncoofsr] next action will be OS_READ_CACHE_NOOP
>> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>> (perform_cache_write_action)> (http) [31] perform_cache_write_action
>> CACHE_DO_NO_ACTION
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1996 (DecideCacheLookup)> (http_trans) [32]
>> [DecideCacheLookup] Will NOT do cache lookup.
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1997 (DecideCacheLookup)> (http_seq) [32]
>> [DecideCacheLookup] Will NOT do cache lookup
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:2019 (DecideCacheLookup)> (http_trans) Next action
>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [32] State Transition:
>> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [32] State Transition:
>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:7953 (build_request)> (http_trans) [32] [build_request]
>> request like cacheable and conditional headers removed
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4145 (handle_forward_server_connection_open)> (http_trans)
>> [32] [hfsco] cache action: CACHE_DO_NO_ACTION
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4708
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
>> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4709
>> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [32]
>> [handle_no_cache_operation_on_forward_server_response]
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4716
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
>> [hncoofsr] server sent back 200
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4723
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
>> [hncoofsr] next action will be OS_READ_CACHE_NOOP
>> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>> (perform_cache_write_action)> (http) [32] perform_cache_write_action
>> CACHE_DO_NO_ACTION
>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1048
>> (mainEvent)> (cache_dir_sync) sync started
>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1056
>> (mainEvent)> (cache_dir_sync) Dir /test/cache/cache.db 16384:65536 not dirty
>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1048
>> (mainEvent)> (cache_dir_sync) sync started
>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1056
>> (mainEvent)> (cache_dir_sync) Dir /test/cache/cache.db 536887296:32768 not
>> dirty
>> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1006
>> (mainEvent)> (cache_dir_sync) sync done
>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1996 (DecideCacheLookup)> (http_trans) [33]
>> [DecideCacheLookup] Will NOT do cache lookup.
>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1997 (DecideCacheLookup)> (http_seq) [33]
>> [DecideCacheLookup] Will NOT do cache lookup
>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:2019 (DecideCacheLookup)> (http_trans) Next action
>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [33] State Transition:
>> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [33] State Transition:
>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
>> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:7953 (build_request)> (http_trans) [33] [build_request]
>> request like cacheable and conditional headers removed
>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4145 (handle_forward_server_connection_open)> (http_trans)
>> [33] [hfsco] cache action: CACHE_DO_NO_ACTION
>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4708
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
>> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4709
>> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [33]
>> [handle_no_cache_operation_on_forward_server_response]
>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4716
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
>> [hncoofsr] server sent back 200
>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4723
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
>> [hncoofsr] next action will be OS_READ_CACHE_NOOP
>> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>> (perform_cache_write_action)> (http) [33] perform_cache_write_action
>> CACHE_DO_NO_ACTION
>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1996 (DecideCacheLookup)> (http_trans) [34]
>> [DecideCacheLookup] Will NOT do cache lookup.
>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1997 (DecideCacheLookup)> (http_seq) [34]
>> [DecideCacheLookup] Will NOT do cache lookup
>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:2019 (DecideCacheLookup)> (http_trans) Next action
>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [34] State Transition:
>> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [34] State Transition:
>> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
>> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:7953 (build_request)> (http_trans) [34] [build_request]
>> request like cacheable and conditional headers removed
>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4145 (handle_forward_server_connection_open)> (http_trans)
>> [34] [hfsco] cache action: CACHE_DO_NO_ACTION
>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4708
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
>> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4709
>> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [34]
>> [handle_no_cache_operation_on_forward_server_response]
>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4716
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
>> [hncoofsr] server sent back 200
>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4723
>> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
>> [hncoofsr] next action will be OS_READ_CACHE_NOOP
>> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>> (perform_cache_write_action)> (http) [34] perform_cache_write_action
>> CACHE_DO_NO_ACTION
>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1948 (DecideCacheLookup)> (http_trans) [35]
>> [DecideCacheLookup] Will do cache lookup.
>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1949 (DecideCacheLookup)> (http_seq) [35]
>> [DecideCacheLookup] Will do cache lookup
>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1992 (DecideCacheLookup)> (http_trans) Next action
>> SM_ACTION_CACHE_LOOKUP; nullptr
>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [35] State Transition:
>> SM_ACTION_API_POST_REMAP -> SM_ACTION_CACHE_LOOKUP
>> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4569
>> (do_cache_lookup_and_read)> (http_seq) [HttpSM::do_cache_lookup_and_read]
>> [35] Issuing cache lookup for URL http://10.10.0.213/
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
>> (key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
>> 10.10.0.213
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:118
>> (state_cache_open_read)> (http_cache) [35]
>> [&HttpCacheSM::state_cache_open_read, CACHE_EVENT_OPEN_READ_FAILED]
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
>> (main_handler)> (http) [35] [HttpSM::main_handler,
>> CACHE_EVENT_OPEN_READ_FAILED]
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2607
>> (state_cache_open_read)> (http) [35] [&HttpSM::state_cache_open_read,
>> CACHE_EVENT_OPEN_READ_FAILED]
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2641
>> (state_cache_open_read)> (http) [35] cache_open_read -
>> CACHE_EVENT_OPEN_READ_FAILED with ECACHE_NO_DOC (-20400)
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2643
>> (state_cache_open_read)> (http) [state_cache_open_read] open read failed.
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:2205 (HandleCacheOpenRead)> (http_trans) [35]
>> [HttpTransact::HandleCacheOpenRead]
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:2235 (HandleCacheOpenRead)> (http_trans) [35]
>> CacheOpenRead -- miss
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:3122 (HandleCacheOpenReadMiss)> (http_trans) [35]
>> [HandleCacheOpenReadMiss] --- MISS
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:3124 (HandleCacheOpenReadMiss)> (http_seq) [35]
>> [HttpTransact::HandleCacheOpenReadMiss] Miss in cache
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:3200 (HandleCacheOpenReadMiss)> (http_trans) Next action
>> SM_ACTION_DNS_LOOKUP; OSDNSLookup
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [35] State Transition:
>> SM_ACTION_CACHE_LOOKUP -> SM_ACTION_DNS_LOOKUP
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:1846 (OSDNSLookup)> (http_trans) Next action
>> SM_ACTION_API_OS_DNS; HandleCacheOpenReadMiss
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:3122 (HandleCacheOpenReadMiss)> (http_trans) [35]
>> [HandleCacheOpenReadMiss] --- MISS
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:3124 (HandleCacheOpenReadMiss)> (http_seq) [35]
>> [HttpTransact::HandleCacheOpenReadMiss] Miss in cache
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:7953 (build_request)> (http_trans) [35] [build_request]
>> request like cacheable and conditional headers removed
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [35] State Transition:
>> SM_ACTION_API_OS_DNS -> SM_ACTION_CACHE_ISSUE_WRITE
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4696
>> (do_cache_prepare_action)> (http_cache_write) [35] writing to cache with
>> URL http://10.10.0.213/
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <P_CacheInternal.h:566 (new_CacheVC)> (cache_new) new 0x7fa8b8284bb0
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
>> (key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
>> 10.10.0.213
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:177
>> (state_cache_open_write)> (http_cache) [35]
>> [&HttpCacheSM::state_cache_open_write, CACHE_EVENT_OPEN_WRITE]
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
>> (main_handler)> (http) [35] [HttpSM::main_handler, CACHE_EVENT_OPEN_WRITE]
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2488
>> (state_cache_open_write)> (http) [35] [&HttpSM : state_cache_open_write,
>> CACHE_EVENT_OPEN_WRITE]
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:3088 (handle_cache_write_lock)> (http_trans) Next action
>> next; nullptr
>> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
>> (call_transact_and_set_next_state)> (http) [35] State Transition:
>> SM_ACTION_CACHE_ISSUE_WRITE -> SM_ACTION_ORIGIN_SERVER_OPEN
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4124 (handle_forward_server_connection_open)> (http_trans)
>> [35] [hfsco] cache action: CACHE_DO_WRITE
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4254 (handle_cache_operation_on_forward_server_response)>
>> (http_trans) [35] [handle_cache_operation_on_forward_server_response]
>> (hcoofsr)
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4255 (handle_cache_operation_on_forward_server_response)>
>> (http_seq) [35] [handle_cache_operation_on_forward_server_response]
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:6308 (is_response_cacheable)> (http_trans) [35]
>> [is_response_cacheable] client permits storing
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:6423 (is_response_cacheable)> (http_trans) [35]
>> [is_response_cacheable] NO by default
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4264 (handle_cache_operation_on_forward_server_response)>
>> (http_trans) [35] [hcoofsr] response is not cacheable
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <HttpTransact.cc:4407 (handle_cache_operation_on_forward_server_response)>
>> (http_trans) [35] [hcoofsr] response code: 403
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
>> (perform_cache_write_action)> (http) [35] perform_cache_write_action
>> CACHE_DO_NO_ACTION
>> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
>> <P_CacheInternal.h:578 (free_CacheVC)> (cache_free) free 0x7fa8b8284bb0
>>
>>
>>
>> I see CACHE_DO_NO_ACTION and response is not cacheable. I am curling an
>> index page (default index) on Apache web server, fresh install.
>>
>> On Wed, Feb 17, 2021 at 4:17 PM Alan Carroll <
>> solidwallofcode@verizonmedia.com> wrote:
>>
>>> Hmmm. I would enable debug tags and add the "cache" tag. That should
>>> give you information on why the cache isn't caching. You can also chat with
>>> us at the-asf.slack.com
>>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__the-2Dasf.slack.com&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=irsYt8PCQN3eRwH3Lz4lsWSyZ4Ln4hwNog9_VgFJ8U8&e=>,
>>> channel "#trafficserver".
>>>
>>> On Wed, Feb 17, 2021 at 9:13 AM Milos Dodic <2b...@gmail.com>
>>> wrote:
>>>
>>>> I already had cache defined in storage.config. As for volume.config,
>>>> I've added volumes, but it didn't change much (seems like an option to
>>>> segment the overall storage for cache).
>>>>
>>>> On Wed, Feb 17, 2021 at 3:57 PM Alan Carroll <
>>>> solidwallofcode@verizonmedia.com> wrote:
>>>>
>>>>> You need to set up the "storage.config" and "volume.config" files to
>>>>> specify the storage used to cache the objects.
>>>>>
>>>>> On Tue, Feb 16, 2021 at 6:38 PM Milos Dodic <2b...@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Basic caching setup?
>>>>>>
>>>>>>
>>>>>> I am trying to have the most basic caching setup for a forward
>>>>>> caching proxy. Initially I tried changing the following options only:
>>>>>>
>>>>>> CONFIG proxy.config.http.cache.http INT 1
>>>>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>>>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>>>>
>>>>>> I had no luck. After trying out a few things, I ended with something
>>>>>> like this:
>>>>>>
>>>>>> CONFIG proxy.config.http.cache.http INT 1
>>>>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>>>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>>>> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
>>>>>> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
>>>>>> CONFIG proxy.config.http.cache.ignore_authentication INT 1
>>>>>> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
>>>>>> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
>>>>>> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and
>>>>>> 2)
>>>>>> CONFIG proxy.config.http.push_method_enabled INT 1
>>>>>>
>>>>>> Again, no luck. All I got was lots of MISS, and nothing was cached.
>>>>>> I tried to cache by using the custom app with a forward proxy set to
>>>>>> target the ATS, and later by simply trying to curl na object from AWS S3
>>>>>> (https). In the end, I brought up an Apache web server, and tried curling
>>>>>> the basic http index page. Still, nothing was cached.
>>>>>>
>>>>>> How can I have the most basic setup in place (at least for now), that
>>>>>> will cache stuff like me pulling the index page from the apache web server?
>>>>>> Or cache everything even?
>>>>>> What am I missing?
>>>>>>
>>>>>>
>>>>>> Thanks!
>>>>>>
>>>>>
Re: [E] Basic caching setup?
Posted by Alan Carroll <so...@verizonmedia.com>.
It looks like you enabled the "http" debug tag but not the "cache" debug
tag. That said, given the "Will NOT do cache lookup", I suspect Leif is
correct. OTOH I do see
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4696
(do_cache_prepare_action)> (http_cache_write) [35] writing to cache with
URL http://10.10.0.213/
<https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <P_CacheInternal.h:566
(new_CacheVC)> (cache_new) new 0x7fa8b8284bb0
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
(key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
10.10.0.213
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:177
(state_cache_open_write)> (http_cache) [35]
[&HttpCacheSM::state_cache_open_write, CACHE_EVENT_OPEN_WRITE]
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
(main_handler)> (http) [35] [HttpSM::main_handler, CACHE_EVENT_OPEN_WRITE]
which indicates an attempt to write to cache, but then
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:6423
(is_response_cacheable)> (http_trans) [35] [is_response_cacheable] NO by
default
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4264
(handle_cache_operation_on_forward_server_response)> (http_trans) [35]
[hcoofsr] response is not cacheable
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4407
(handle_cache_operation_on_forward_server_response)> (http_trans) [35]
[hcoofsr] response code: 403
which indicates it's not being cached because it's a negative response.
On Wed, Feb 17, 2021 at 9:34 AM Milos Dodic <2b...@gmail.com> wrote:
> I have enabled cache tags for debugging, here is the parsed traffic.out
> log (looking at cache lines only):
>
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1996
> (DecideCacheLookup)> (http_trans) [31] [DecideCacheLookup] Will NOT do
> cache lookup.
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1997
> (DecideCacheLookup)> (http_seq) [31] [DecideCacheLookup] Will NOT do cache
> lookup
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2019
> (DecideCacheLookup)> (http_trans) Next action
> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [31] State Transition:
> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [31] State Transition:
> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
> (build_request)> (http_trans) [31] [build_request] request like cacheable
> and conditional headers removed
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4145
> (handle_forward_server_connection_open)> (http_trans) [31] [hfsco] cache
> action: CACHE_DO_NO_ACTION
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4708
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4709
> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [31]
> [handle_no_cache_operation_on_forward_server_response]
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4716
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
> [hncoofsr] server sent back 200
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4723
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
> [hncoofsr] next action will be OS_READ_CACHE_NOOP
> [Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
> (perform_cache_write_action)> (http) [31] perform_cache_write_action
> CACHE_DO_NO_ACTION
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1996
> (DecideCacheLookup)> (http_trans) [32] [DecideCacheLookup] Will NOT do
> cache lookup.
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1997
> (DecideCacheLookup)> (http_seq) [32] [DecideCacheLookup] Will NOT do cache
> lookup
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2019
> (DecideCacheLookup)> (http_trans) Next action
> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [32] State Transition:
> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [32] State Transition:
> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
> (build_request)> (http_trans) [32] [build_request] request like cacheable
> and conditional headers removed
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4145
> (handle_forward_server_connection_open)> (http_trans) [32] [hfsco] cache
> action: CACHE_DO_NO_ACTION
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4708
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4709
> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [32]
> [handle_no_cache_operation_on_forward_server_response]
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4716
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
> [hncoofsr] server sent back 200
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4723
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
> [hncoofsr] next action will be OS_READ_CACHE_NOOP
> [Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
> (perform_cache_write_action)> (http) [32] perform_cache_write_action
> CACHE_DO_NO_ACTION
> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1048
> (mainEvent)> (cache_dir_sync) sync started
> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1056
> (mainEvent)> (cache_dir_sync) Dir /test/cache/cache.db 16384:65536 not dirty
> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1048
> (mainEvent)> (cache_dir_sync) sync started
> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1056
> (mainEvent)> (cache_dir_sync) Dir /test/cache/cache.db 536887296:32768 not
> dirty
> [Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1006
> (mainEvent)> (cache_dir_sync) sync done
> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1996
> (DecideCacheLookup)> (http_trans) [33] [DecideCacheLookup] Will NOT do
> cache lookup.
> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1997
> (DecideCacheLookup)> (http_seq) [33] [DecideCacheLookup] Will NOT do cache
> lookup
> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2019
> (DecideCacheLookup)> (http_trans) Next action
> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [33] State Transition:
> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [33] State Transition:
> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
> [Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
> (build_request)> (http_trans) [33] [build_request] request like cacheable
> and conditional headers removed
> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4145
> (handle_forward_server_connection_open)> (http_trans) [33] [hfsco] cache
> action: CACHE_DO_NO_ACTION
> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4708
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4709
> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [33]
> [handle_no_cache_operation_on_forward_server_response]
> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4716
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
> [hncoofsr] server sent back 200
> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4723
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
> [hncoofsr] next action will be OS_READ_CACHE_NOOP
> [Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
> (perform_cache_write_action)> (http) [33] perform_cache_write_action
> CACHE_DO_NO_ACTION
> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1996
> (DecideCacheLookup)> (http_trans) [34] [DecideCacheLookup] Will NOT do
> cache lookup.
> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1997
> (DecideCacheLookup)> (http_seq) [34] [DecideCacheLookup] Will NOT do cache
> lookup
> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2019
> (DecideCacheLookup)> (http_trans) Next action
> SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [34] State Transition:
> SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [34] State Transition:
> SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
> [Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
> (build_request)> (http_trans) [34] [build_request] request like cacheable
> and conditional headers removed
> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4145
> (handle_forward_server_connection_open)> (http_trans) [34] [hfsco] cache
> action: CACHE_DO_NO_ACTION
> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4708
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
> [handle_no_cache_operation_on_forward_server_response] (hncoofsr)
> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4709
> (handle_no_cache_operation_on_forward_server_response)> (http_seq) [34]
> [handle_no_cache_operation_on_forward_server_response]
> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4716
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
> [hncoofsr] server sent back 200
> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4723
> (handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
> [hncoofsr] next action will be OS_READ_CACHE_NOOP
> [Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
> (perform_cache_write_action)> (http) [34] perform_cache_write_action
> CACHE_DO_NO_ACTION
> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1948
> (DecideCacheLookup)> (http_trans) [35] [DecideCacheLookup] Will do cache
> lookup.
> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1949
> (DecideCacheLookup)> (http_seq) [35] [DecideCacheLookup] Will do cache
> lookup
> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1992
> (DecideCacheLookup)> (http_trans) Next action SM_ACTION_CACHE_LOOKUP;
> nullptr
> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [35] State Transition:
> SM_ACTION_API_POST_REMAP -> SM_ACTION_CACHE_LOOKUP
> [Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4569
> (do_cache_lookup_and_read)> (http_seq) [HttpSM::do_cache_lookup_and_read]
> [35] Issuing cache lookup for URL http://10.10.0.213/
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
> (key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
> 10.10.0.213
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:118
> (state_cache_open_read)> (http_cache) [35]
> [&HttpCacheSM::state_cache_open_read, CACHE_EVENT_OPEN_READ_FAILED]
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
> (main_handler)> (http) [35] [HttpSM::main_handler,
> CACHE_EVENT_OPEN_READ_FAILED]
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2607
> (state_cache_open_read)> (http) [35] [&HttpSM::state_cache_open_read,
> CACHE_EVENT_OPEN_READ_FAILED]
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2641
> (state_cache_open_read)> (http) [35] cache_open_read -
> CACHE_EVENT_OPEN_READ_FAILED with ECACHE_NO_DOC (-20400)
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2643
> (state_cache_open_read)> (http) [state_cache_open_read] open read failed.
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2205
> (HandleCacheOpenRead)> (http_trans) [35] [HttpTransact::HandleCacheOpenRead]
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2235
> (HandleCacheOpenRead)> (http_trans) [35] CacheOpenRead -- miss
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3122
> (HandleCacheOpenReadMiss)> (http_trans) [35] [HandleCacheOpenReadMiss] ---
> MISS
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3124
> (HandleCacheOpenReadMiss)> (http_seq) [35]
> [HttpTransact::HandleCacheOpenReadMiss] Miss in cache
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3200
> (HandleCacheOpenReadMiss)> (http_trans) Next action SM_ACTION_DNS_LOOKUP;
> OSDNSLookup
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [35] State Transition:
> SM_ACTION_CACHE_LOOKUP -> SM_ACTION_DNS_LOOKUP
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1846
> (OSDNSLookup)> (http_trans) Next action SM_ACTION_API_OS_DNS;
> HandleCacheOpenReadMiss
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3122
> (HandleCacheOpenReadMiss)> (http_trans) [35] [HandleCacheOpenReadMiss] ---
> MISS
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3124
> (HandleCacheOpenReadMiss)> (http_seq) [35]
> [HttpTransact::HandleCacheOpenReadMiss] Miss in cache
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
> (build_request)> (http_trans) [35] [build_request] request like cacheable
> and conditional headers removed
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [35] State Transition:
> SM_ACTION_API_OS_DNS -> SM_ACTION_CACHE_ISSUE_WRITE
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4696
> (do_cache_prepare_action)> (http_cache_write) [35] writing to cache with
> URL http://10.10.0.213/
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__10.10.0.213_&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=9xDeuoqZtYqzeZRmi6edCNHOSy3SwpbA5qVV77cjuXE&e=>
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG:
> <P_CacheInternal.h:566 (new_CacheVC)> (cache_new) new 0x7fa8b8284bb0
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
> (key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
> 10.10.0.213
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:177
> (state_cache_open_write)> (http_cache) [35]
> [&HttpCacheSM::state_cache_open_write, CACHE_EVENT_OPEN_WRITE]
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
> (main_handler)> (http) [35] [HttpSM::main_handler, CACHE_EVENT_OPEN_WRITE]
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2488
> (state_cache_open_write)> (http) [35] [&HttpSM : state_cache_open_write,
> CACHE_EVENT_OPEN_WRITE]
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3088
> (handle_cache_write_lock)> (http_trans) Next action next; nullptr
> [Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
> (call_transact_and_set_next_state)> (http) [35] State Transition:
> SM_ACTION_CACHE_ISSUE_WRITE -> SM_ACTION_ORIGIN_SERVER_OPEN
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4124
> (handle_forward_server_connection_open)> (http_trans) [35] [hfsco] cache
> action: CACHE_DO_WRITE
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4254
> (handle_cache_operation_on_forward_server_response)> (http_trans) [35]
> [handle_cache_operation_on_forward_server_response] (hcoofsr)
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4255
> (handle_cache_operation_on_forward_server_response)> (http_seq) [35]
> [handle_cache_operation_on_forward_server_response]
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:6308
> (is_response_cacheable)> (http_trans) [35] [is_response_cacheable] client
> permits storing
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:6423
> (is_response_cacheable)> (http_trans) [35] [is_response_cacheable] NO by
> default
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4264
> (handle_cache_operation_on_forward_server_response)> (http_trans) [35]
> [hcoofsr] response is not cacheable
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4407
> (handle_cache_operation_on_forward_server_response)> (http_trans) [35]
> [hcoofsr] response code: 403
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
> (perform_cache_write_action)> (http) [35] perform_cache_write_action
> CACHE_DO_NO_ACTION
> [Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG:
> <P_CacheInternal.h:578 (free_CacheVC)> (cache_free) free 0x7fa8b8284bb0
>
>
>
> I see CACHE_DO_NO_ACTION and response is not cacheable. I am curling an
> index page (default index) on Apache web server, fresh install.
>
> On Wed, Feb 17, 2021 at 4:17 PM Alan Carroll <
> solidwallofcode@verizonmedia.com> wrote:
>
>> Hmmm. I would enable debug tags and add the "cache" tag. That should give
>> you information on why the cache isn't caching. You can also chat with us
>> at the-asf.slack.com
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__the-2Dasf.slack.com&d=DwMFaQ&c=sWW_bEwW_mLyN3Kx2v57Q8e-CRbmiT9yOhqES_g_wVY&r=5nE_8e-Jc1t5vF6GVeub9BCN4FzSc_6kU7_mjSiUrDs&m=wFygucBV1pFwCVoy1_dK7uEOITb4TOm0sVYwfjePuUs&s=irsYt8PCQN3eRwH3Lz4lsWSyZ4Ln4hwNog9_VgFJ8U8&e=>,
>> channel "#trafficserver".
>>
>> On Wed, Feb 17, 2021 at 9:13 AM Milos Dodic <2b...@gmail.com> wrote:
>>
>>> I already had cache defined in storage.config. As for volume.config,
>>> I've added volumes, but it didn't change much (seems like an option to
>>> segment the overall storage for cache).
>>>
>>> On Wed, Feb 17, 2021 at 3:57 PM Alan Carroll <
>>> solidwallofcode@verizonmedia.com> wrote:
>>>
>>>> You need to set up the "storage.config" and "volume.config" files to
>>>> specify the storage used to cache the objects.
>>>>
>>>> On Tue, Feb 16, 2021 at 6:38 PM Milos Dodic <2b...@gmail.com>
>>>> wrote:
>>>>
>>>>> Basic caching setup?
>>>>>
>>>>>
>>>>> I am trying to have the most basic caching setup for a forward caching
>>>>> proxy. Initially I tried changing the following options only:
>>>>>
>>>>> CONFIG proxy.config.http.cache.http INT 1
>>>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>>>
>>>>> I had no luck. After trying out a few things, I ended with something
>>>>> like this:
>>>>>
>>>>> CONFIG proxy.config.http.cache.http INT 1
>>>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>>> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
>>>>> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
>>>>> CONFIG proxy.config.http.cache.ignore_authentication INT 1
>>>>> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
>>>>> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
>>>>> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and 2)
>>>>> CONFIG proxy.config.http.push_method_enabled INT 1
>>>>>
>>>>> Again, no luck. All I got was lots of MISS, and nothing was cached.
>>>>> I tried to cache by using the custom app with a forward proxy set to
>>>>> target the ATS, and later by simply trying to curl na object from AWS S3
>>>>> (https). In the end, I brought up an Apache web server, and tried curling
>>>>> the basic http index page. Still, nothing was cached.
>>>>>
>>>>> How can I have the most basic setup in place (at least for now), that
>>>>> will cache stuff like me pulling the index page from the apache web server?
>>>>> Or cache everything even?
>>>>> What am I missing?
>>>>>
>>>>>
>>>>> Thanks!
>>>>>
>>>>
Re: [E] Basic caching setup?
Posted by Milos Dodic <2b...@gmail.com>.
I have enabled cache tags for debugging, here is the parsed traffic.out log
(looking at cache lines only):
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1996
(DecideCacheLookup)> (http_trans) [31] [DecideCacheLookup] Will NOT do
cache lookup.
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1997
(DecideCacheLookup)> (http_seq) [31] [DecideCacheLookup] Will NOT do cache
lookup
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2019
(DecideCacheLookup)> (http_trans) Next action
SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [31] State Transition:
SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [31] State Transition:
SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
(build_request)> (http_trans) [31] [build_request] request like cacheable
and conditional headers removed
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4145
(handle_forward_server_connection_open)> (http_trans) [31] [hfsco] cache
action: CACHE_DO_NO_ACTION
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4708
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
[handle_no_cache_operation_on_forward_server_response] (hncoofsr)
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4709
(handle_no_cache_operation_on_forward_server_response)> (http_seq) [31]
[handle_no_cache_operation_on_forward_server_response]
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4716
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
[hncoofsr] server sent back 200
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4723
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [31]
[hncoofsr] next action will be OS_READ_CACHE_NOOP
[Feb 17 15:31:04.433] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
(perform_cache_write_action)> (http) [31] perform_cache_write_action
CACHE_DO_NO_ACTION
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1996
(DecideCacheLookup)> (http_trans) [32] [DecideCacheLookup] Will NOT do
cache lookup.
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1997
(DecideCacheLookup)> (http_seq) [32] [DecideCacheLookup] Will NOT do cache
lookup
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2019
(DecideCacheLookup)> (http_trans) Next action
SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [32] State Transition:
SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [32] State Transition:
SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
(build_request)> (http_trans) [32] [build_request] request like cacheable
and conditional headers removed
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4145
(handle_forward_server_connection_open)> (http_trans) [32] [hfsco] cache
action: CACHE_DO_NO_ACTION
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4708
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
[handle_no_cache_operation_on_forward_server_response] (hncoofsr)
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4709
(handle_no_cache_operation_on_forward_server_response)> (http_seq) [32]
[handle_no_cache_operation_on_forward_server_response]
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4716
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
[hncoofsr] server sent back 200
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4723
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [32]
[hncoofsr] next action will be OS_READ_CACHE_NOOP
[Feb 17 15:31:14.435] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
(perform_cache_write_action)> (http) [32] perform_cache_write_action
CACHE_DO_NO_ACTION
[Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1048
(mainEvent)> (cache_dir_sync) sync started
[Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1056
(mainEvent)> (cache_dir_sync) Dir /test/cache/cache.db 16384:65536 not dirty
[Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1048
(mainEvent)> (cache_dir_sync) sync started
[Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1056
(mainEvent)> (cache_dir_sync) Dir /test/cache/cache.db 536887296:32768 not
dirty
[Feb 17 15:31:17.488] Server {0x7fa8bfffe700} DEBUG: <CacheDir.cc:1006
(mainEvent)> (cache_dir_sync) sync done
[Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1996
(DecideCacheLookup)> (http_trans) [33] [DecideCacheLookup] Will NOT do
cache lookup.
[Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1997
(DecideCacheLookup)> (http_seq) [33] [DecideCacheLookup] Will NOT do cache
lookup
[Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2019
(DecideCacheLookup)> (http_trans) Next action
SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
[Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [33] State Transition:
SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
[Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [33] State Transition:
SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
[Feb 17 15:31:24.436] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
(build_request)> (http_trans) [33] [build_request] request like cacheable
and conditional headers removed
[Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4145
(handle_forward_server_connection_open)> (http_trans) [33] [hfsco] cache
action: CACHE_DO_NO_ACTION
[Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4708
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
[handle_no_cache_operation_on_forward_server_response] (hncoofsr)
[Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4709
(handle_no_cache_operation_on_forward_server_response)> (http_seq) [33]
[handle_no_cache_operation_on_forward_server_response]
[Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4716
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
[hncoofsr] server sent back 200
[Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4723
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [33]
[hncoofsr] next action will be OS_READ_CACHE_NOOP
[Feb 17 15:31:24.437] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
(perform_cache_write_action)> (http) [33] perform_cache_write_action
CACHE_DO_NO_ACTION
[Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1996
(DecideCacheLookup)> (http_trans) [34] [DecideCacheLookup] Will NOT do
cache lookup.
[Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1997
(DecideCacheLookup)> (http_seq) [34] [DecideCacheLookup] Will NOT do cache
lookup
[Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2019
(DecideCacheLookup)> (http_trans) Next action
SM_ACTION_API_CACHE_LOOKUP_COMPLETE; CallOSDNSLookup
[Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [34] State Transition:
SM_ACTION_API_POST_REMAP -> SM_ACTION_API_CACHE_LOOKUP_COMPLETE
[Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [34] State Transition:
SM_ACTION_API_CACHE_LOOKUP_COMPLETE -> SM_ACTION_DNS_LOOKUP
[Feb 17 15:31:34.438] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
(build_request)> (http_trans) [34] [build_request] request like cacheable
and conditional headers removed
[Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4145
(handle_forward_server_connection_open)> (http_trans) [34] [hfsco] cache
action: CACHE_DO_NO_ACTION
[Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4708
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
[handle_no_cache_operation_on_forward_server_response] (hncoofsr)
[Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4709
(handle_no_cache_operation_on_forward_server_response)> (http_seq) [34]
[handle_no_cache_operation_on_forward_server_response]
[Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4716
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
[hncoofsr] server sent back 200
[Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4723
(handle_no_cache_operation_on_forward_server_response)> (http_trans) [34]
[hncoofsr] next action will be OS_READ_CACHE_NOOP
[Feb 17 15:31:34.439] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
(perform_cache_write_action)> (http) [34] perform_cache_write_action
CACHE_DO_NO_ACTION
[Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1948
(DecideCacheLookup)> (http_trans) [35] [DecideCacheLookup] Will do cache
lookup.
[Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1949
(DecideCacheLookup)> (http_seq) [35] [DecideCacheLookup] Will do cache
lookup
[Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1992
(DecideCacheLookup)> (http_trans) Next action SM_ACTION_CACHE_LOOKUP;
nullptr
[Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [35] State Transition:
SM_ACTION_API_POST_REMAP -> SM_ACTION_CACHE_LOOKUP
[Feb 17 15:31:36.404] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4569
(do_cache_lookup_and_read)> (http_seq) [HttpSM::do_cache_lookup_and_read]
[35] Issuing cache lookup for URL http://10.10.0.213/
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
(key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
10.10.0.213
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:118
(state_cache_open_read)> (http_cache) [35]
[&HttpCacheSM::state_cache_open_read, CACHE_EVENT_OPEN_READ_FAILED]
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
(main_handler)> (http) [35] [HttpSM::main_handler,
CACHE_EVENT_OPEN_READ_FAILED]
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2607
(state_cache_open_read)> (http) [35] [&HttpSM::state_cache_open_read,
CACHE_EVENT_OPEN_READ_FAILED]
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2641
(state_cache_open_read)> (http) [35] cache_open_read -
CACHE_EVENT_OPEN_READ_FAILED with ECACHE_NO_DOC (-20400)
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2643
(state_cache_open_read)> (http) [state_cache_open_read] open read failed.
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2205
(HandleCacheOpenRead)> (http_trans) [35] [HttpTransact::HandleCacheOpenRead]
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:2235
(HandleCacheOpenRead)> (http_trans) [35] CacheOpenRead -- miss
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3122
(HandleCacheOpenReadMiss)> (http_trans) [35] [HandleCacheOpenReadMiss] ---
MISS
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3124
(HandleCacheOpenReadMiss)> (http_seq) [35]
[HttpTransact::HandleCacheOpenReadMiss] Miss in cache
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3200
(HandleCacheOpenReadMiss)> (http_trans) Next action SM_ACTION_DNS_LOOKUP;
OSDNSLookup
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [35] State Transition:
SM_ACTION_CACHE_LOOKUP -> SM_ACTION_DNS_LOOKUP
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:1846
(OSDNSLookup)> (http_trans) Next action SM_ACTION_API_OS_DNS;
HandleCacheOpenReadMiss
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3122
(HandleCacheOpenReadMiss)> (http_trans) [35] [HandleCacheOpenReadMiss] ---
MISS
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3124
(HandleCacheOpenReadMiss)> (http_seq) [35]
[HttpTransact::HandleCacheOpenReadMiss] Miss in cache
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:7953
(build_request)> (http_trans) [35] [build_request] request like cacheable
and conditional headers removed
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [35] State Transition:
SM_ACTION_API_OS_DNS -> SM_ACTION_CACHE_ISSUE_WRITE
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:4696
(do_cache_prepare_action)> (http_cache_write) [35] writing to cache with
URL http://10.10.0.213/
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <P_CacheInternal.h:566
(new_CacheVC)> (cache_new) new 0x7fa8b8284bb0
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <Cache.cc:3126
(key_to_vol)> (cache_hosting) Generic volume: b8008c28d for host:
10.10.0.213
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpCacheSM.cc:177
(state_cache_open_write)> (http_cache) [35]
[&HttpCacheSM::state_cache_open_write, CACHE_EVENT_OPEN_WRITE]
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2676
(main_handler)> (http) [35] [HttpSM::main_handler, CACHE_EVENT_OPEN_WRITE]
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:2488
(state_cache_open_write)> (http) [35] [&HttpSM : state_cache_open_write,
CACHE_EVENT_OPEN_WRITE]
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:3088
(handle_cache_write_lock)> (http_trans) Next action next; nullptr
[Feb 17 15:31:36.405] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:7244
(call_transact_and_set_next_state)> (http) [35] State Transition:
SM_ACTION_CACHE_ISSUE_WRITE -> SM_ACTION_ORIGIN_SERVER_OPEN
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4124
(handle_forward_server_connection_open)> (http_trans) [35] [hfsco] cache
action: CACHE_DO_WRITE
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4254
(handle_cache_operation_on_forward_server_response)> (http_trans) [35]
[handle_cache_operation_on_forward_server_response] (hcoofsr)
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4255
(handle_cache_operation_on_forward_server_response)> (http_seq) [35]
[handle_cache_operation_on_forward_server_response]
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:6308
(is_response_cacheable)> (http_trans) [35] [is_response_cacheable] client
permits storing
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:6423
(is_response_cacheable)> (http_trans) [35] [is_response_cacheable] NO by
default
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4264
(handle_cache_operation_on_forward_server_response)> (http_trans) [35]
[hcoofsr] response is not cacheable
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpTransact.cc:4407
(handle_cache_operation_on_forward_server_response)> (http_trans) [35]
[hcoofsr] response code: 403
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <HttpSM.cc:5816
(perform_cache_write_action)> (http) [35] perform_cache_write_action
CACHE_DO_NO_ACTION
[Feb 17 15:31:36.407] Server {0x7fa8bfffe700} DEBUG: <P_CacheInternal.h:578
(free_CacheVC)> (cache_free) free 0x7fa8b8284bb0
I see CACHE_DO_NO_ACTION and response is not cacheable. I am curling an
index page (default index) on Apache web server, fresh install.
On Wed, Feb 17, 2021 at 4:17 PM Alan Carroll <
solidwallofcode@verizonmedia.com> wrote:
> Hmmm. I would enable debug tags and add the "cache" tag. That should give
> you information on why the cache isn't caching. You can also chat with us
> at the-asf.slack.com, channel "#trafficserver".
>
> On Wed, Feb 17, 2021 at 9:13 AM Milos Dodic <2b...@gmail.com> wrote:
>
>> I already had cache defined in storage.config. As for volume.config, I've
>> added volumes, but it didn't change much (seems like an option to segment
>> the overall storage for cache).
>>
>> On Wed, Feb 17, 2021 at 3:57 PM Alan Carroll <
>> solidwallofcode@verizonmedia.com> wrote:
>>
>>> You need to set up the "storage.config" and "volume.config" files to
>>> specify the storage used to cache the objects.
>>>
>>> On Tue, Feb 16, 2021 at 6:38 PM Milos Dodic <2b...@gmail.com>
>>> wrote:
>>>
>>>> Basic caching setup?
>>>>
>>>>
>>>> I am trying to have the most basic caching setup for a forward caching
>>>> proxy. Initially I tried changing the following options only:
>>>>
>>>> CONFIG proxy.config.http.cache.http INT 1
>>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>>
>>>> I had no luck. After trying out a few things, I ended with something
>>>> like this:
>>>>
>>>> CONFIG proxy.config.http.cache.http INT 1
>>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
>>>> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
>>>> CONFIG proxy.config.http.cache.ignore_authentication INT 1
>>>> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
>>>> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
>>>> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and 2)
>>>> CONFIG proxy.config.http.push_method_enabled INT 1
>>>>
>>>> Again, no luck. All I got was lots of MISS, and nothing was cached.
>>>> I tried to cache by using the custom app with a forward proxy set to
>>>> target the ATS, and later by simply trying to curl na object from AWS S3
>>>> (https). In the end, I brought up an Apache web server, and tried curling
>>>> the basic http index page. Still, nothing was cached.
>>>>
>>>> How can I have the most basic setup in place (at least for now), that
>>>> will cache stuff like me pulling the index page from the apache web server?
>>>> Or cache everything even?
>>>> What am I missing?
>>>>
>>>>
>>>> Thanks!
>>>>
>>>
Re: [E] Basic caching setup?
Posted by Alan Carroll <so...@verizonmedia.com>.
Hmmm. I would enable debug tags and add the "cache" tag. That should give
you information on why the cache isn't caching. You can also chat with us
at the-asf.slack.com, channel "#trafficserver".
On Wed, Feb 17, 2021 at 9:13 AM Milos Dodic <2b...@gmail.com> wrote:
> I already had cache defined in storage.config. As for volume.config, I've
> added volumes, but it didn't change much (seems like an option to segment
> the overall storage for cache).
>
> On Wed, Feb 17, 2021 at 3:57 PM Alan Carroll <
> solidwallofcode@verizonmedia.com> wrote:
>
>> You need to set up the "storage.config" and "volume.config" files to
>> specify the storage used to cache the objects.
>>
>> On Tue, Feb 16, 2021 at 6:38 PM Milos Dodic <2b...@gmail.com> wrote:
>>
>>> Basic caching setup?
>>>
>>>
>>> I am trying to have the most basic caching setup for a forward caching
>>> proxy. Initially I tried changing the following options only:
>>>
>>> CONFIG proxy.config.http.cache.http INT 1
>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>>
>>> I had no luck. After trying out a few things, I ended with something
>>> like this:
>>>
>>> CONFIG proxy.config.http.cache.http INT 1
>>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>>> CONFIG proxy.config.url_remap.remap_required INT 0
>>> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
>>> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
>>> CONFIG proxy.config.http.cache.ignore_authentication INT 1
>>> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
>>> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
>>> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and 2)
>>> CONFIG proxy.config.http.push_method_enabled INT 1
>>>
>>> Again, no luck. All I got was lots of MISS, and nothing was cached.
>>> I tried to cache by using the custom app with a forward proxy set to
>>> target the ATS, and later by simply trying to curl na object from AWS S3
>>> (https). In the end, I brought up an Apache web server, and tried curling
>>> the basic http index page. Still, nothing was cached.
>>>
>>> How can I have the most basic setup in place (at least for now), that
>>> will cache stuff like me pulling the index page from the apache web server?
>>> Or cache everything even?
>>> What am I missing?
>>>
>>>
>>> Thanks!
>>>
>>
Re: [E] Basic caching setup?
Posted by Milos Dodic <2b...@gmail.com>.
I already had cache defined in storage.config. As for volume.config, I've
added volumes, but it didn't change much (seems like an option to segment
the overall storage for cache).
On Wed, Feb 17, 2021 at 3:57 PM Alan Carroll <
solidwallofcode@verizonmedia.com> wrote:
> You need to set up the "storage.config" and "volume.config" files to
> specify the storage used to cache the objects.
>
> On Tue, Feb 16, 2021 at 6:38 PM Milos Dodic <2b...@gmail.com> wrote:
>
>> Basic caching setup?
>>
>>
>> I am trying to have the most basic caching setup for a forward caching
>> proxy. Initially I tried changing the following options only:
>>
>> CONFIG proxy.config.http.cache.http INT 1
>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>> CONFIG proxy.config.url_remap.remap_required INT 0
>>
>> I had no luck. After trying out a few things, I ended with something like
>> this:
>>
>> CONFIG proxy.config.http.cache.http INT 1
>> CONFIG proxy.config.reverse_proxy.enabled INT 0
>> CONFIG proxy.config.url_remap.remap_required INT 0
>> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
>> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
>> CONFIG proxy.config.http.cache.ignore_authentication INT 1
>> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
>> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
>> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and 2)
>> CONFIG proxy.config.http.push_method_enabled INT 1
>>
>> Again, no luck. All I got was lots of MISS, and nothing was cached.
>> I tried to cache by using the custom app with a forward proxy set to
>> target the ATS, and later by simply trying to curl na object from AWS S3
>> (https). In the end, I brought up an Apache web server, and tried curling
>> the basic http index page. Still, nothing was cached.
>>
>> How can I have the most basic setup in place (at least for now), that
>> will cache stuff like me pulling the index page from the apache web server?
>> Or cache everything even?
>> What am I missing?
>>
>>
>> Thanks!
>>
>
Re: [E] Basic caching setup?
Posted by Alan Carroll <so...@verizonmedia.com>.
You need to set up the "storage.config" and "volume.config" files to
specify the storage used to cache the objects.
On Tue, Feb 16, 2021 at 6:38 PM Milos Dodic <2b...@gmail.com> wrote:
> Basic caching setup?
>
>
> I am trying to have the most basic caching setup for a forward caching
> proxy. Initially I tried changing the following options only:
>
> CONFIG proxy.config.http.cache.http INT 1
> CONFIG proxy.config.reverse_proxy.enabled INT 0
> CONFIG proxy.config.url_remap.remap_required INT 0
>
> I had no luck. After trying out a few things, I ended with something like
> this:
>
> CONFIG proxy.config.http.cache.http INT 1
> CONFIG proxy.config.reverse_proxy.enabled INT 0
> CONFIG proxy.config.url_remap.remap_required INT 0
> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
> CONFIG proxy.config.http.cache.ignore_authentication INT 1
> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and 2)
> CONFIG proxy.config.http.push_method_enabled INT 1
>
> Again, no luck. All I got was lots of MISS, and nothing was cached.
> I tried to cache by using the custom app with a forward proxy set to
> target the ATS, and later by simply trying to curl na object from AWS S3
> (https). In the end, I brought up an Apache web server, and tried curling
> the basic http index page. Still, nothing was cached.
>
> How can I have the most basic setup in place (at least for now), that will
> cache stuff like me pulling the index page from the apache web server? Or
> cache everything even?
> What am I missing?
>
>
> Thanks!
>
Re: Basic caching setup?
Posted by Leif Hedstrom <zw...@apache.org>.
> On Feb 16, 2021, at 5:37 PM, Milos Dodic <2b...@gmail.com> wrote:
>
> Basic caching setup?
>
>
> I am trying to have the most basic caching setup for a forward caching proxy. Initially I tried changing the following options only:
>
> CONFIG proxy.config.http.cache.http INT 1
> CONFIG proxy.config.reverse_proxy.enabled INT 0
> CONFIG proxy.config.url_remap.remap_required INT 0
>
> I had no luck. After trying out a few things, I ended with something like this:
>
> CONFIG proxy.config.http.cache.http INT 1
> CONFIG proxy.config.reverse_proxy.enabled INT 0
> CONFIG proxy.config.url_remap.remap_required INT 0
> CONFIG proxy.config.http.cache.ignore_client_no_cache INT 1
> CONFIG proxy.config.http.cache.ignore_server_no_cache INT 1
> CONFIG proxy.config.http.cache.ignore_authentication INT 1
> CONFIG proxy.config.http.cache.cache_urls_that_look_dynamic INT 1
> CONFIG proxy.config.http.uncacheable_requests_bypass_parent INT 1
> CONFIG proxy.config.http.cache.required_headers INT X (tried 0,1 and 2)
> CONFIG proxy.config.http.push_method_enabled INT 1
>
> Again, no luck. All I got was lots of MISS, and nothing was cached.
> I tried to cache by using the custom app with a forward proxy set to target the ATS, and later by simply trying to curl na object from AWS S3 (https). In the end, I brought up an Apache web server, and tried curling the basic http index page. Still, nothing was cached.
Odds are that your “origin” is not sending appropriate Cache-Control headers. Even the default storage.config should have a small cache. HTTPD (Apache) would by default not send any cache-control headers. If you don’t want to change that, you can set
CONFIG proxy.config.http.cache.required_headers INT 1 # Or 0, but that’s kinda crazy in general
Also, from your above config, this is almost always a bad idea (it becomes an open proxy at this point):
CONFIG proxy.config.url_remap.remap_required INT 0
— Leif
>
> How can I have the most basic setup in place (at least for now), that will cache stuff like me pulling the index page from the apache web server? Or cache everything even?
> What am I missing?
>
>
> Thanks!