You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@trafficserver.apache.org by Muhammad Faisal <fa...@yahoo.com> on 2016/03/30 15:28:39 UTC
No caching of Octet Stream from Filehippo
Hi,
To test the caching behavior i tired to use filehippo website. The same
file when downloaded twice but served from Origin instead of ATS.
When Download Start on Client:
1459344116.695 437 119.73.7.63 TCP_MISS/301 654 GET
http://filehippo.com/download/file/6853a2c840eaefd1d7da43d6f2c94863adc5f470927402e6518d70573a99114d/
- DIRECT/filehippo.com text/html
When Download finished on Client:
1459343751.623 97330 119.73.7.63 TCP_MISS/200 31367371 GET
http://fs32.filehippo.com/1992/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
- DIRECT/fs32.filehippo.com application/octet-stream
On Client (Chrome) I saw the URL during download was different on Chrome
than ATS logs reported.
Origin Header:
GET /9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe HTTP/1.1
Host: fs37.filehippo.com
Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
Accept-Encoding: gzip, deflate, sdch
Accept-Language: en-US,en;q=0.8
Referer:
http://filehippo.com/download_vlc_64/download/56a450f832aee6bb4fda3b01259f9866/
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36
(KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36
HTTP/1.1 200 OK
Accept-Ranges: bytes
Age: 0
Connection: keep-alive
Content-Length: 31367109
Content-Type: application/octet-stream
Date: Wed, 30 Mar 2016 13:26:43 GMT
ETag: "81341be3a62d11:0"
Last-Modified: Mon, 08 Feb 2016 06:34:21 GMT
Server: ATS
--
Regards,
Faisal.
Re: No caching of Octet Stream from Filehippo
Posted by Muhammad Faisal <fa...@yahoo.com>.
Yes thanks, trying to understand the CacheURL plugin working let see.
--
Regards,
Faisal.
------ Original Message ------
From: "Luca Rea" <lu...@contactlab.com>
To: "users@trafficserver.apache.org" <us...@trafficserver.apache.org>;
"Muhammad Faisal" <fa...@yahoo.com>
Sent: 3/31/2016 7:58:57 PM
Subject: RE: No caching of Octet Stream from Filehippo
>
>Take a look to the Cache URL Plugin ...
>
RE: No caching of Octet Stream from Filehippo
Posted by Luca Rea <lu...@contactlab.com>.
Take a look to the Cache URL Plugin ...
Re: No caching of Octet Stream from Filehippo
Posted by Muhammad Faisal <fa...@yahoo.com>.
Yes i understood your point since each new request is resulting in a
different URL i dont know if cacheurl plugin will help or not? and even
if this is possible with ATS?
--
Regards,
Faisal.
------ Original Message ------
From: "Reindl Harald" <h....@thelounge.net>
To: users@trafficserver.apache.org
Sent: 3/31/2016 11:34:23 PM
Subject: Re: No caching of Octet Stream from Filehippo
>
>
>Am 31.03.2016 um 16:52 schrieb Muhammad Faisal:
>>Reindl, I dont see the ATS role limited to those having control over
>>origin.
>>I'm using ATS as forward Caching proxy there must be some way just
>>waiting for the experts to respond.
>
>what in the world do you expect when the origin (no matter if reverse
>or forward) decides to redirect each request do a different random
>destination URL?
>
>you can't cache everything - period
>
>for that to understand you don't need to be "expert" whatever that
>means
>
>>------ Original Message ------
>>From: "Reindl Harald" <h....@thelounge.net>
>>To: users@trafficserver.apache.org
>>Sent: 3/31/2016 2:47:16 AM
>>Subject: Re: No caching of Octet Stream from Filehippo
>>
>>>
>>>
>>>Am 30.03.2016 um 22:13 schrieb Muhammad Faisal:
>>>>The content is being cached but everytime when im attempting to
>>>>download
>>>>the same file the origin is responding with a different URL
>>>>everytime.
>>>
>>>than there is no point to cache it - if you don't control the origin
>>>and the origin intentds not to work caceh freindly you are done
>
Re: No caching of Octet Stream from Filehippo
Posted by Reindl Harald <h....@thelounge.net>.
Am 31.03.2016 um 16:52 schrieb Muhammad Faisal:
> Reindl, I dont see the ATS role limited to those having control over
> origin.
> I'm using ATS as forward Caching proxy there must be some way just
> waiting for the experts to respond.
what in the world do you expect when the origin (no matter if reverse or
forward) decides to redirect each request do a different random
destination URL?
you can't cache everything - period
for that to understand you don't need to be "expert" whatever that means
> ------ Original Message ------
> From: "Reindl Harald" <h....@thelounge.net>
> To: users@trafficserver.apache.org
> Sent: 3/31/2016 2:47:16 AM
> Subject: Re: No caching of Octet Stream from Filehippo
>
>>
>>
>> Am 30.03.2016 um 22:13 schrieb Muhammad Faisal:
>>> The content is being cached but everytime when im attempting to download
>>> the same file the origin is responding with a different URL everytime.
>>
>> than there is no point to cache it - if you don't control the origin
>> and the origin intentds not to work caceh freindly you are done
Re: No caching of Octet Stream from Filehippo
Posted by Muhammad Faisal <fa...@yahoo.com>.
Reindl, I dont see the ATS role limited to those having control over
origin.
I'm using ATS as forward Caching proxy there must be some way just
waiting for the experts to respond.
--
Regards,
Faisal.
------ Original Message ------
From: "Reindl Harald" <h....@thelounge.net>
To: users@trafficserver.apache.org
Sent: 3/31/2016 2:47:16 AM
Subject: Re: No caching of Octet Stream from Filehippo
>
>
>Am 30.03.2016 um 22:13 schrieb Muhammad Faisal:
>>The content is being cached but everytime when im attempting to
>>download
>>the same file the origin is responding with a different URL everytime.
>
>than there is no point to cache it - if you don't control the origin
>and the origin intentds not to work caceh freindly you are done
>
Re: No caching of Octet Stream from Filehippo
Posted by Reindl Harald <h....@thelounge.net>.
Am 30.03.2016 um 22:13 schrieb Muhammad Faisal:
> The content is being cached but everytime when im attempting to download
> the same file the origin is responding with a different URL everytime.
than there is no point to cache it - if you don't control the origin and
the origin intentds not to work caceh freindly you are done
Re: No caching of Octet Stream from Filehippo
Posted by Muhammad Faisal <fa...@yahoo.com>.
Ho to handle this situation to ensure object is delivered from cache
when different URL corresponds to same object? Due to this behavior of
many sites the cache hit ratio is very low 3 to 4% only.
--
Regards,
Faisal.
------ Original Message ------
From: "Muhammad Faisal" <fa...@yahoo.com>
To: users@trafficserver.apache.org; users@trafficserver.apache.org
Sent: 3/31/2016 1:13:50 AM
Subject: Re: No caching of Octet Stream from Filehippo
>The content is being cached but everytime when im attempting to
>download the same file the origin is responding with a different URL
>everytime. The previously downloaded URL is cached properly:
>
>459368207.221 22871 119.73.7.11 ERR_CLIENT_ABORT/200 3774362 GET
>http://fs37.filehippo.com/1697/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>- DIRECT/fs37.filehippo.com application/octet-stream
>1459368253.311 41029 119.73.7.11 ERR_CLIENT_ABORT/200 6541785 GET
>http://fs37.filehippo.com/1697/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>- DIRECT/fs37.filehippo.com application/octet-stream
>1459368256.659 17 119.73.7.11 TCP_HIT/206 312 GET
>http://fs35.filehippo.com/6294/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>- NONE/- application/octet-stream
>First Time:
>1459368105.128 272889 119.73.7.11 TCP_MISS/200 31367371 GET
>http://fs35.filehippo.com/6294/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>- DIRECT/fs35.filehippo.com application/octet-stream
>Second Attempt on direct URL:
>1459368350.531 93590 119.73.7.11 TCP_HIT/206 31364779 GET
>http://fs35.filehippo.com/6294/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>- NONE/- application/octet-stream
>Difference in URL for the same file/object:
>
>GET
>http://fs37.filehippo.com/1697/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>
>http://fs35.filehippo.com/6294/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>
>--
>Regards,
>Faisal.
>
>
>
>------ Original Message ------
>From: "Reindl Harald" <h....@thelounge.net>
>To: users@trafficserver.apache.org
>Sent: 3/31/2016 12:50:36 AM
>Subject: Re: No caching of Octet Stream from Filehippo
>
>>
>>
>>Am 30.03.2016 um 21:42 schrieb Muhammad Faisal:
>>>Here is the output of CURL, I have included origin headers in my
>>>original email
>>>
>>>[root@wc01 /]# curl --head
>>>http://fs37.filehippo.com/9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>>>
>>>HTTP/1.1 200 OK
>>>Content-Length: 90
>>>Content-Type: text/html
>>>Last-Modified: Fri, 17 Apr 2015 06:33:53 GMT
>>>Accept-Ranges: bytes
>>>ETag: "b4357379d878d01:0"
>>>Server: Microsoft-IIS/7.5
>>>Date: Wed, 30 Mar 2016 19:41:14 GMT
>>
>>"It seems the object caching is not happening even if "Last Modified"
>>a proper origin would send cache-control headers
>>
>>but are ypu *really* sure it's not cached?
>>
>>what does the same curl-request against the proxy show with at least
>>two requests - see the growing ATS-"Age" header below
>>
>>[harry@srv-rhsoft:~]$ curl --head
>>http://local.rhsoft.net/images/pixel.gif
>>HTTP/1.1 200 OK
>>Date: Wed, 30 Mar 2016 19:46:29 GMT
>>X-Content-Type-Options: nosniff
>>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>>ETag: "2b-4fa744e151f00"
>>Accept-Ranges: bytes
>>Content-Length: 43
>>Cache-Control: max-age=60
>>Expires: Wed, 30 Mar 2016 19:47:29 GMT
>>Connection: close
>>Content-Type: image/gif
>>_____________________________
>>
>>
>>[harry@srv-rhsoft:~]$ curl --head
>>http://www.rhsoft.net/images/pixel.gif
>>HTTP/1.1 200 OK
>>Date: Wed, 30 Mar 2016 19:49:38 GMT
>>X-Content-Type-Options: nosniff
>>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>>ETag: "2b-4fa744e151f00"
>>Accept-Ranges: bytes
>>Content-Length: 43
>>Cache-Control: max-age=60
>>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>>Content-Type: image/gif
>>Age: 0
>>Connection: keep-alive
>>
>>[harry@srv-rhsoft:~]$ curl --head
>>http://www.rhsoft.net/images/pixel.gif
>>HTTP/1.1 200 OK
>>Date: Wed, 30 Mar 2016 19:49:38 GMT
>>X-Content-Type-Options: nosniff
>>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>>ETag: "2b-4fa744e151f00"
>>Accept-Ranges: bytes
>>Content-Length: 43
>>Cache-Control: max-age=60
>>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>>Content-Type: image/gif
>>Age: 1
>>Connection: keep-alive
>>
>>[harry@srv-rhsoft:~]$ curl --head
>>http://www.rhsoft.net/images/pixel.gif
>>HTTP/1.1 200 OK
>>Date: Wed, 30 Mar 2016 19:49:38 GMT
>>X-Content-Type-Options: nosniff
>>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>>ETag: "2b-4fa744e151f00"
>>Accept-Ranges: bytes
>>Content-Length: 43
>>Cache-Control: max-age=60
>>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>>Content-Type: image/gif
>>Age: 2
>>Connection: keep-alive
>>
>>[harry@srv-rhsoft:~]$ curl --head
>>http://www.rhsoft.net/images/pixel.gif
>>HTTP/1.1 200 OK
>>Date: Wed, 30 Mar 2016 19:49:38 GMT
>>X-Content-Type-Options: nosniff
>>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>>ETag: "2b-4fa744e151f00"
>>Accept-Ranges: bytes
>>Content-Length: 43
>>Cache-Control: max-age=60
>>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>>Content-Type: image/gif
>>Age: 3
>>Connection: keep-alive
>>
>>[harry@srv-rhsoft:~]$ curl --head
>>http://www.rhsoft.net/images/pixel.gif
>>HTTP/1.1 200 OK
>>Date: Wed, 30 Mar 2016 19:49:38 GMT
>>X-Content-Type-Options: nosniff
>>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>>ETag: "2b-4fa744e151f00"
>>Accept-Ranges: bytes
>>Content-Length: 43
>>Cache-Control: max-age=60
>>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>>Content-Type: image/gif
>>Age: 4
>>Connection: keep-alive
>>
>>
>
Re: No caching of Octet Stream from Filehippo
Posted by Muhammad Faisal <fa...@yahoo.com>.
The content is being cached but everytime when im attempting to download
the same file the origin is responding with a different URL everytime.
The previously downloaded URL is cached properly:
459368207.221 22871 119.73.7.11 ERR_CLIENT_ABORT/200 3774362 GET
http://fs37.filehippo.com/1697/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
- DIRECT/fs37.filehippo.com application/octet-stream
1459368253.311 41029 119.73.7.11 ERR_CLIENT_ABORT/200 6541785 GET
http://fs37.filehippo.com/1697/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
- DIRECT/fs37.filehippo.com application/octet-stream
1459368256.659 17 119.73.7.11 TCP_HIT/206 312 GET
http://fs35.filehippo.com/6294/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
- NONE/- application/octet-stream
First Time:
1459368105.128 272889 119.73.7.11 TCP_MISS/200 31367371 GET
http://fs35.filehippo.com/6294/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
- DIRECT/fs35.filehippo.com application/octet-stream
Second Attempt on direct URL:
1459368350.531 93590 119.73.7.11 TCP_HIT/206 31364779 GET
http://fs35.filehippo.com/6294/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
- NONE/- application/octet-stream
Difference in URL for the same file/object:
GET
http://fs37.filehippo.com/1697/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
http://fs35.filehippo.com/6294/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
--
Regards,
Faisal.
------ Original Message ------
From: "Reindl Harald" <h....@thelounge.net>
To: users@trafficserver.apache.org
Sent: 3/31/2016 12:50:36 AM
Subject: Re: No caching of Octet Stream from Filehippo
>
>
>Am 30.03.2016 um 21:42 schrieb Muhammad Faisal:
>>Here is the output of CURL, I have included origin headers in my
>>original email
>>
>>[root@wc01 /]# curl --head
>>http://fs37.filehippo.com/9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>>
>>HTTP/1.1 200 OK
>>Content-Length: 90
>>Content-Type: text/html
>>Last-Modified: Fri, 17 Apr 2015 06:33:53 GMT
>>Accept-Ranges: bytes
>>ETag: "b4357379d878d01:0"
>>Server: Microsoft-IIS/7.5
>>Date: Wed, 30 Mar 2016 19:41:14 GMT
>
>"It seems the object caching is not happening even if "Last Modified"
>a proper origin would send cache-control headers
>
>but are ypu *really* sure it's not cached?
>
>what does the same curl-request against the proxy show with at least
>two requests - see the growing ATS-"Age" header below
>
>[harry@srv-rhsoft:~]$ curl --head
>http://local.rhsoft.net/images/pixel.gif
>HTTP/1.1 200 OK
>Date: Wed, 30 Mar 2016 19:46:29 GMT
>X-Content-Type-Options: nosniff
>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>ETag: "2b-4fa744e151f00"
>Accept-Ranges: bytes
>Content-Length: 43
>Cache-Control: max-age=60
>Expires: Wed, 30 Mar 2016 19:47:29 GMT
>Connection: close
>Content-Type: image/gif
>_____________________________
>
>
>[harry@srv-rhsoft:~]$ curl --head
>http://www.rhsoft.net/images/pixel.gif
>HTTP/1.1 200 OK
>Date: Wed, 30 Mar 2016 19:49:38 GMT
>X-Content-Type-Options: nosniff
>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>ETag: "2b-4fa744e151f00"
>Accept-Ranges: bytes
>Content-Length: 43
>Cache-Control: max-age=60
>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>Content-Type: image/gif
>Age: 0
>Connection: keep-alive
>
>[harry@srv-rhsoft:~]$ curl --head
>http://www.rhsoft.net/images/pixel.gif
>HTTP/1.1 200 OK
>Date: Wed, 30 Mar 2016 19:49:38 GMT
>X-Content-Type-Options: nosniff
>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>ETag: "2b-4fa744e151f00"
>Accept-Ranges: bytes
>Content-Length: 43
>Cache-Control: max-age=60
>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>Content-Type: image/gif
>Age: 1
>Connection: keep-alive
>
>[harry@srv-rhsoft:~]$ curl --head
>http://www.rhsoft.net/images/pixel.gif
>HTTP/1.1 200 OK
>Date: Wed, 30 Mar 2016 19:49:38 GMT
>X-Content-Type-Options: nosniff
>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>ETag: "2b-4fa744e151f00"
>Accept-Ranges: bytes
>Content-Length: 43
>Cache-Control: max-age=60
>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>Content-Type: image/gif
>Age: 2
>Connection: keep-alive
>
>[harry@srv-rhsoft:~]$ curl --head
>http://www.rhsoft.net/images/pixel.gif
>HTTP/1.1 200 OK
>Date: Wed, 30 Mar 2016 19:49:38 GMT
>X-Content-Type-Options: nosniff
>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>ETag: "2b-4fa744e151f00"
>Accept-Ranges: bytes
>Content-Length: 43
>Cache-Control: max-age=60
>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>Content-Type: image/gif
>Age: 3
>Connection: keep-alive
>
>[harry@srv-rhsoft:~]$ curl --head
>http://www.rhsoft.net/images/pixel.gif
>HTTP/1.1 200 OK
>Date: Wed, 30 Mar 2016 19:49:38 GMT
>X-Content-Type-Options: nosniff
>Last-Modified: Wed, 28 May 2014 11:42:20 GMT
>ETag: "2b-4fa744e151f00"
>Accept-Ranges: bytes
>Content-Length: 43
>Cache-Control: max-age=60
>Expires: Wed, 30 Mar 2016 19:50:38 GMT
>Content-Type: image/gif
>Age: 4
>Connection: keep-alive
>
>
Re: No caching of Octet Stream from Filehippo
Posted by Reindl Harald <h....@thelounge.net>.
Am 30.03.2016 um 21:42 schrieb Muhammad Faisal:
> Here is the output of CURL, I have included origin headers in my
> original email
>
> [root@wc01 /]# curl --head
> http://fs37.filehippo.com/9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>
> HTTP/1.1 200 OK
> Content-Length: 90
> Content-Type: text/html
> Last-Modified: Fri, 17 Apr 2015 06:33:53 GMT
> Accept-Ranges: bytes
> ETag: "b4357379d878d01:0"
> Server: Microsoft-IIS/7.5
> Date: Wed, 30 Mar 2016 19:41:14 GMT
"It seems the object caching is not happening even if "Last Modified"
a proper origin would send cache-control headers
but are ypu *really* sure it's not cached?
what does the same curl-request against the proxy show with at least two
requests - see the growing ATS-"Age" header below
[harry@srv-rhsoft:~]$ curl --head http://local.rhsoft.net/images/pixel.gif
HTTP/1.1 200 OK
Date: Wed, 30 Mar 2016 19:46:29 GMT
X-Content-Type-Options: nosniff
Last-Modified: Wed, 28 May 2014 11:42:20 GMT
ETag: "2b-4fa744e151f00"
Accept-Ranges: bytes
Content-Length: 43
Cache-Control: max-age=60
Expires: Wed, 30 Mar 2016 19:47:29 GMT
Connection: close
Content-Type: image/gif
_____________________________
[harry@srv-rhsoft:~]$ curl --head http://www.rhsoft.net/images/pixel.gif
HTTP/1.1 200 OK
Date: Wed, 30 Mar 2016 19:49:38 GMT
X-Content-Type-Options: nosniff
Last-Modified: Wed, 28 May 2014 11:42:20 GMT
ETag: "2b-4fa744e151f00"
Accept-Ranges: bytes
Content-Length: 43
Cache-Control: max-age=60
Expires: Wed, 30 Mar 2016 19:50:38 GMT
Content-Type: image/gif
Age: 0
Connection: keep-alive
[harry@srv-rhsoft:~]$ curl --head http://www.rhsoft.net/images/pixel.gif
HTTP/1.1 200 OK
Date: Wed, 30 Mar 2016 19:49:38 GMT
X-Content-Type-Options: nosniff
Last-Modified: Wed, 28 May 2014 11:42:20 GMT
ETag: "2b-4fa744e151f00"
Accept-Ranges: bytes
Content-Length: 43
Cache-Control: max-age=60
Expires: Wed, 30 Mar 2016 19:50:38 GMT
Content-Type: image/gif
Age: 1
Connection: keep-alive
[harry@srv-rhsoft:~]$ curl --head http://www.rhsoft.net/images/pixel.gif
HTTP/1.1 200 OK
Date: Wed, 30 Mar 2016 19:49:38 GMT
X-Content-Type-Options: nosniff
Last-Modified: Wed, 28 May 2014 11:42:20 GMT
ETag: "2b-4fa744e151f00"
Accept-Ranges: bytes
Content-Length: 43
Cache-Control: max-age=60
Expires: Wed, 30 Mar 2016 19:50:38 GMT
Content-Type: image/gif
Age: 2
Connection: keep-alive
[harry@srv-rhsoft:~]$ curl --head http://www.rhsoft.net/images/pixel.gif
HTTP/1.1 200 OK
Date: Wed, 30 Mar 2016 19:49:38 GMT
X-Content-Type-Options: nosniff
Last-Modified: Wed, 28 May 2014 11:42:20 GMT
ETag: "2b-4fa744e151f00"
Accept-Ranges: bytes
Content-Length: 43
Cache-Control: max-age=60
Expires: Wed, 30 Mar 2016 19:50:38 GMT
Content-Type: image/gif
Age: 3
Connection: keep-alive
[harry@srv-rhsoft:~]$ curl --head http://www.rhsoft.net/images/pixel.gif
HTTP/1.1 200 OK
Date: Wed, 30 Mar 2016 19:49:38 GMT
X-Content-Type-Options: nosniff
Last-Modified: Wed, 28 May 2014 11:42:20 GMT
ETag: "2b-4fa744e151f00"
Accept-Ranges: bytes
Content-Length: 43
Cache-Control: max-age=60
Expires: Wed, 30 Mar 2016 19:50:38 GMT
Content-Type: image/gif
Age: 4
Connection: keep-alive
Re: No caching of Octet Stream from Filehippo
Posted by Muhammad Faisal <fa...@yahoo.com>.
Here is the output of CURL, I have included origin headers in my
original email
[root@wc01 /]# curl --head
http://fs37.filehippo.com/9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
HTTP/1.1 200 OK
Content-Length: 90
Content-Type: text/html
Last-Modified: Fri, 17 Apr 2015 06:33:53 GMT
Accept-Ranges: bytes
ETag: "b4357379d878d01:0"
Server: Microsoft-IIS/7.5
Date: Wed, 30 Mar 2016 19:41:14 GMT
--
Regards,
Faisal.
------ Original Message ------
From: "Reindl Harald" <h....@thelounge.net>
To: users@trafficserver.apache.org
Sent: 3/31/2016 12:37:06 AM
Subject: Re: No caching of Octet Stream from Filehippo
>301 is a REDIRECT
>
>to debug caching issues just use "curl --head origin-url", anything
>else is blind guessing
>
>Am 30.03.2016 um 21:13 schrieb Muhammad Faisal:
>>It seems the object caching is not happening even if "Last Modified"
>>header in the origin response despite setting *CONFIG
>>proxy.config.http.cache.required_headers INT 1*
>>--
>>Regards,
>>Faisal.
>>------ Original Message ------
>>From: "Muhammad Faisal" <faisalusuf@yahoo.com
>><ma...@yahoo.com>>
>>To: users@trafficserver.apache.org
>><ma...@trafficserver.apache.org>; "Users"
>><users@trafficserver.apache.org
>><ma...@trafficserver.apache.org>>
>>Sent: 3/30/2016 6:44:16 PM
>>Subject: Re: No caching of Octet Stream from Filehippo
>>>When I click download button there are two requests one 301 and
>>>second
>>>200:
>>>*301 Headers: I wonder why they are setting cache control private?
>
Re: No caching of Octet Stream from Filehippo
Posted by Reindl Harald <h....@thelounge.net>.
301 is a REDIRECT
to debug caching issues just use "curl --head origin-url", anything else
is blind guessing
Am 30.03.2016 um 21:13 schrieb Muhammad Faisal:
> It seems the object caching is not happening even if "Last Modified"
> header in the origin response despite setting *CONFIG
> proxy.config.http.cache.required_headers INT 1*
> --
> Regards,
> Faisal.
> ------ Original Message ------
> From: "Muhammad Faisal" <faisalusuf@yahoo.com <ma...@yahoo.com>>
> To: users@trafficserver.apache.org
> <ma...@trafficserver.apache.org>; "Users"
> <users@trafficserver.apache.org <ma...@trafficserver.apache.org>>
> Sent: 3/30/2016 6:44:16 PM
> Subject: Re: No caching of Octet Stream from Filehippo
>> When I click download button there are two requests one 301 and second
>> 200:
>> *301 Headers: I wonder why they are setting cache control private?
Re: No caching of Octet Stream from Filehippo
Posted by Muhammad Faisal <fa...@yahoo.com>.
It seems the object caching is not happening even if "Last Modified"
header in the origin response despite setting CONFIG
proxy.config.http.cache.required_headers INT 1
--
Regards,
Faisal.
------ Original Message ------
From: "Muhammad Faisal" <fa...@yahoo.com>
To: users@trafficserver.apache.org; "Users"
<us...@trafficserver.apache.org>
Sent: 3/30/2016 6:44:16 PM
Subject: Re: No caching of Octet Stream from Filehippo
>When I click download button there are two requests one 301 and second
>200:
>
>
>301 Headers: I wonder why they are setting cache control private?
>
>GET
>/download/file/6853a2c840eaefd1d7da43d6f2c94863adc5f470927402e6518d70573a99114d/
>HTTP/1.1
>Host: filehippo.com
>Accept:
>text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
>Accept-Encoding: gzip, deflate, sdch
>Accept-Language: en-US,en;q=0.8
>Cookie: FHSession=mfzdaugt4nu11q3yfxfkjyox;
>FH_PreferredCulture=l=en-US&e=3/30/2017 1:38:22 PM;
>__utmt_UA-5815250-1=1; __qca=P0-1359511593-1459345103148;
>__utma=144473122.1934842269.1459345103.1459345103.1459345103.1;
>__utmb=144473122.3.10.1459345119355; __utmc=144473122;
>__utmz=144473122.1459345103.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none);
>__utmv=144473122.|1=AB%20Test=new-home-v1=1
>Referer:
>http://filehippo.com/download_vlc_64/download/56a450f832aee6bb4fda3b01259f9866/
>Upgrade-Insecure-Requests: 1
>User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36
>(KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36
>
>HTTP/1.1 301 Moved Permanently
>Accept-Ranges: bytes
>Age: 0
>Cache-Control: private
>Connection: keep-alive
>Content-Length: 0
>Content-Type: text/html
>Date: Wed, 30 Mar 2016 13:38:45 GMT
>Location:
>http://fs37.filehippo.com/9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>Server: ATS
>Via: 1.1 varnish
>X-Cache: MISS
>X-Cache-Hits: 0
>x-debug-output: FHSession=mfzdaugt4nu11q3yfxfkjyox;
>FH_PreferredCulture=l=en-US&e=3/30/2017 1:38:22 PM;
>__utmt_UA-5815250-1=1; __qca=P0-1359511593-1459345103148;
>__utma=144473122.1934842269.1459345103.1459345103.1459345103.1;
>__utmb=144473122.3.10.1459345119355; __utmc=144473122;
>__utmz=144473122.1459345103.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none);
>__utmv=144473122.|1=AB%20Test=new-home-v1=1
>X-Served-By: cache-lhr6334-LHR
>200 Header: Why ATS is not caching octet stream despite having CONFIG
>proxy.config.http.cache.required_headers INT 1
>GET /9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe HTTP/1.1
>Host: fs37.filehippo.com
>Accept:
>text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
>Accept-Encoding: gzip, deflate, sdch
>Accept-Language: en-US,en;q=0.8
>Cookie: __utmt_UA-5815250-1=1; __qca=P0-1359511593-1459345103148;
>__utma=144473122.1934842269.1459345103.1459345103.1459345103.1;
>__utmb=144473122.3.10.1459345119355; __utmc=144473122;
>__utmz=144473122.1459345103.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none);
>__utmv=144473122.|1=AB%20Test=new-home-v1=1
>Referer:
>http://filehippo.com/download_vlc_64/download/56a450f832aee6bb4fda3b01259f9866/
>Upgrade-Insecure-Requests: 1
>User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36
>(KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36
>
>HTTP/1.1 200 OK
>Accept-Ranges: bytes
>Age: 739
>Connection: keep-alive
>Content-Length: 31367109
>Content-Type: application/octet-stream
>Date: Wed, 30 Mar 2016 13:26:43 GMT
>ETag: "81341be3a62d11:0"
>Last-Modified: Mon, 08 Feb 2016 06:34:21 GMT
>Server: ATS
>
>
>
>
>
>
>
>
>
>--
>Regards,
>Faisal.
>
>
>
>------ Original Message ------
>From: "Muhammad Faisal" <fa...@yahoo.com>
>To: "Users" <us...@trafficserver.apache.org>
>Sent: 3/30/2016 6:28:39 PM
>Subject: No caching of Octet Stream from Filehippo
>
>>Hi,
>>To test the caching behavior i tired to use filehippo website. The
>>same file when downloaded twice but served from Origin instead of ATS.
>>
>>When Download Start on Client:
>>1459344116.695 437 119.73.7.63 TCP_MISS/301 654 GET
>>http://filehippo.com/download/file/6853a2c840eaefd1d7da43d6f2c94863adc5f470927402e6518d70573a99114d/
>>- DIRECT/filehippo.com text/html
>>When Download finished on Client:
>>1459343751.623 97330 119.73.7.63 TCP_MISS/200 31367371 GET
>>http://fs32.filehippo.com/1992/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>>- DIRECT/fs32.filehippo.com application/octet-stream
>>On Client (Chrome) I saw the URL during download was different on
>>Chrome than ATS logs reported.
>>
>>
>>Origin Header:
>>
>>GET /9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>>HTTP/1.1
>>Host: fs37.filehippo.com
>>Accept:
>>text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
>>Accept-Encoding: gzip, deflate, sdch
>>Accept-Language: en-US,en;q=0.8
>>Referer:
>>http://filehippo.com/download_vlc_64/download/56a450f832aee6bb4fda3b01259f9866/
>>Upgrade-Insecure-Requests: 1
>>User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36
>>(KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36
>>
>>HTTP/1.1 200 OK
>>Accept-Ranges: bytes
>>Age: 0
>>Connection: keep-alive
>>Content-Length: 31367109
>>Content-Type: application/octet-stream
>>Date: Wed, 30 Mar 2016 13:26:43 GMT
>>ETag: "81341be3a62d11:0"
>>Last-Modified: Mon, 08 Feb 2016 06:34:21 GMT
>>Server: ATS
>>
>>--
>>Regards,
>>Faisal.
>>
Re: No caching of Octet Stream from Filehippo
Posted by Muhammad Faisal <fa...@yahoo.com>.
When I click download button there are two requests one 301 and second
200:
301 Headers: I wonder why they are setting cache control private?
GET
/download/file/6853a2c840eaefd1d7da43d6f2c94863adc5f470927402e6518d70573a99114d/
HTTP/1.1
Host: filehippo.com
Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
Accept-Encoding: gzip, deflate, sdch
Accept-Language: en-US,en;q=0.8
Cookie: FHSession=mfzdaugt4nu11q3yfxfkjyox;
FH_PreferredCulture=l=en-US&e=3/30/2017 1:38:22 PM;
__utmt_UA-5815250-1=1; __qca=P0-1359511593-1459345103148;
__utma=144473122.1934842269.1459345103.1459345103.1459345103.1;
__utmb=144473122.3.10.1459345119355; __utmc=144473122;
__utmz=144473122.1459345103.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none);
__utmv=144473122.|1=AB%20Test=new-home-v1=1
Referer:
http://filehippo.com/download_vlc_64/download/56a450f832aee6bb4fda3b01259f9866/
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36
(KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36
HTTP/1.1 301 Moved Permanently
Accept-Ranges: bytes
Age: 0
Cache-Control: private
Connection: keep-alive
Content-Length: 0
Content-Type: text/html
Date: Wed, 30 Mar 2016 13:38:45 GMT
Location:
http://fs37.filehippo.com/9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
Server: ATS
Via: 1.1 varnish
X-Cache: MISS
X-Cache-Hits: 0
x-debug-output: FHSession=mfzdaugt4nu11q3yfxfkjyox;
FH_PreferredCulture=l=en-US&e=3/30/2017 1:38:22 PM;
__utmt_UA-5815250-1=1; __qca=P0-1359511593-1459345103148;
__utma=144473122.1934842269.1459345103.1459345103.1459345103.1;
__utmb=144473122.3.10.1459345119355; __utmc=144473122;
__utmz=144473122.1459345103.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none);
__utmv=144473122.|1=AB%20Test=new-home-v1=1
X-Served-By: cache-lhr6334-LHR
200 Header: Why ATS is not caching octet stream despite having CONFIG
proxy.config.http.cache.required_headers INT 1
GET /9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe HTTP/1.1
Host: fs37.filehippo.com
Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
Accept-Encoding: gzip, deflate, sdch
Accept-Language: en-US,en;q=0.8
Cookie: __utmt_UA-5815250-1=1; __qca=P0-1359511593-1459345103148;
__utma=144473122.1934842269.1459345103.1459345103.1459345103.1;
__utmb=144473122.3.10.1459345119355; __utmc=144473122;
__utmz=144473122.1459345103.1.1.utmcsr=(direct)|utmccn=(direct)|utmcmd=(none);
__utmv=144473122.|1=AB%20Test=new-home-v1=1
Referer:
http://filehippo.com/download_vlc_64/download/56a450f832aee6bb4fda3b01259f9866/
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36
(KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36
HTTP/1.1 200 OK
Accept-Ranges: bytes
Age: 739
Connection: keep-alive
Content-Length: 31367109
Content-Type: application/octet-stream
Date: Wed, 30 Mar 2016 13:26:43 GMT
ETag: "81341be3a62d11:0"
Last-Modified: Mon, 08 Feb 2016 06:34:21 GMT
Server: ATS
--
Regards,
Faisal.
------ Original Message ------
From: "Muhammad Faisal" <fa...@yahoo.com>
To: "Users" <us...@trafficserver.apache.org>
Sent: 3/30/2016 6:28:39 PM
Subject: No caching of Octet Stream from Filehippo
>Hi,
>To test the caching behavior i tired to use filehippo website. The same
>file when downloaded twice but served from Origin instead of ATS.
>
>When Download Start on Client:
>1459344116.695 437 119.73.7.63 TCP_MISS/301 654 GET
>http://filehippo.com/download/file/6853a2c840eaefd1d7da43d6f2c94863adc5f470927402e6518d70573a99114d/
>- DIRECT/filehippo.com text/html
>When Download finished on Client:
>1459343751.623 97330 119.73.7.63 TCP_MISS/200 31367371 GET
>http://fs32.filehippo.com/1992/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe
>- DIRECT/fs32.filehippo.com application/octet-stream
>On Client (Chrome) I saw the URL during download was different on
>Chrome than ATS logs reported.
>
>
>Origin Header:
>
>GET /9546/46cfd241f1da4ae9812f512f7b36643c/vlc-2.2.2-win64.exe HTTP/1.1
>Host: fs37.filehippo.com
>Accept:
>text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
>Accept-Encoding: gzip, deflate, sdch
>Accept-Language: en-US,en;q=0.8
>Referer:
>http://filehippo.com/download_vlc_64/download/56a450f832aee6bb4fda3b01259f9866/
>Upgrade-Insecure-Requests: 1
>User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36
>(KHTML, like Gecko) Chrome/49.0.2623.87 Safari/537.36
>
>HTTP/1.1 200 OK
>Accept-Ranges: bytes
>Age: 0
>Connection: keep-alive
>Content-Length: 31367109
>Content-Type: application/octet-stream
>Date: Wed, 30 Mar 2016 13:26:43 GMT
>ETag: "81341be3a62d11:0"
>Last-Modified: Mon, 08 Feb 2016 06:34:21 GMT
>Server: ATS
>
>--
>Regards,
>Faisal.
>