You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by "Faysal Banna (JIRA)" <ji...@apache.org> on 2015/05/01 17:15:06 UTC

[jira] [Commented] (TS-3531) cacheurl plugin not working in 5.3.0->5.3.x

    [ https://issues.apache.org/jira/browse/TS-3531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14523308#comment-14523308 ] 

Faysal Banna commented on TS-3531:
----------------------------------

Hi Guys.
been away from the systems lately but after returning back i saw that the bug still hanging on regarding cacheurl issue.

anyhow let me update you with the latest of what i have done and what i have found.
been using TS-5.2.1 things were ok but i needed to throttle origin server bandwidth and not throttle requests/s so i needed the patch that previously was done by sudheer. but the patch won't be installed on 5.2.1 says already patched and yet it does not work even though.
i went trying 5.3.0 where the TS-3414 says fix version 5.3.0 
and then cacheurl does not work anymore. 
it gets loaded and configs in cacheurl.config gets parsed correct 
but no url key->hash was done 
the steps reproduced was :
1- records.config 
CONFIG proxy.config.diags.debug.enabled INT 1
CONFIG proxy.config.diags.debug.tags STRING cacheurl
2- plugin.config
cacheurl.so /usr/local/etc/trafficserver/cacheurl.config
3- cacheurl.config
http://.*/speedtest/latency.txt\?.* http://SpeedTEST.net/latency.txt
http://.*/speedtest/random(.*)x(.*)\.jpg\?.* http://SpeedTEST.net/random$1x$2
4- start trafficserver and checked traffic.out in the logs i get 

traffic_server: using root directory '/usr/local'
[May  1 17:04:45.529] Server {0x7f4d5e705780} DIAG: (cacheurl) Adding pattern/replacement pair: 'http://.*/speedtest/latency.txt\?.*' -> 'http://SpeedTEST.net/latency.txt'
[May  1 17:04:45.529] Server {0x7f4d5e705780} DIAG: (cacheurl) Adding pattern/replacement pair: 'http://.*/speedtest/random(.*)x(.*)\.jpg\?.*' -> 'http://SpeedTEST.net/random$1x$2'

5- do a request to check :
export http_proxy=127.0.0.1:8080
wget -S -c 'http://www.dralle-electronics.de/speedtest/random2000x2000.jpg?x=1430489380795&y=7' --delete-after 
--2015-05-01 17:30:45--  http://www.dralle-electronics.de/speedtest/random2000x2000.jpg?x=1430489380795&y=7
Connecting to 127.0.0.1:8080... connected.
Proxy request sent, awaiting response... 
  HTTP/1.1 200 OK
  Date: Fri, 01 May 2015 14:09:39 GMT
  Server: Apache
  Last-Modified: Mon, 06 Mar 2006 15:26:32 GMT
  ETag: "a120cae-78a99c-40e5526c07a00"
  Accept-Ranges: bytes
  Content-Length: 7907740
  X-Powered-By: PleskLin
  Content-Type: image/jpeg
  Age: 1266
  Proxy-Connection: keep-alive
  Via: http/1.1 UB1-tst1 (AdySys/5.2.0 [uScMsSfWpSeN:t cCMi p sS])
Length: 7907740 (7.5M) [image/jpeg]
Saving to: ‘random2000x2000.jpg?x=1430489380795&y=7’

100%[=======================================================================================================================================================>] 7,907,740   9.14MB/s   in 0.8s   

2015-05-01 17:30:46 (9.14 MB/s) - ‘random2000x2000.jpg?x=1430489380795&y=7’ saved [7907740/7907740]

Removing random2000x2000.jpg?x=1430489380795&y=7.
6- do the request again to double check if it is cacheable and cached 
wget -S -c 'http://www.dralle-electronics.de/speedtest/random2000x2000.jpg?x=1430489380795&y=7' --delete-after 
--2015-05-01 17:31:34--  http://www.dralle-electronics.de/speedtest/random2000x2000.jpg?x=1430489380795&y=7
Connecting to 127.0.0.1:8080... connected.
Proxy request sent, awaiting response... 
  HTTP/1.1 200 OK
  Date: Fri, 01 May 2015 14:09:39 GMT
  Server: Apache
  Last-Modified: Mon, 06 Mar 2006 15:26:32 GMT
  ETag: "a120cae-78a99c-40e5526c07a00"
  Accept-Ranges: bytes
  Content-Length: 7907740
  X-Powered-By: PleskLin
  Content-Type: image/jpeg
  Age: 1315
  Proxy-Connection: keep-alive
  Via: http/1.1 UB1-tst1 (AdySys/5.2.0 [uScHs f p eN:t cCHi p s ])
Length: 7907740 (7.5M) [image/jpeg]
Saving to: ‘random2000x2000.jpg?x=1430489380795&y=7’

100%[=======================================================================================================================================================>] 7,907,740   --.-K/s   in 0.04s   

2015-05-01 17:31:34 (188 MB/s) - ‘random2000x2000.jpg?x=1430489380795&y=7’ saved [7907740/7907740]

Removing random2000x2000.jpg?x=1430489380795&y=7.

7- after checking the traffic.out log file still no sign of any transformation done 
i just change attribute and test wget again 

wget -S -c 'http://www.dralle-electronics.de/speedtest/random2000x2000.jpg?x=1430489380795&y=8' --delete-after 
--2015-05-01 17:32:39--  http://www.dralle-electronics.de/speedtest/random2000x2000.jpg?x=1430489380795&y=8
Connecting to 127.0.0.1:8080... connected.
Proxy request sent, awaiting response... 
  HTTP/1.1 200 OK
  Date: Fri, 01 May 2015 14:09:39 GMT
  Server: Apache
  Last-Modified: Mon, 06 Mar 2006 15:26:32 GMT
  ETag: "a120cae-78a99c-40e5526c07a00"
  Accept-Ranges: bytes
  Content-Length: 7907740
  X-Powered-By: PleskLin
  Content-Type: image/jpeg
  Age: 1380
  Proxy-Connection: keep-alive
  Via: http/1.1 UB1-tst1 (AdySys/5.2.0 [uScMsSfWpSeN:t cCMi p sS])
Length: 7907740 (7.5M) [image/jpeg]
Saving to: ‘random2000x2000.jpg?x=1430489380795&y=8’

100%[=======================================================================================================================================================>] 7,907,740   9.42MB/s   in 0.8s   

2015-05-01 17:32:40 (9.42 MB/s) - ‘random2000x2000.jpg?x=1430489380795&y=8’ saved [7907740/7907740]

Removing random2000x2000.jpg?x=1430489380795&y=8.
 

as you see file was not cached depending on the key/hash information i asked it to 




> cacheurl plugin not working in 5.3.0->5.3.x
> -------------------------------------------
>
>                 Key: TS-3531
>                 URL: https://issues.apache.org/jira/browse/TS-3531
>             Project: Traffic Server
>          Issue Type: Bug
>          Components: Cache, Plugins
>            Reporter: Faysal Banna
>             Fix For: 6.0.0
>
>
> Hi Guys 
> was working and doing tests on 5.3.0 before i could integrate it in my production servers, and while doing so i noticed some issues with cacheurl plugin and maybe other plugins but that i can not confirm. 
> Here is what my observation was : 
> in cacheurl.config i have 
> http://s1.2mdn.net/viewad/4079501/BeitMisk_Spring_160x600_web.gif http://tested/switched.gif 
> loaded cacheurl.so cacheurl.config  in plugin.config
> and i confirm that i get [Apr 18 02:45:54.442] Server {0x2b05b69fba80} DIAG: (cacheurl) Adding pattern/replacement pair: 'http://s1.2mdn.net/viewad/4079501/BeitMisk_Spring_160x600_web.gif' -> 'http://tested/switched.gif'
> in traffic.out 
> which says that the pattern was added correctly 
> nevertheless when i do curl or wget with xdebug header request 
> i get : 
> X-Cache-Key: http://s1.2mdn.net/viewad/4079501/BeitMisk_Spring_160x600_web.gif
> meaning that the cacheurl plugin didn't actually do the mapping in any way possible 
> Next was testing with 5.2.1 version of ATS to see how things go so i git cloned it and compiled and ran the same test again 
> now i get 
>  X-Cache-Key: http://tested/switched.gif
> which means that cacheurl in 5.2.1 works while in latest mainstream or 5.3.0  it does not 
> i shall do further tests and feed you back here 
> much regards 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)