You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@trafficserver.apache.org by Mohd Akhbar <my...@gmail.com> on 2013/03/14 05:15:58 UTC
cacheurl plugin in 3.2.4
Just started testing TS, previously on squid. I found that cacheurl plugin
is an interesting but how do i get it to work/compile & requirement to
compile in Centos 6. Any guide that i can refer ?
Thanks
Re: cacheurl plugin in 3.2.4
Posted by Bruno Araújo <bj...@gmail.com>.
If it works like squid, call the original url than ATS translates it again and make a hit.
_______________
Antes de imprimir, verifique se tem papel e tinta suficiente na impressora.
Em 30/03/2013, às 01:33, Mohd Akhbar <my...@gmail.com> escreveu:
> i have a this in my cacheurl.log
>
> http://r8---sn-5hn7su7s.c.youtube.com/videoplayback?newshard=yes&cp=U0hVSVVPU19OTkNONV9NSVdIOmZ0b250YXNVanNJ&upn=LSlJ_XJrWLg&ip=103.31.34.2&ms=tsu&fexp=912513%2C926502%2C900817%2C916624%2C929809%2C932000%2C906383%2C902000%2C919512%2C929903%2C931202%2C900821%2C900823%2C931203%2C931401%2C912515%2C908529%2C919373%2C930803%2C906836%2C920201%2C929602%2C930101%2C930603%2C926403%2C900824%2C910223&source=youtube&itag=22&ipbits=8&sparams=cp%2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&id=06e26a35933d3cb1&key=yt1&expire=1364545794&mv=m&mt=1364522167&sver=3&ratebypass=yes&signature=071750A18FB381239A3DCFA6CBF25E5A6E444D42.1DB8F36D8F1ACCADB268A2F53ADC6A5DAB33B35C&redirect_counter=1&cms_redirect=yes to http://video-srv.youtube.com.ATSINTERNAL/itag=22&id=06e26a35933d3cb1
>
> and from what i understand is that the plugins successfully translate y0utube url to http://video-srv.youtube.com.ATSINTERNAL/itag=22&id=06e26a35933d3cb1 . But how do i call the link cause it gives me
>
> Unknown Host
>
> Description: Unable to locate the server named "video-srv.youtube.com.atsinternal (2)" --- the server does not have a DNS entry. Perhaps there is a misspelling in the server name, or the server no longer exists. Double-check the name and try again.
>
>
> Any suggestion ?
>
>
> On Sat, Mar 30, 2013 at 11:44 AM, Mohd Akhbar <my...@gmail.com> wrote:
> Does anybody have a working cacheurl rule to cache y0utube as i would like to implement it in our college and our bandwidth are very limited ? The previous suggested rules seems not working as it doesn't give a hit inthe log.
>
> Thanks.
>
>
> On Wed, Mar 20, 2013 at 11:01 PM, Mark Harrison <ma...@omniti.com> wrote:
> d'oh. You're right. It was done a while ago, so I'm blaming an earlier
> version of me for that. Feel free to remove any '\/' and replace with
> just '/'. Leaving them in shouldn't hurt anything though.
>
> On Wed, Mar 20, 2013 at 10:51 AM, Igor Galić <i....@brainsware.org> wrote:
> >
> >
> > ----- Original Message -----
> >> The regex/cacheurl line I've used in the past is:
> >>
> >> http:\/\/(.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com)\/(get_video|videoplayback|videodownload)\?.*?\&(itag=[0-9]*).*?\&(id=[a-zA-Z0-9]*)
> >> http://video-srv.youtube.com.ATSINTERNAL/$3&$4
> >
> >
> > I don't think you need to excape / in our regex
> >
> > -- i
> >
> >> The following page has some information on how to cache youtube
> >> content and is the source for the above regex:
> >> http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube#ConfigExamples.2BAC8-DynamicContent.2BAC8-YouTube.2BAC8-Discussion.To_cache_that_content
> >> If you look at the storeurl script, it uses perl to extract the itag,
> >> id and range, and then uses those to form the cache url. The rest of
> >> the parameters are not relevant to the content served, so you can
> >> ignore them. The regex above doesn't include range= (it looks like
> >> that was a more recent update to the squid page) so you'll probably
> >> want to add something to match that also and/or deal with range
> >> requests in another way (remap them to full requests for example).
> >>
> >> HTH,
> >>
> >> Mark
> >>
> >>
> >> On Fri, Mar 15, 2013 at 3:47 AM, Mohd Akhbar <my...@gmail.com>
> >> wrote:
> >> > Somehow i manage to get the cacheurl plugin to compile, thanks for
> >> > the hint.
> >> > I would like to test to cache youtube video, but seems like
> >> > impossible to
> >> > make a regex...example
> >> >
> >> > http://r5---sn-uh-30ad.c.youtube.com/videoplayback?algorithm=throttle-factor&ip=103.31.34.2&sver=3&factor=1.25&fexp=910071%2C914061%2C916625%2C929809%2C920704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C908529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824&itag=35&source=youtube&expire=1363356961&newshard=yes&mt=1363333513&ms=au&upn=hRMl7WiBTbI&mv=m&id=251f971ea2ab9567&key=yt1&burst=40&sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn%2Cexpire&ipbits=8&cp=U0hVSFNQVF9LS0NONV9LSlhKOmxGTVJlTThOdXBC&signature=C59BC1D10B06AF55A5B0AC8BF4C6CBB74246DE4F.BBAB79A56916A7A4561A0C0C19727AA0BB5455F1
> >> >
> >> > this is 1min video that i would like to try...
> >> >
> >> >
> >> > On Thu, Mar 14, 2013 at 9:39 PM, Vasiliy Lukyanets
> >> > <bl...@gmail.com>
> >> > wrote:
> >> >>
> >> >> # uname -a
> >> >> Linux 2.6.32-279.19.1.el6.x86_64 #1 SMP Wed Dec 19 07:05:20 UTC
> >> >> 2012
> >> >> x86_64 x86_64 x86_64 GNU/Linux
> >> >>
> >> >> # cd /root/trafficserver/plugins/experimental/cacheurl
> >> >> # /opt/ts/bin/tsxs -o cacheurl.so -c cacheurl.c
> >> >> compiling cacheurl.c -> cacheurl.lo
> >> >> linking -> cacheurl.so
> >> >>
> >> >> # cp cacheurl.so /opt/ts/libexec/trafficserver
> >> >>
> >> >>
> >> >> 2013/3/14 Mohd Akhbar <my...@gmail.com>
> >> >>>
> >> >>> Just started testing TS, previously on squid. I found that
> >> >>> cacheurl
> >> >>> plugin is an interesting but how do i get it to work/compile &
> >> >>> requirement
> >> >>> to compile in Centos 6. Any guide that i can refer ?
> >> >>>
> >> >>> Thanks
> >> >>
> >> >>
> >> >
> >>
> >>
> >>
> >> --
> >> Mark Harrison
> >> Lead Site Reliability Engineer
> >> OmniTI
> >>
> >
> > --
> > Igor Galić
> >
> > Tel: +43 (0) 664 886 22 883
> > Mail: i.galic@brainsware.org
> > URL: http://brainsware.org/
> > GPG: 6880 4155 74BD FD7C B515 2EA5 4B1D 9E08 A097 C9AE
> >
>
>
>
> --
> Mark Harrison
> Lead Site Reliability Engineer
> OmniTI
>
>
Re: cacheurl plugin in 3.2.4
Posted by Mohd Akhbar <my...@gmail.com>.
i have a this in my cacheurl.log
http://r8---sn-5hn7su7s.c.youtube.com/videoplayback?newshard=yes&cp=U0hVSVVPU19OTkNONV9NSVdIOmZ0b250YXNVanNJ&upn=LSlJ_XJrWLg&ip=103.31.34.2&ms=tsu&fexp=912513%2C926502%2C900817%2C916624%2C929809%2C932000%2C906383%2C902000%2C919512%2C929903%2C931202%2C900821%2C900823%2C931203%2C931401%2C912515%2C908529%2C919373%2C930803%2C906836%2C920201%2C929602%2C930101%2C930603%2C926403%2C900824%2C910223&source=youtube&itag=22&ipbits=8&sparams=cp%2Cid%2Cip%2Cipbits%2Citag%2Cratebypass%2Csource%2Cupn%2Cexpire&id=06e26a35933d3cb1&key=yt1&expire=1364545794&mv=m&mt=1364522167&sver=3&ratebypass=yes&signature=071750A18FB381239A3DCFA6CBF25E5A6E444D42.1DB8F36D8F1ACCADB268A2F53ADC6A5DAB33B35C&redirect_counter=1&cms_redirect=yesto
http://video-srv.youtube.com.ATSINTERNAL/itag=22&id=06e26a35933d3cb1
and from what i understand is that the plugins successfully translate
y0utube url to
http://video-srv.youtube.com.ATSINTERNAL/itag=22&id=06e26a35933d3cb1 . But
how do i call the link cause it gives me
*Unknown Host
------------------------------
Description: Unable to locate the server named
"video-srv.youtube.com.atsinternal
(2)" --- the server does not have a DNS entry. Perhaps there is a
misspelling in the server name, or the server no longer exists.
Double-check the name and try again.*
Any suggestion ?
On Sat, Mar 30, 2013 at 11:44 AM, Mohd Akhbar <my...@gmail.com> wrote:
> Does anybody have a working cacheurl rule to cache y0utube as i would like
> to implement it in our college and our bandwidth are very limited ? The
> previous suggested rules seems not working as it doesn't give a hit inthe
> log.
>
> Thanks.
>
>
> On Wed, Mar 20, 2013 at 11:01 PM, Mark Harrison <ma...@omniti.com> wrote:
>
>> d'oh. You're right. It was done a while ago, so I'm blaming an earlier
>> version of me for that. Feel free to remove any '\/' and replace with
>> just '/'. Leaving them in shouldn't hurt anything though.
>>
>> On Wed, Mar 20, 2013 at 10:51 AM, Igor Galić <i....@brainsware.org>
>> wrote:
>> >
>> >
>> > ----- Original Message -----
>> >> The regex/cacheurl line I've used in the past is:
>> >>
>> >>
>> http:\/\/(.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com)\/(get_video|videoplayback|videodownload)\?.*?\&(itag=[0-9]*).*?\&(id=[a-zA-Z0-9]*)
>> >> http://video-srv.youtube.com.ATSINTERNAL/$3&$4
>> >
>> >
>> > I don't think you need to excape / in our regex
>> >
>> > -- i
>> >
>> >> The following page has some information on how to cache youtube
>> >> content and is the source for the above regex:
>> >>
>> http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube#ConfigExamples.2BAC8-DynamicContent.2BAC8-YouTube.2BAC8-Discussion.To_cache_that_content
>> >> If you look at the storeurl script, it uses perl to extract the itag,
>> >> id and range, and then uses those to form the cache url. The rest of
>> >> the parameters are not relevant to the content served, so you can
>> >> ignore them. The regex above doesn't include range= (it looks like
>> >> that was a more recent update to the squid page) so you'll probably
>> >> want to add something to match that also and/or deal with range
>> >> requests in another way (remap them to full requests for example).
>> >>
>> >> HTH,
>> >>
>> >> Mark
>> >>
>> >>
>> >> On Fri, Mar 15, 2013 at 3:47 AM, Mohd Akhbar <my...@gmail.com>
>> >> wrote:
>> >> > Somehow i manage to get the cacheurl plugin to compile, thanks for
>> >> > the hint.
>> >> > I would like to test to cache youtube video, but seems like
>> >> > impossible to
>> >> > make a regex...example
>> >> >
>> >> >
>> http://r5---sn-uh-30ad.c.youtube.com/videoplayback?algorithm=throttle-factor&ip=103.31.34.2&sver=3&factor=1.25&fexp=910071%2C914061%2C916625%2C929809%2C920704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C908529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824&itag=35&source=youtube&expire=1363356961&newshard=yes&mt=1363333513&ms=au&upn=hRMl7WiBTbI&mv=m&id=251f971ea2ab9567&key=yt1&burst=40&sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn%2Cexpire&ipbits=8&cp=U0hVSFNQVF9LS0NONV9LSlhKOmxGTVJlTThOdXBC&signature=C59BC1D10B06AF55A5B0AC8BF4C6CBB74246DE4F.BBAB79A56916A7A4561A0C0C19727AA0BB5455F1
>> >> >
>> >> > this is 1min video that i would like to try...
>> >> >
>> >> >
>> >> > On Thu, Mar 14, 2013 at 9:39 PM, Vasiliy Lukyanets
>> >> > <bl...@gmail.com>
>> >> > wrote:
>> >> >>
>> >> >> # uname -a
>> >> >> Linux 2.6.32-279.19.1.el6.x86_64 #1 SMP Wed Dec 19 07:05:20 UTC
>> >> >> 2012
>> >> >> x86_64 x86_64 x86_64 GNU/Linux
>> >> >>
>> >> >> # cd /root/trafficserver/plugins/experimental/cacheurl
>> >> >> # /opt/ts/bin/tsxs -o cacheurl.so -c cacheurl.c
>> >> >> compiling cacheurl.c -> cacheurl.lo
>> >> >> linking -> cacheurl.so
>> >> >>
>> >> >> # cp cacheurl.so /opt/ts/libexec/trafficserver
>> >> >>
>> >> >>
>> >> >> 2013/3/14 Mohd Akhbar <my...@gmail.com>
>> >> >>>
>> >> >>> Just started testing TS, previously on squid. I found that
>> >> >>> cacheurl
>> >> >>> plugin is an interesting but how do i get it to work/compile &
>> >> >>> requirement
>> >> >>> to compile in Centos 6. Any guide that i can refer ?
>> >> >>>
>> >> >>> Thanks
>> >> >>
>> >> >>
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Mark Harrison
>> >> Lead Site Reliability Engineer
>> >> OmniTI
>> >>
>> >
>> > --
>> > Igor Galić
>> >
>> > Tel: +43 (0) 664 886 22 883
>> > Mail: i.galic@brainsware.org
>> > URL: http://brainsware.org/
>> > GPG: 6880 4155 74BD FD7C B515 2EA5 4B1D 9E08 A097 C9AE
>> >
>>
>>
>>
>> --
>> Mark Harrison
>> Lead Site Reliability Engineer
>> OmniTI
>>
>
>
Re: cacheurl plugin in 3.2.4
Posted by Mohd Akhbar <my...@gmail.com>.
Does anybody have a working cacheurl rule to cache y0utube as i would like
to implement it in our college and our bandwidth are very limited ? The
previous suggested rules seems not working as it doesn't give a hit inthe
log.
Thanks.
On Wed, Mar 20, 2013 at 11:01 PM, Mark Harrison <ma...@omniti.com> wrote:
> d'oh. You're right. It was done a while ago, so I'm blaming an earlier
> version of me for that. Feel free to remove any '\/' and replace with
> just '/'. Leaving them in shouldn't hurt anything though.
>
> On Wed, Mar 20, 2013 at 10:51 AM, Igor Galić <i....@brainsware.org>
> wrote:
> >
> >
> > ----- Original Message -----
> >> The regex/cacheurl line I've used in the past is:
> >>
> >>
> http:\/\/(.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com)\/(get_video|videoplayback|videodownload)\?.*?\&(itag=[0-9]*).*?\&(id=[a-zA-Z0-9]*)
> >> http://video-srv.youtube.com.ATSINTERNAL/$3&$4
> >
> >
> > I don't think you need to excape / in our regex
> >
> > -- i
> >
> >> The following page has some information on how to cache youtube
> >> content and is the source for the above regex:
> >>
> http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube#ConfigExamples.2BAC8-DynamicContent.2BAC8-YouTube.2BAC8-Discussion.To_cache_that_content
> >> If you look at the storeurl script, it uses perl to extract the itag,
> >> id and range, and then uses those to form the cache url. The rest of
> >> the parameters are not relevant to the content served, so you can
> >> ignore them. The regex above doesn't include range= (it looks like
> >> that was a more recent update to the squid page) so you'll probably
> >> want to add something to match that also and/or deal with range
> >> requests in another way (remap them to full requests for example).
> >>
> >> HTH,
> >>
> >> Mark
> >>
> >>
> >> On Fri, Mar 15, 2013 at 3:47 AM, Mohd Akhbar <my...@gmail.com>
> >> wrote:
> >> > Somehow i manage to get the cacheurl plugin to compile, thanks for
> >> > the hint.
> >> > I would like to test to cache youtube video, but seems like
> >> > impossible to
> >> > make a regex...example
> >> >
> >> >
> http://r5---sn-uh-30ad.c.youtube.com/videoplayback?algorithm=throttle-factor&ip=103.31.34.2&sver=3&factor=1.25&fexp=910071%2C914061%2C916625%2C929809%2C920704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C908529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824&itag=35&source=youtube&expire=1363356961&newshard=yes&mt=1363333513&ms=au&upn=hRMl7WiBTbI&mv=m&id=251f971ea2ab9567&key=yt1&burst=40&sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn%2Cexpire&ipbits=8&cp=U0hVSFNQVF9LS0NONV9LSlhKOmxGTVJlTThOdXBC&signature=C59BC1D10B06AF55A5B0AC8BF4C6CBB74246DE4F.BBAB79A56916A7A4561A0C0C19727AA0BB5455F1
> >> >
> >> > this is 1min video that i would like to try...
> >> >
> >> >
> >> > On Thu, Mar 14, 2013 at 9:39 PM, Vasiliy Lukyanets
> >> > <bl...@gmail.com>
> >> > wrote:
> >> >>
> >> >> # uname -a
> >> >> Linux 2.6.32-279.19.1.el6.x86_64 #1 SMP Wed Dec 19 07:05:20 UTC
> >> >> 2012
> >> >> x86_64 x86_64 x86_64 GNU/Linux
> >> >>
> >> >> # cd /root/trafficserver/plugins/experimental/cacheurl
> >> >> # /opt/ts/bin/tsxs -o cacheurl.so -c cacheurl.c
> >> >> compiling cacheurl.c -> cacheurl.lo
> >> >> linking -> cacheurl.so
> >> >>
> >> >> # cp cacheurl.so /opt/ts/libexec/trafficserver
> >> >>
> >> >>
> >> >> 2013/3/14 Mohd Akhbar <my...@gmail.com>
> >> >>>
> >> >>> Just started testing TS, previously on squid. I found that
> >> >>> cacheurl
> >> >>> plugin is an interesting but how do i get it to work/compile &
> >> >>> requirement
> >> >>> to compile in Centos 6. Any guide that i can refer ?
> >> >>>
> >> >>> Thanks
> >> >>
> >> >>
> >> >
> >>
> >>
> >>
> >> --
> >> Mark Harrison
> >> Lead Site Reliability Engineer
> >> OmniTI
> >>
> >
> > --
> > Igor Galić
> >
> > Tel: +43 (0) 664 886 22 883
> > Mail: i.galic@brainsware.org
> > URL: http://brainsware.org/
> > GPG: 6880 4155 74BD FD7C B515 2EA5 4B1D 9E08 A097 C9AE
> >
>
>
>
> --
> Mark Harrison
> Lead Site Reliability Engineer
> OmniTI
>
Re: cacheurl plugin in 3.2.4
Posted by Mark Harrison <ma...@omniti.com>.
d'oh. You're right. It was done a while ago, so I'm blaming an earlier
version of me for that. Feel free to remove any '\/' and replace with
just '/'. Leaving them in shouldn't hurt anything though.
On Wed, Mar 20, 2013 at 10:51 AM, Igor Galić <i....@brainsware.org> wrote:
>
>
> ----- Original Message -----
>> The regex/cacheurl line I've used in the past is:
>>
>> http:\/\/(.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com)\/(get_video|videoplayback|videodownload)\?.*?\&(itag=[0-9]*).*?\&(id=[a-zA-Z0-9]*)
>> http://video-srv.youtube.com.ATSINTERNAL/$3&$4
>
>
> I don't think you need to excape / in our regex
>
> -- i
>
>> The following page has some information on how to cache youtube
>> content and is the source for the above regex:
>> http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube#ConfigExamples.2BAC8-DynamicContent.2BAC8-YouTube.2BAC8-Discussion.To_cache_that_content
>> If you look at the storeurl script, it uses perl to extract the itag,
>> id and range, and then uses those to form the cache url. The rest of
>> the parameters are not relevant to the content served, so you can
>> ignore them. The regex above doesn't include range= (it looks like
>> that was a more recent update to the squid page) so you'll probably
>> want to add something to match that also and/or deal with range
>> requests in another way (remap them to full requests for example).
>>
>> HTH,
>>
>> Mark
>>
>>
>> On Fri, Mar 15, 2013 at 3:47 AM, Mohd Akhbar <my...@gmail.com>
>> wrote:
>> > Somehow i manage to get the cacheurl plugin to compile, thanks for
>> > the hint.
>> > I would like to test to cache youtube video, but seems like
>> > impossible to
>> > make a regex...example
>> >
>> > http://r5---sn-uh-30ad.c.youtube.com/videoplayback?algorithm=throttle-factor&ip=103.31.34.2&sver=3&factor=1.25&fexp=910071%2C914061%2C916625%2C929809%2C920704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C908529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824&itag=35&source=youtube&expire=1363356961&newshard=yes&mt=1363333513&ms=au&upn=hRMl7WiBTbI&mv=m&id=251f971ea2ab9567&key=yt1&burst=40&sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn%2Cexpire&ipbits=8&cp=U0hVSFNQVF9LS0NONV9LSlhKOmxGTVJlTThOdXBC&signature=C59BC1D10B06AF55A5B0AC8BF4C6CBB74246DE4F.BBAB79A56916A7A4561A0C0C19727AA0BB5455F1
>> >
>> > this is 1min video that i would like to try...
>> >
>> >
>> > On Thu, Mar 14, 2013 at 9:39 PM, Vasiliy Lukyanets
>> > <bl...@gmail.com>
>> > wrote:
>> >>
>> >> # uname -a
>> >> Linux 2.6.32-279.19.1.el6.x86_64 #1 SMP Wed Dec 19 07:05:20 UTC
>> >> 2012
>> >> x86_64 x86_64 x86_64 GNU/Linux
>> >>
>> >> # cd /root/trafficserver/plugins/experimental/cacheurl
>> >> # /opt/ts/bin/tsxs -o cacheurl.so -c cacheurl.c
>> >> compiling cacheurl.c -> cacheurl.lo
>> >> linking -> cacheurl.so
>> >>
>> >> # cp cacheurl.so /opt/ts/libexec/trafficserver
>> >>
>> >>
>> >> 2013/3/14 Mohd Akhbar <my...@gmail.com>
>> >>>
>> >>> Just started testing TS, previously on squid. I found that
>> >>> cacheurl
>> >>> plugin is an interesting but how do i get it to work/compile &
>> >>> requirement
>> >>> to compile in Centos 6. Any guide that i can refer ?
>> >>>
>> >>> Thanks
>> >>
>> >>
>> >
>>
>>
>>
>> --
>> Mark Harrison
>> Lead Site Reliability Engineer
>> OmniTI
>>
>
> --
> Igor Galić
>
> Tel: +43 (0) 664 886 22 883
> Mail: i.galic@brainsware.org
> URL: http://brainsware.org/
> GPG: 6880 4155 74BD FD7C B515 2EA5 4B1D 9E08 A097 C9AE
>
--
Mark Harrison
Lead Site Reliability Engineer
OmniTI
Re: cacheurl plugin in 3.2.4
Posted by Igor Galić <i....@brainsware.org>.
----- Original Message -----
> The regex/cacheurl line I've used in the past is:
>
> http:\/\/(.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com)\/(get_video|videoplayback|videodownload)\?.*?\&(itag=[0-9]*).*?\&(id=[a-zA-Z0-9]*)
> http://video-srv.youtube.com.ATSINTERNAL/$3&$4
I don't think you need to excape / in our regex
-- i
> The following page has some information on how to cache youtube
> content and is the source for the above regex:
> http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube#ConfigExamples.2BAC8-DynamicContent.2BAC8-YouTube.2BAC8-Discussion.To_cache_that_content
> If you look at the storeurl script, it uses perl to extract the itag,
> id and range, and then uses those to form the cache url. The rest of
> the parameters are not relevant to the content served, so you can
> ignore them. The regex above doesn't include range= (it looks like
> that was a more recent update to the squid page) so you'll probably
> want to add something to match that also and/or deal with range
> requests in another way (remap them to full requests for example).
>
> HTH,
>
> Mark
>
>
> On Fri, Mar 15, 2013 at 3:47 AM, Mohd Akhbar <my...@gmail.com>
> wrote:
> > Somehow i manage to get the cacheurl plugin to compile, thanks for
> > the hint.
> > I would like to test to cache youtube video, but seems like
> > impossible to
> > make a regex...example
> >
> > http://r5---sn-uh-30ad.c.youtube.com/videoplayback?algorithm=throttle-factor&ip=103.31.34.2&sver=3&factor=1.25&fexp=910071%2C914061%2C916625%2C929809%2C920704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C908529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824&itag=35&source=youtube&expire=1363356961&newshard=yes&mt=1363333513&ms=au&upn=hRMl7WiBTbI&mv=m&id=251f971ea2ab9567&key=yt1&burst=40&sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn%2Cexpire&ipbits=8&cp=U0hVSFNQVF9LS0NONV9LSlhKOmxGTVJlTThOdXBC&signature=C59BC1D10B06AF55A5B0AC8BF4C6CBB74246DE4F.BBAB79A56916A7A4561A0C0C19727AA0BB5455F1
> >
> > this is 1min video that i would like to try...
> >
> >
> > On Thu, Mar 14, 2013 at 9:39 PM, Vasiliy Lukyanets
> > <bl...@gmail.com>
> > wrote:
> >>
> >> # uname -a
> >> Linux 2.6.32-279.19.1.el6.x86_64 #1 SMP Wed Dec 19 07:05:20 UTC
> >> 2012
> >> x86_64 x86_64 x86_64 GNU/Linux
> >>
> >> # cd /root/trafficserver/plugins/experimental/cacheurl
> >> # /opt/ts/bin/tsxs -o cacheurl.so -c cacheurl.c
> >> compiling cacheurl.c -> cacheurl.lo
> >> linking -> cacheurl.so
> >>
> >> # cp cacheurl.so /opt/ts/libexec/trafficserver
> >>
> >>
> >> 2013/3/14 Mohd Akhbar <my...@gmail.com>
> >>>
> >>> Just started testing TS, previously on squid. I found that
> >>> cacheurl
> >>> plugin is an interesting but how do i get it to work/compile &
> >>> requirement
> >>> to compile in Centos 6. Any guide that i can refer ?
> >>>
> >>> Thanks
> >>
> >>
> >
>
>
>
> --
> Mark Harrison
> Lead Site Reliability Engineer
> OmniTI
>
--
Igor Galić
Tel: +43 (0) 664 886 22 883
Mail: i.galic@brainsware.org
URL: http://brainsware.org/
GPG: 6880 4155 74BD FD7C B515 2EA5 4B1D 9E08 A097 C9AE
Re: cacheurl plugin in 3.2.4
Posted by Mark Harrison <ma...@omniti.com>.
The regex/cacheurl line I've used in the past is:
http:\/\/(.*\.youtube\.com|.*\.googlevideo\.com|.*\.video\.google\.com)\/(get_video|videoplayback|videodownload)\?.*?\&(itag=[0-9]*).*?\&(id=[a-zA-Z0-9]*)
http://video-srv.youtube.com.ATSINTERNAL/$3&$4
The following page has some information on how to cache youtube
content and is the source for the above regex:
http://wiki.squid-cache.org/ConfigExamples/DynamicContent/YouTube#ConfigExamples.2BAC8-DynamicContent.2BAC8-YouTube.2BAC8-Discussion.To_cache_that_content
If you look at the storeurl script, it uses perl to extract the itag,
id and range, and then uses those to form the cache url. The rest of
the parameters are not relevant to the content served, so you can
ignore them. The regex above doesn't include range= (it looks like
that was a more recent update to the squid page) so you'll probably
want to add something to match that also and/or deal with range
requests in another way (remap them to full requests for example).
HTH,
Mark
On Fri, Mar 15, 2013 at 3:47 AM, Mohd Akhbar <my...@gmail.com> wrote:
> Somehow i manage to get the cacheurl plugin to compile, thanks for the hint.
> I would like to test to cache youtube video, but seems like impossible to
> make a regex...example
>
> http://r5---sn-uh-30ad.c.youtube.com/videoplayback?algorithm=throttle-factor&ip=103.31.34.2&sver=3&factor=1.25&fexp=910071%2C914061%2C916625%2C929809%2C920704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C908529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824&itag=35&source=youtube&expire=1363356961&newshard=yes&mt=1363333513&ms=au&upn=hRMl7WiBTbI&mv=m&id=251f971ea2ab9567&key=yt1&burst=40&sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn%2Cexpire&ipbits=8&cp=U0hVSFNQVF9LS0NONV9LSlhKOmxGTVJlTThOdXBC&signature=C59BC1D10B06AF55A5B0AC8BF4C6CBB74246DE4F.BBAB79A56916A7A4561A0C0C19727AA0BB5455F1
>
> this is 1min video that i would like to try...
>
>
> On Thu, Mar 14, 2013 at 9:39 PM, Vasiliy Lukyanets <bl...@gmail.com>
> wrote:
>>
>> # uname -a
>> Linux 2.6.32-279.19.1.el6.x86_64 #1 SMP Wed Dec 19 07:05:20 UTC 2012
>> x86_64 x86_64 x86_64 GNU/Linux
>>
>> # cd /root/trafficserver/plugins/experimental/cacheurl
>> # /opt/ts/bin/tsxs -o cacheurl.so -c cacheurl.c
>> compiling cacheurl.c -> cacheurl.lo
>> linking -> cacheurl.so
>>
>> # cp cacheurl.so /opt/ts/libexec/trafficserver
>>
>>
>> 2013/3/14 Mohd Akhbar <my...@gmail.com>
>>>
>>> Just started testing TS, previously on squid. I found that cacheurl
>>> plugin is an interesting but how do i get it to work/compile & requirement
>>> to compile in Centos 6. Any guide that i can refer ?
>>>
>>> Thanks
>>
>>
>
--
Mark Harrison
Lead Site Reliability Engineer
OmniTI
Re: cacheurl plugin in 3.2.4
Posted by Mohd Akhbar <my...@gmail.com>.
Somehow i manage to get the cacheurl plugin to compile, thanks for the
hint. I would like to test to cache youtube video, but seems like
impossible to make a regex...example
http://r5---sn-uh-30ad.c.youtube.com/videoplayback?algorithm=throttle-factor&ip=103.31.34.2&sver=3&factor=1.25&fexp=910071%2C914061%2C916625%2C929809%2C920704%2C912806%2C902000%2C919512%2C929901%2C913605%2C906938%2C931202%2C931401%2C908529%2C930803%2C920201%2C929602%2C930101%2C930603%2C900824&itag=35&source=youtube&expire=1363356961&newshard=yes&mt=1363333513&ms=au&upn=hRMl7WiBTbI&mv=m&id=251f971ea2ab9567&key=yt1&burst=40&sparams=algorithm%2Cburst%2Ccp%2Cfactor%2Cid%2Cip%2Cipbits%2Citag%2Csource%2Cupn%2Cexpire&ipbits=8&cp=U0hVSFNQVF9LS0NONV9LSlhKOmxGTVJlTThOdXBC&signature=C59BC1D10B06AF55A5B0AC8BF4C6CBB74246DE4F.BBAB79A56916A7A4561A0C0C19727AA0BB5455F1
this is 1min video that i would like to try...
On Thu, Mar 14, 2013 at 9:39 PM, Vasiliy Lukyanets
<bl...@gmail.com>wrote:
> # uname -a
> Linux 2.6.32-279.19.1.el6.x86_64 #1 SMP Wed Dec 19 07:05:20 UTC 2012
> x86_64 x86_64 x86_64 GNU/Linux
>
> # cd /root/trafficserver/plugins/experimental/cacheurl
> # /opt/ts/bin/tsxs -o cacheurl.so -c cacheurl.c
> compiling cacheurl.c -> cacheurl.lo
> linking -> cacheurl.so
>
> # cp cacheurl.so /opt/ts/libexec/trafficserver
>
>
> 2013/3/14 Mohd Akhbar <my...@gmail.com>
>
>> Just started testing TS, previously on squid. I found that cacheurl
>> plugin is an interesting but how do i get it to work/compile & requirement
>> to compile in Centos 6. Any guide that i can refer ?
>>
>> Thanks
>>
>
>
Re: cacheurl plugin in 3.2.4
Posted by Vasiliy Lukyanets <bl...@gmail.com>.
# uname -a
Linux 2.6.32-279.19.1.el6.x86_64 #1 SMP Wed Dec 19 07:05:20 UTC 2012 x86_64
x86_64 x86_64 GNU/Linux
# cd /root/trafficserver/plugins/experimental/cacheurl
# /opt/ts/bin/tsxs -o cacheurl.so -c cacheurl.c
compiling cacheurl.c -> cacheurl.lo
linking -> cacheurl.so
# cp cacheurl.so /opt/ts/libexec/trafficserver
2013/3/14 Mohd Akhbar <my...@gmail.com>
> Just started testing TS, previously on squid. I found that cacheurl plugin
> is an interesting but how do i get it to work/compile & requirement to
> compile in Centos 6. Any guide that i can refer ?
>
> Thanks
>