You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@httpd.apache.org by "Roy T. Fielding" <fi...@gbiv.com> on 2009/06/15 06:25:28 UTC

incubator proposal for (what was once) Inktomi Traffic Server

I think this is an interesting opportunity to compare
different implementations and share code where desirable.
I haven't seen anyone comment on the proposal yet.

....Roy


Begin forwarded message:

> From: Leif Hedstrom <le...@yahoo-inc.com>
> Date: June 12, 2009 9:17:59 AM PDT
> To: general@incubator.apache.org
> Subject: [Proposal] Traffic Server
>
>
> Good morning,
>
> We would like to submit the Traffic Server proposal to the  
> incubator. Our draft is available at
>
>    http://wiki.apache.org/incubator/TrafficServerProposal
>
>
> A quick overview of Traffic Server:
>
> Traffic Server is a Yahoo! / Inktomi caching proxy server. It has  
> been actively developed and used inside Yahoo! for the last 3+  
> years, and we are now ready to begin the next step in it's  
> evolution: make it Open Source. TS is a fairly large piece of  
> software (300k+ lines of C/C++ code), and provides features and  
> benefits lacking in many existing proxy/caches.
>
> I am obviously looking for feedback and comments on the proposal,  
> as well as a few mentors. Doug Cutting has accepted to be our  
> Champion.
>
> Thanks,
>
> -- Leif

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by Albert Lash <al...@gmail.com>.
This looks wonderful to me. I've been using Varnish and Nginx as
reverse proxies a lot lately and have used mod_proxy a bunch in the
past - they are all extremely useful tools and I believe there is
still more room for additional tools.

On Mon, Jun 15, 2009 at 12:25 AM, Roy T. Fielding<fi...@gbiv.com> wrote:
> I think this is an interesting opportunity to compare
> different implementations and share code where desirable.
> I haven't seen anyone comment on the proposal yet.
>
> ....Roy
>
>
> Begin forwarded message:
>
>> From: Leif Hedstrom <le...@yahoo-inc.com>
>> Date: June 12, 2009 9:17:59 AM PDT
>> To: general@incubator.apache.org
>> Subject: [Proposal] Traffic Server
>>
>>
>> Good morning,
>>
>> We would like to submit the Traffic Server proposal to the incubator. Our
>> draft is available at
>>
>>   http://wiki.apache.org/incubator/TrafficServerProposal
>>
>>
>> A quick overview of Traffic Server:
>>
>> Traffic Server is a Yahoo! / Inktomi caching proxy server. It has been
>> actively developed and used inside Yahoo! for the last 3+ years, and we are
>> now ready to begin the next step in it's evolution: make it Open Source. TS
>> is a fairly large piece of software (300k+ lines of C/C++ code), and
>> provides features and benefits lacking in many existing proxy/caches.
>>
>> I am obviously looking for feedback and comments on the proposal, as well
>> as a few mentors. Doug Cutting has accepted to be our Champion.
>>
>> Thanks,
>>
>> -- Leif
>

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by "Brian J. France" <li...@firehawksystems.com>.
On Jun 16, 2009, at 10:02 AM, howard chen wrote:
> On Mon, Jun 15, 2009 at 12:25 PM, Roy T. Fielding<fi...@gbiv.com>  
> wrote:
>> I think this is an interesting opportunity to compare
>> different implementations and share code where desirable.
>> I haven't seen anyone comment on the proposal yet.
>>
>
> Just out of curiosity, Flickr has been a die hard users of Squid.
>
> Did your team ever convinced them to use YTS?


While I don't work on the YTS team, I am in the same group and deal a  
lot with them.

I believe Flickr partially uses YTS already for serving all movies,  
but I could be wrong.

The YTS team is working with Flickr on evaluating YTS as an  
alternative to squid, but I don't know how it is going.

Brian


Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by howard chen <ho...@gmail.com>.
Hello,

On Mon, Jun 15, 2009 at 12:25 PM, Roy T. Fielding<fi...@gbiv.com> wrote:
> I think this is an interesting opportunity to compare
> different implementations and share code where desirable.
> I haven't seen anyone comment on the proposal yet.
>

Just out of curiosity, Flickr has been a die hard users of Squid.

Did your team ever convinced them to use YTS?

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by howard chen <ho...@gmail.com>.
On Tue, Jun 16, 2009 at 9:41 PM, Albert Lash<al...@gmail.com> wrote:
> Speaking of code, I'd be very glad to see more C / C++ in the Apache
> projects. Java is fine but I think Apache went overboard with it a
> little.

+1

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by jean-frederic clere <jf...@gmail.com>.
Jeff Trawick wrote:
> On Tue, Jun 16, 2009 at 9:41 AM, Albert Lash <albert.lash@gmail.com 
> <ma...@gmail.com>> wrote:
> 
>     +1
> 
>     Speaking of code, I'd be very glad to see more C / C++ in the Apache
>     projects. Java is fine but I think Apache went overboard with it a
>     little.
> 
> 
> "Apache" is not a committee that decides what should be developed or 
> imposes standards like selection of implementation language or other 
> such details.  The common aspects are instead issues like governing 
> structure, licensing, and community model.  (See 
> http://incubator.apache.org/ and docs linked from that page.)

I think that anyone interested in Traffic should join the discussion in 
general@incubator.apache.org.

The httpd  community is probably the best one to receive the project and 
use it to improve our reserve proxy modules.

Cheers

Jean-Frederic

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by Jeff Trawick <tr...@gmail.com>.
On Tue, Jun 16, 2009 at 10:32 AM, Albert Lash <al...@gmail.com> wrote:

> > "Apache" is not a committee that decides what should be developed or
> imposes
> > standards like selection of implementation language or other such
> details.
> > The common aspects are instead issues like governing structure,
> licensing,
> > and community model.  (See http://incubator.apache.org/ and docs linked
> from
> > that page.)
> >
> > The predominance of one language or another simply reflects the desire of
> > the groups that started the projects.
> >
> > Or:
> >
> > Start a project (and of course select implementation details like
> language).
> > Generate shared interest in ongoing open source development/support.
> > Decide as a group that you agree with ASF principles and would like to
> see
> > it as an ASF project.
> > Go to http://incubator.apache.org/ and proceed from there.
> >
> >
>
> Thanks Jeff, I hope your use of quotes doesn't mean I've painted
> myself clueless.


I wouldn't put it exactly in those terms ;)  Your comment did seem to stem
from a misunderstanding, and the rapid +1 led me to think that this
misunderstanding might be more widely held (and I was stuck trying to decide
out how to properly verify the fix for a defect I had opened), so I
responded.

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by Albert Lash <al...@gmail.com>.
> "Apache" is not a committee that decides what should be developed or imposes
> standards like selection of implementation language or other such details.
> The common aspects are instead issues like governing structure, licensing,
> and community model.  (See http://incubator.apache.org/ and docs linked from
> that page.)
>
> The predominance of one language or another simply reflects the desire of
> the groups that started the projects.
>
> Or:
>
> Start a project (and of course select implementation details like language).
> Generate shared interest in ongoing open source development/support.
> Decide as a group that you agree with ASF principles and would like to see
> it as an ASF project.
> Go to http://incubator.apache.org/ and proceed from there.
>
>

Thanks Jeff, I hope your use of quotes doesn't mean I've painted
myself clueless. I admit - poor choice of words on my part. I
understand that there wasn't a conscious decision by "Apache" to
switch to Java. I only meant to say that I, personally, would be
pleased to see more C/C++ projects under the Apache umbrella at large
for the selfish reasons that I really like how ASF runs things and
that I really like C/C++. :-)

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by Jeff Trawick <tr...@gmail.com>.
On Tue, Jun 16, 2009 at 9:41 AM, Albert Lash <al...@gmail.com> wrote:

> +1
>
> Speaking of code, I'd be very glad to see more C / C++ in the Apache
> projects. Java is fine but I think Apache went overboard with it a
> little.


"Apache" is not a committee that decides what should be developed or imposes
standards like selection of implementation language or other such details.
The common aspects are instead issues like governing structure, licensing,
and community model.  (See http://incubator.apache.org/ and docs linked from
that page.)

The predominance of one language or another simply reflects the desire of
the groups that started the projects.

Or:

Start a project (and of course select implementation details like language).
Generate shared interest in ongoing open source development/support.
Decide as a group that you agree with ASF principles and would like to see
it as an ASF project.
Go to http://incubator.apache.org/ and proceed from there.

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by Albert Lash <al...@gmail.com>.
+1

Speaking of code, I'd be very glad to see more C / C++ in the Apache
projects. Java is fine but I think Apache went overboard with it a
little.

On Tue, Jun 16, 2009 at 3:19 AM, jean-frederic clere<jf...@gmail.com> wrote:
> Roy T. Fielding wrote:
>>
>> I think this is an interesting opportunity to compare
>> different implementations and share code where desirable.
>> I haven't seen anyone comment on the proposal yet.
>
> +1  More code, more fun :-)
>
> Cheers
>
> Jean-Frederic
>

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by jean-frederic clere <jf...@gmail.com>.
Roy T. Fielding wrote:
> I think this is an interesting opportunity to compare
> different implementations and share code where desirable.
> I haven't seen anyone comment on the proposal yet.

+1  More code, more fun :-)

Cheers

Jean-Frederic

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by Pranav Desai <pr...@gmail.com>.
On Mon, Jun 15, 2009 at 12:06 PM, Akins, Brian<Br...@turner.com> wrote:
> On 6/15/09 12:39 PM, "Pranav Desai" <pr...@gmail.com> wrote:
>
>> The 35000 rps is for reverse proxy or forward proxy ?
>>
>
> Of course, I've coerced a stock mod_disk_cache/mod_proxy_http httpd server
> to over 40k rps on normal serevr hardware. It all depends on the benchmark.
>

I haven't done much testing with mod_proxy_http as a forward proxy,
but 40k seems really good ! ... will it be possible for you share your
mpm model and related parameters and what test tool do you use to
generate that load ?

Thanks
-- Pranav

> FWIW, the more code we can play with, the better.  Who knows what goodies we
> may find.
>
> --
> Brian Akins
>
>

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by Albert Lash <al...@gmail.com>.
>> This sounds awesome. Can it act as a forward proxy as well ? I guess
>> we will find out once the source is released.
>
>
> Yes, YTS can be used as a forward proxy.
>

Now that is awesome. I'm very interested now!

Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by "Brian J. France" <li...@firehawksystems.com>.
On Jun 15, 2009, at 12:39 PM, Pranav Desai wrote:

> On Sun, Jun 14, 2009 at 9:25 PM, Roy T. Fielding<fi...@gbiv.com>  
> wrote:
>> I think this is an interesting opportunity to compare
>> different implementations and share code where desirable.
>> I haven't seen anyone comment on the proposal yet.
>>
>> ....Roy
>>
>>
>> Begin forwarded message:
>>
>>> From: Leif Hedstrom <le...@yahoo-inc.com>
>>> Date: June 12, 2009 9:17:59 AM PDT
>>> To: general@incubator.apache.org
>>> Subject: [Proposal] Traffic Server
>>>
>>>
>>> Good morning,
>>>
>>> We would like to submit the Traffic Server proposal to the  
>>> incubator. Our
>>> draft is available at
>>>
>>>   http://wiki.apache.org/incubator/TrafficServerProposal
>>>
>
> This sounds awesome. Can it act as a forward proxy as well ? I guess
> we will find out once the source is released.


Yes, YTS can be used as a forward proxy.


> The 35000 rps is for reverse proxy or forward proxy ?


That is for reverse proxy mode and 35k is conservative.

Brian

   - Not on the YTS team, but in the same group




Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by "Akins, Brian" <Br...@turner.com>.
On 6/15/09 12:39 PM, "Pranav Desai" <pr...@gmail.com> wrote:

> The 35000 rps is for reverse proxy or forward proxy ?
> 

Of course, I've coerced a stock mod_disk_cache/mod_proxy_http httpd server
to over 40k rps on normal serevr hardware. It all depends on the benchmark.

FWIW, the more code we can play with, the better.  Who knows what goodies we
may find.  

-- 
Brian Akins


Re: incubator proposal for (what was once) Inktomi Traffic Server

Posted by Pranav Desai <pr...@gmail.com>.
On Sun, Jun 14, 2009 at 9:25 PM, Roy T. Fielding<fi...@gbiv.com> wrote:
> I think this is an interesting opportunity to compare
> different implementations and share code where desirable.
> I haven't seen anyone comment on the proposal yet.
>
> ....Roy
>
>
> Begin forwarded message:
>
>> From: Leif Hedstrom <le...@yahoo-inc.com>
>> Date: June 12, 2009 9:17:59 AM PDT
>> To: general@incubator.apache.org
>> Subject: [Proposal] Traffic Server
>>
>>
>> Good morning,
>>
>> We would like to submit the Traffic Server proposal to the incubator. Our
>> draft is available at
>>
>>   http://wiki.apache.org/incubator/TrafficServerProposal
>>

This sounds awesome. Can it act as a forward proxy as well ? I guess
we will find out once the source is released.

The 35000 rps is for reverse proxy or forward proxy ?

-- Pranav

>>
>> A quick overview of Traffic Server:
>>
>> Traffic Server is a Yahoo! / Inktomi caching proxy server. It has been
>> actively developed and used inside Yahoo! for the last 3+ years, and we are
>> now ready to begin the next step in it's evolution: make it Open Source. TS
>> is a fairly large piece of software (300k+ lines of C/C++ code), and
>> provides features and benefits lacking in many existing proxy/caches.
>>
>> I am obviously looking for feedback and comments on the proposal, as well
>> as a few mentors. Doug Cutting has accepted to be our Champion.
>>
>> Thanks,
>>
>> -- Leif
>