You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@trafficserver.apache.org by "Narayan Balasubramanian (நாராயண் )" <bv...@gmail.com> on 2014/07/03 07:40:57 UTC
Co Advisor HTP compliance tests on 5.0
Hi:
I ran the CoAdvisor (http://coad.measurement-factory.com) compliance tests
against 4.2.2 and 5.0
I ran with 5.0 changed settings as well as default settings.
5.0 new settings are described at:
https://cwiki.apache.org/confluence/display/TS/What%27s+new+in+v5.0.x#What'snewinv5.0.x-Changeddefaultconfigurations
Here is a summary of the results:
In version 5.0, 441/718 test cases passed - 61% pass
In version 4.2, 472/718 test cases passed - 66% pass
In version 5.0 with 4.2 setting 471/718 test cases passed - 66% pass
In version 4.2 with 5.0 setting, 441/718 test cases passed - 61% pass
Thanks,
Narayan
Re: Co Advisor HTP compliance tests on 5.0
Posted by "Narayan Balasubramanian (நாராயண் )" <bv...@gmail.com>.
Good idea. It is easy to setup and run the tests for previous releases.
Narayan
On Sun, Jul 6, 2014 at 12:58 PM, Leif Hedstrom <zw...@apache.org> wrote:
>
> On Jul 2, 2014, at 11:40 PM, Narayan Balasubramanian (நாராயண் ) <
> bv.narayan@gmail.com> wrote:
>
> > Hi:
> >
> > I ran the CoAdvisor (http://coad.measurement-factory.com) compliance
> tests
> > against 4.2.2 and 5.0
> >
> > I ran with 5.0 changed settings as well as default settings.
> >
> > 5.0 new settings are described at:
> >
> https://cwiki.apache.org/confluence/display/TS/What%27s+new+in+v5.0.x#What'snewinv5.0.x-Changeddefaultconfigurations
> >
> > Here is a summary of the results:
> >
> > In version 5.0, 441/718 test cases passed - 61% pass
> > In version 4.2, 472/718 test cases passed - 66% pass
> > In version 5.0 with 4.2 setting 471/718 test cases passed - 66% pass
> > In version 4.2 with 5.0 setting, 441/718 test cases passed - 61% pass
>
>
>
> Very cool! I think having a Wiki page with these results (and future runs)
> would be very useful. Just a brief summary on each release, with the counts
> on passes / violations / failures would be cool. Even cooler would be to go
> back to at least v4.0.0, maybe every 3.2.5, and then go forward?
>
> Thoughts?
>
> — Leif
>
>
Re: Co Advisor HTP compliance tests on 5.0
Posted by Leif Hedstrom <zw...@apache.org>.
On Jul 2, 2014, at 11:40 PM, Narayan Balasubramanian (நாராயண் ) <bv...@gmail.com> wrote:
> Hi:
>
> I ran the CoAdvisor (http://coad.measurement-factory.com) compliance tests
> against 4.2.2 and 5.0
>
> I ran with 5.0 changed settings as well as default settings.
>
> 5.0 new settings are described at:
> https://cwiki.apache.org/confluence/display/TS/What%27s+new+in+v5.0.x#What'snewinv5.0.x-Changeddefaultconfigurations
>
> Here is a summary of the results:
>
> In version 5.0, 441/718 test cases passed - 61% pass
> In version 4.2, 472/718 test cases passed - 66% pass
> In version 5.0 with 4.2 setting 471/718 test cases passed - 66% pass
> In version 4.2 with 5.0 setting, 441/718 test cases passed - 61% pass
Very cool! I think having a Wiki page with these results (and future runs) would be very useful. Just a brief summary on each release, with the counts on passes / violations / failures would be cool. Even cooler would be to go back to at least v4.0.0, maybe every 3.2.5, and then go forward?
Thoughts?
— Leif