You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@harmony.apache.org by Vladimir Ivanov <iv...@gmail.com> on 2006/08/18 14:27:44 UTC
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
The coverage information was updated on the wiki. Also, coverage for
accessibility, awt, instrument and sound modules was added. I have a problem
to calculate coverage for swing module (test run hang up) so issue 564 will
be updated later.
thanks, Vladimir
On 6/20/06, Paulex Yang <pa...@gmail.com> wrote:
>
> Vladimir Ivanov wrote:
> > Classes from exclude list are now specified as green.
> > I've update wiki (http://wiki.apache.org/harmony/Coverage_information)
> > and
> > coverage pages.
> >
> Great, thank you, Vladimir!
> > Thanks,
> > Vladimir
> >
> >
> > On 6/16/06, Paulex Yang <pa...@gmail.com> wrote:
> >>
> >> Vladimir
> >>
> >> Vladimir Ivanov wrote:
> >> >>
> >> >> The current reports don't provide code source linking. Are you
> >> going to
> >>
> >> >> add it?
> >> >
> >> >
> >> > There were no information for 'security' and 'auth' modules, but, I
> >> have
> >> > updated the pages and now there is source code linking for all
> >> modules.
> >> >
> >> > One more issue to discuss: excluded classes present in the coverage
> >> table
> >> > now with 0 coverage. May be it is more convenient do not have these
> >> > classes
> >> > in coverage tables at all? In this case one won't wonder why the
> class
> >> > has 0
> >> > coverage - go to exclude list to look at the class and decide whether
> >> the
> >> > class is really untested or just excluded from coverage, instead, all
> >> > really
> >> > uncovered classes will be shown with 0 coverage, if a class is
> >> missed in
> >> > coverage table – it is in exclude list.
> >> +1 for current "0 coverage" is not convenient. But if we can remove
> them
> >> from the report, how about just mark them in another way? say, mark the
> >> excluded class with different background colors?
> >>
> >> At least people don't need to care about two documents for one package.
> >> > Thanks,
> >> > Vladimir
> >> >
> >> >
> >> >
> >> >> Now I have 2 questions/ issues to discuss:
> >> >> > 1) preferable VM to calculate coverage (seems, the exclude list
> >> is a
> >> >> > little
> >> >> > bit different for j9 and drlvm)
> >> >>
> >> >>
> >> >> If the only difference is the exclude list then I'd suggest using VM
> >> >> with
> >> >> the shortest one. :-)
> >> >>
> >> >> 2) preferable sorting mode for results (by name, by blocks or by
> >> >> methods)
> >> >>
> >> >>
> >> >> IMHO, sorting by name looks more natural.
> >> >>
> >> >> Thanks,
> >> >> Stepan.
> >> >>
> >> >> Thanks,
> >> >> > Vladimir
> >> >> >
> >> >> > <SNIP>
> >> >> >
> >> >>
> >> >>
> >> >> ------------------------------------------------------
> >> >> Terms of use : http://incubator.apache.org/harmony/mailing.html
> >> >> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> >> >> For additional commands, e-mail:
> >> harmony-dev-help@incubator.apache.org
> >> >>
> >> >>
> >> >
> >>
> >>
> >> --
> >> Paulex Yang
> >> China Software Development Lab
> >> IBM
> >>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> Terms of use : http://incubator.apache.org/harmony/mailing.html
> >> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> >> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >>
> >>
> >
>
>
> --
> Paulex Yang
> China Software Development Lab
> IBM
>
>
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
Coverage for swing module was added.
thanks, Vladimir
On 8/18/06, Tim Ellison <t....@gmail.com> wrote:
>
> Thanks for updating the numbers Vladimir. Overall I think they look
> quite respectable.
>
> There are a few places where it looks like we could use more test
> coverage. It's a great way to contribute to Harmony (he said, hinting
> to the lurkers <g>). Pick a favourite package, kick the wheels of
> Harmony using JUnit tests -- then contribute them for the greater good.
>
> Regards,
> Tim
>
> Vladimir Ivanov wrote:
> > The coverage information was updated on the wiki. Also, coverage for
> > accessibility, awt, instrument and sound modules was added. I have a
> > problem
> > to calculate coverage for swing module (test run hang up) so issue 564
> will
> > be updated later.
> >
> > thanks, Vladimir
> >
> >
> > On 6/20/06, Paulex Yang < paulex.yang@gmail.com> wrote:
> >>
> >> Vladimir Ivanov wrote:
> >> > Classes from exclude list are now specified as green.
> >> > I've update wiki (http://wiki.apache.org/harmony/Coverage_information
> )
> >> > and
> >> > coverage pages.
> >> >
> >> Great, thank you, Vladimir!
> >> > Thanks,
> >> > Vladimir
> >> >
> >> >
> >> > On 6/16/06, Paulex Yang <pa...@gmail.com> wrote:
> >> >>
> >> >> Vladimir
> >> >>
> >> >> Vladimir Ivanov wrote:
> >> >> >>
> >> >> >> The current reports don't provide code source linking. Are you
> >> >> going to
> >> >>
> >> >> >> add it?
> >> >> >
> >> >> >
> >> >> > There were no information for 'security' and 'auth' modules, but,
> I
> >> >> have
> >> >> > updated the pages and now there is source code linking for all
> >> >> modules.
> >> >> >
> >> >> > One more issue to discuss: excluded classes present in the
> coverage
> >> >> table
> >> >> > now with 0 coverage. May be it is more convenient do not have
> these
> >> >> > classes
> >> >> > in coverage tables at all? In this case one won't wonder why the
> >> class
> >> >> > has 0
> >> >> > coverage - go to exclude list to look at the class and decide
> >> whether
> >> >> the
> >> >> > class is really untested or just excluded from coverage, instead,
> >> all
> >> >> > really
> >> >> > uncovered classes will be shown with 0 coverage, if a class is
> >> >> missed in
> >> >> > coverage table – it is in exclude list.
> >> >> +1 for current "0 coverage" is not convenient. But if we can remove
> >> them
> >> >> from the report, how about just mark them in another way? say, mark
> >> the
> >> >> excluded class with different background colors?
> >> >>
> >> >> At least people don't need to care about two documents for one
> >> package.
> >> >> > Thanks,
> >> >> > Vladimir
> >> >> >
> >> >> >
> >> >> >
> >> >> >> Now I have 2 questions/ issues to discuss:
> >> >> >> > 1) preferable VM to calculate coverage (seems, the exclude list
>
> >> >> is a
> >> >> >> > little
> >> >> >> > bit different for j9 and drlvm)
> >> >> >>
> >> >> >>
> >> >> >> If the only difference is the exclude list then I'd suggest
> >> using VM
> >> >> >> with
> >> >> >> the shortest one. :-)
> >> >> >>
> >> >> >> 2) preferable sorting mode for results (by name, by blocks or by
> >> >> >> methods)
> >> >> >>
> >> >> >>
> >> >> >> IMHO, sorting by name looks more natural.
> >> >> >>
> >> >> >> Thanks,
> >> >> >> Stepan.
> >> >> >>
> >> >> >> Thanks,
> >> >> >> > Vladimir
> >> >> >> >
> >> >> >> > <SNIP>
> >> >> >> >
> >> >> >>
> >> >> >>
> >> >> >> ------------------------------------------------------
> >> >> >> Terms of use : http://incubator.apache.org/harmony/mailing.html
> >> >> >> To unsubscribe, e-mail:
> >> harmony-dev-unsubscribe@incubator.apache.org
> >> >> >> For additional commands, e-mail:
> >> >> harmony-dev-help@incubator.apache.org
> >> >> >>
> >> >> >>
> >> >> >
> >> >>
> >> >>
> >> >> --
> >> >> Paulex Yang
> >> >> China Software Development Lab
> >> >> IBM
> >> >>
> >> >>
> >> >>
> >> >>
> ---------------------------------------------------------------------
> >> >> Terms of use : http://incubator.apache.org/harmony/mailing.html
> >> >> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> >> >> For additional commands, e-mail:
> harmony-dev-help@incubator.apache.org
> >> >>
> >> >>
> >> >
> >>
> >>
> >> --
> >> Paulex Yang
> >> China Software Development Lab
> >> IBM
> >>
> >>
> >>
> >> ---------------------------------------------------------------------
> >> Terms of use : http://incubator.apache.org/harmony/mailing.html
> >> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> >> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >>
> >>
> >
>
> --
>
> Tim Ellison (t.p.ellison@gmail.com )
> IBM Java technology centre, UK.
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution
time is spent in a single test)
Posted by Tim Ellison <t....@gmail.com>.
Thanks for updating the numbers Vladimir. Overall I think they look
quite respectable.
There are a few places where it looks like we could use more test
coverage. It's a great way to contribute to Harmony (he said, hinting
to the lurkers <g>). Pick a favourite package, kick the wheels of
Harmony using JUnit tests -- then contribute them for the greater good.
Regards,
Tim
Vladimir Ivanov wrote:
> The coverage information was updated on the wiki. Also, coverage for
> accessibility, awt, instrument and sound modules was added. I have a
> problem
> to calculate coverage for swing module (test run hang up) so issue 564 will
> be updated later.
>
> thanks, Vladimir
>
>
> On 6/20/06, Paulex Yang <pa...@gmail.com> wrote:
>>
>> Vladimir Ivanov wrote:
>> > Classes from exclude list are now specified as green.
>> > I've update wiki (http://wiki.apache.org/harmony/Coverage_information)
>> > and
>> > coverage pages.
>> >
>> Great, thank you, Vladimir!
>> > Thanks,
>> > Vladimir
>> >
>> >
>> > On 6/16/06, Paulex Yang <pa...@gmail.com> wrote:
>> >>
>> >> Vladimir
>> >>
>> >> Vladimir Ivanov wrote:
>> >> >>
>> >> >> The current reports don't provide code source linking. Are you
>> >> going to
>> >>
>> >> >> add it?
>> >> >
>> >> >
>> >> > There were no information for 'security' and 'auth' modules, but, I
>> >> have
>> >> > updated the pages and now there is source code linking for all
>> >> modules.
>> >> >
>> >> > One more issue to discuss: excluded classes present in the coverage
>> >> table
>> >> > now with 0 coverage. May be it is more convenient do not have these
>> >> > classes
>> >> > in coverage tables at all? In this case one won't wonder why the
>> class
>> >> > has 0
>> >> > coverage - go to exclude list to look at the class and decide
>> whether
>> >> the
>> >> > class is really untested or just excluded from coverage, instead,
>> all
>> >> > really
>> >> > uncovered classes will be shown with 0 coverage, if a class is
>> >> missed in
>> >> > coverage table – it is in exclude list.
>> >> +1 for current "0 coverage" is not convenient. But if we can remove
>> them
>> >> from the report, how about just mark them in another way? say, mark
>> the
>> >> excluded class with different background colors?
>> >>
>> >> At least people don't need to care about two documents for one
>> package.
>> >> > Thanks,
>> >> > Vladimir
>> >> >
>> >> >
>> >> >
>> >> >> Now I have 2 questions/ issues to discuss:
>> >> >> > 1) preferable VM to calculate coverage (seems, the exclude list
>> >> is a
>> >> >> > little
>> >> >> > bit different for j9 and drlvm)
>> >> >>
>> >> >>
>> >> >> If the only difference is the exclude list then I'd suggest
>> using VM
>> >> >> with
>> >> >> the shortest one. :-)
>> >> >>
>> >> >> 2) preferable sorting mode for results (by name, by blocks or by
>> >> >> methods)
>> >> >>
>> >> >>
>> >> >> IMHO, sorting by name looks more natural.
>> >> >>
>> >> >> Thanks,
>> >> >> Stepan.
>> >> >>
>> >> >> Thanks,
>> >> >> > Vladimir
>> >> >> >
>> >> >> > <SNIP>
>> >> >> >
>> >> >>
>> >> >>
>> >> >> ------------------------------------------------------
>> >> >> Terms of use : http://incubator.apache.org/harmony/mailing.html
>> >> >> To unsubscribe, e-mail:
>> harmony-dev-unsubscribe@incubator.apache.org
>> >> >> For additional commands, e-mail:
>> >> harmony-dev-help@incubator.apache.org
>> >> >>
>> >> >>
>> >> >
>> >>
>> >>
>> >> --
>> >> Paulex Yang
>> >> China Software Development Lab
>> >> IBM
>> >>
>> >>
>> >>
>> >> ---------------------------------------------------------------------
>> >> Terms of use : http://incubator.apache.org/harmony/mailing.html
>> >> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
>> >> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>> >>
>> >>
>> >
>>
>>
>> --
>> Paulex Yang
>> China Software Development Lab
>> IBM
>>
>>
>>
>> ---------------------------------------------------------------------
>> Terms of use : http://incubator.apache.org/harmony/mailing.html
>> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
>> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>>
>>
>
--
Tim Ellison (t.p.ellison@gmail.com)
IBM Java technology centre, UK.
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Gabriel Miretti <ga...@gmail.com>.
First of all, please excuse my late reply, Vladimir.
Right now I'm working in the tests for the implementation of jx.s.t.h.p.Parser, but here we are using a different code coverage tool, which is Clover, sorry :)
When I found your post at harmony-dev, I realized that none of that tests were computed.
At this moment, I'm not using the coverage system but I think that it is important for Harmony to have a good coverage tool and know how much code was covered by the tests.
Keep the good work.
Gabriel
PD: Clover is offered with free licensing for open source projects. http://www.cenqua.com/clover/licensing.html
and has plugins for Eclipse.
2006/10/19, Vladimir Ivanov <iv...@gmail.com>:
On 10/17/06, Gabriel Miretti <ga...@gmail.com> wrote:
>
> Vladimir
>
> Do you know why javax.swing.text.html tests weren't computed by the
> coverage tool if they are present in the SVN tree?
Seems, you are first person who tries to use it :)
The reason is the coverage system emulates common tests run over the
profiled classes. But common run includes only tests from the dir="${
hy.swing.src.test.api}/java/common". Actually, I don't know why :(
But I'll try to run other tests too in the next 'coverage calculation'
cycle.
thanks, Vladimir
Note, you can do it too :) Just download the last attachment for jira 564,
update property and run it.
Gabriel Miretti
>
> 2006/10/10, Vladimir Ivanov <iv...@gmail.com>:
> > On 10/6/06, Geir Magnusson Jr. < geir@pobox.com > wrote:
> > >
> > > >
> > > > - 'cc' - for cruise control script (and move current stuff to this
> dir);
> > > >
> > > > - 'coverage' - for coverage scripts (It will nice if somebody also
> > > placed
> > > > here data from issue 564);
> > > >
> > > > - 'japi' - for script to run 'japi'-tool.
> > >
> > > Agreed on all three.
> >
> >
> >
> > It will fine if somebody do it :). We have updated version of CC (
> > HARMONY-995 < http://issues.apache.org/jira/browse/HARMONY-995>) and
> coverage
> > scripts (HARMONY-564 < http://issues.apache.org/jira/browse/HARMONY-564 >
> ). I
> > hope we will have a japi script soon.
> >
> > Now I'm going to:
> >
> > - improve notification for CC to include txt files (output of cunit and
> > smoke tests for DRLVM);
> >
> > - add imageio/print/applet modules to coverage script.
> >
> > I hope, it will be small updated to 'buildtest' module instead of
> > reattach to jira a whole scripts again.
> >
> >
> >
> > thanks, Vladimir
> >
> > Do we have a japi script?
> > >
> > > geir
> > >
> > > >
> > > >
> > > >
> > > > Seems, that directory 'tests' also should be created in this module
> to
> > > > place non-unit tests when we will have one.
> > > >
> > > >
> > > >
> > > > thanks, Vladimir
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> > >
> > >
> >
> >
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/17/06, Gabriel Miretti <ga...@gmail.com> wrote:
>
> Vladimir
>
> Do you know why javax.swing.text.html tests weren't computed by the
> coverage tool if they are present in the SVN tree?
Seems, you are first person who tries to use it :)
The reason is the coverage system emulates common tests run over the
profiled classes. But common run includes only tests from the dir="${
hy.swing.src.test.api}/java/common". Actually, I don't know why :(
But I'll try to run other tests too in the next 'coverage calculation'
cycle.
thanks, Vladimir
Note, you can do it too :) Just download the last attachment for jira 564,
update property and run it.
Gabriel Miretti
>
> 2006/10/10, Vladimir Ivanov <iv...@gmail.com>:
> > On 10/6/06, Geir Magnusson Jr. <geir@pobox.com > wrote:
> > >
> > > >
> > > > - 'cc' - for cruise control script (and move current stuff to this
> dir);
> > > >
> > > > - 'coverage' - for coverage scripts (It will nice if somebody also
> > > placed
> > > > here data from issue 564);
> > > >
> > > > - 'japi' - for script to run 'japi'-tool.
> > >
> > > Agreed on all three.
> >
> >
> >
> > It will fine if somebody do it :). We have updated version of CC (
> > HARMONY-995 <http://issues.apache.org/jira/browse/HARMONY-995>) and
> coverage
> > scripts (HARMONY-564 < http://issues.apache.org/jira/browse/HARMONY-564>
> ). I
> > hope we will have a japi script soon.
> >
> > Now I'm going to:
> >
> > - improve notification for CC to include txt files (output of cunit and
> > smoke tests for DRLVM);
> >
> > - add imageio/print/applet modules to coverage script.
> >
> > I hope, it will be small updated to 'buildtest' module instead of
> > reattach to jira a whole scripts again.
> >
> >
> >
> > thanks, Vladimir
> >
> > Do we have a japi script?
> > >
> > > geir
> > >
> > > >
> > > >
> > > >
> > > > Seems, that directory 'tests' also should be created in this module
> to
> > > > place non-unit tests when we will have one.
> > > >
> > > >
> > > >
> > > > thanks, Vladimir
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> > >
> > >
> >
> >
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Gabriel Miretti <ga...@gmail.com>.
Vladimir
Do you know why javax.swing.text.html tests weren't computed by the
coverage tool if they are present in the SVN tree?
Gabriel Miretti
2006/10/10, Vladimir Ivanov <iv...@gmail.com>:
> On 10/6/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> >
> > >
> > > - 'cc' - for cruise control script (and move current stuff to this dir);
> > >
> > > - 'coverage' - for coverage scripts (It will nice if somebody also
> > placed
> > > here data from issue 564);
> > >
> > > - 'japi' - for script to run 'japi'-tool.
> >
> > Agreed on all three.
>
>
>
> It will fine if somebody do it :). We have updated version of CC (
> HARMONY-995 <http://issues.apache.org/jira/browse/HARMONY-995>) and coverage
> scripts (HARMONY-564 <http://issues.apache.org/jira/browse/HARMONY-564> ). I
> hope we will have a japi script soon.
>
> Now I'm going to:
>
> - improve notification for CC to include txt files (output of cunit and
> smoke tests for DRLVM);
>
> - add imageio/print/applet modules to coverage script.
>
> I hope, it will be small updated to 'buildtest' module instead of
> reattach to jira a whole scripts again.
>
>
>
> thanks, Vladimir
>
> Do we have a japi script?
> >
> > geir
> >
> > >
> > >
> > >
> > > Seems, that directory 'tests' also should be created in this module to
> > > place non-unit tests when we will have one.
> > >
> > >
> > >
> > > thanks, Vladimir
> > >
> >
> > ---------------------------------------------------------------------
> > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >
> >
>
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/6/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
>
> >
> > - 'cc' - for cruise control script (and move current stuff to this dir);
> >
> > - 'coverage' - for coverage scripts (It will nice if somebody also
> placed
> > here data from issue 564);
> >
> > - 'japi' - for script to run 'japi'-tool.
>
> Agreed on all three.
It will fine if somebody do it :). We have updated version of CC (
HARMONY-995 <http://issues.apache.org/jira/browse/HARMONY-995>) and coverage
scripts (HARMONY-564 <http://issues.apache.org/jira/browse/HARMONY-564> ). I
hope we will have a japi script soon.
Now I'm going to:
- improve notification for CC to include txt files (output of cunit and
smoke tests for DRLVM);
- add imageio/print/applet modules to coverage script.
I hope, it will be small updated to 'buildtest' module instead of
reattach to jira a whole scripts again.
thanks, Vladimir
Do we have a japi script?
>
> geir
>
> >
> >
> >
> > Seems, that directory 'tests' also should be created in this module to
> > place non-unit tests when we will have one.
> >
> >
> >
> > thanks, Vladimir
> >
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/6/06, Mark Hindess <ma...@googlemail.com> wrote:
>
> >
> > Agreed on all three. Do we have a japi script?
>
> I have one but it's a little specific to the wrapper we use for the
> builds that report to the -commits list. But I can provide it if
> it will help.
If this script requires some updates I am volunteer to implement it :)
thanks, Vladimir
> -Mark.
>
> > > Seems, that directory 'tests' also should be created in this module to
> > > place non-unit tests when we will have one.
> > >
> > >
> > >
> > > thanks, Vladimir
> > >
> >
> > ---------------------------------------------------------------------
> > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >
>
>
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution
time is spent in a single test)
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Thanks - maybe someone can massage that to fit with what we're building...
Mark Hindess wrote:
> On 6 October 2006 at 9:41, "Geir Magnusson Jr." <ge...@pobox.com> wrote:
>>
>> Vladimir Ivanov wrote:
>>> While nobody objects :) the right place for coverage scripts is 'buildtest'
>>> module.
>>>
>>> Seems, that this module should be a little bit reorder: new top level
>>> directories should be created:
>>>
>>> - 'cc' - for cruise control script (and move current stuff to this dir);
>>>
>>> - 'coverage' - for coverage scripts (It will nice if somebody also placed
>>> here data from issue 564);
>>>
>>> - 'japi' - for script to run 'japi'-tool.
>> Agreed on all three. Do we have a japi script?
>
> I have one but it's a little specific to the wrapper we use for the
> builds that report to the -commits list. But I can provide it if
> it will help.
>
> -Mark.
>
>>> Seems, that directory 'tests' also should be created in this module to
>>> place non-unit tests when we will have one.
>>>
>>>
>>>
>>> thanks, Vladimir
>>>
>> ---------------------------------------------------------------------
>> Terms of use : http://incubator.apache.org/harmony/mailing.html
>> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
>> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>>
>
>
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Mark Hindess <ma...@googlemail.com>.
On 6 October 2006 at 9:41, "Geir Magnusson Jr." <ge...@pobox.com> wrote:
>
>
> Vladimir Ivanov wrote:
> > While nobody objects :) the right place for coverage scripts is 'buildtest'
> > module.
> >
> > Seems, that this module should be a little bit reorder: new top level
> > directories should be created:
> >
> > - 'cc' - for cruise control script (and move current stuff to this dir);
> >
> > - 'coverage' - for coverage scripts (It will nice if somebody also placed
> > here data from issue 564);
> >
> > - 'japi' - for script to run 'japi'-tool.
>
> Agreed on all three. Do we have a japi script?
I have one but it's a little specific to the wrapper we use for the
builds that report to the -commits list. But I can provide it if
it will help.
-Mark.
> > Seems, that directory 'tests' also should be created in this module to
> > place non-unit tests when we will have one.
> >
> >
> >
> > thanks, Vladimir
> >
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution
time is spent in a single test)
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Vladimir Ivanov wrote:
> While nobody objects :) the right place for coverage scripts is 'buildtest'
> module.
>
> Seems, that this module should be a little bit reorder: new top level
> directories should be created:
>
> - 'cc' - for cruise control script (and move current stuff to this dir);
>
> - 'coverage' - for coverage scripts (It will nice if somebody also placed
> here data from issue 564);
>
> - 'japi' - for script to run 'japi'-tool.
Agreed on all three. Do we have a japi script?
geir
>
>
>
> Seems, that directory 'tests' also should be created in this module to
> place non-unit tests when we will have one.
>
>
>
> thanks, Vladimir
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
While nobody objects :) the right place for coverage scripts is 'buildtest'
module.
Seems, that this module should be a little bit reorder: new top level
directories should be created:
- 'cc' - for cruise control script (and move current stuff to this dir);
- 'coverage' - for coverage scripts (It will nice if somebody also placed
here data from issue 564);
- 'japi' - for script to run 'japi'-tool.
Seems, that directory 'tests' also should be created in this module to
place non-unit tests when we will have one.
thanks, Vladimir
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/3/06, Mark Hindess <ma...@googlemail.com> wrote:
>
>
> Regarding the 'run japi' script what are you planning to do here? The
> IBM Build/test builds also run japi (on linux only since we get enough
> information using one platform and linux is easier). We might as well
> share ant code.
>
> Also note that to get anything like reasonable data you need to be
> running the latest japi from CVS.
Please, share the code (as part of B&TI) :) It will be enough I think
thanks, Vladimir
Regards,
> Mark.
>
> > Thanks, Vladimir
> >
> >
> >
> > On 10/2/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > >
> > > The coverage information was updated on the wiki to current state
> (issue
> > > 564 also was updated):
> > > http://wiki.apache.org/harmony/Coverage_information
> > >
> > > thanks, Vladimir
> > >
> > >
> > >
> >
> > ------=_Part_60236_8031756.1159884501259--
> >
>
>
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Mark Hindess <ma...@googlemail.com>.
On 3 October 2006 at 21:08, "Vladimir Ivanov" <iv...@gmail.com> wrote:
>
> I have one more question about coverage: should it be the part of the B&T
> infrastructure or integrated to the current classlib build system?
>
> From my point of view it should be a part of B&TI while it is rarely used
> functionality and no needs to waste regular build by this data (it does not
> required to duplicate code while coverage depends on regular build and we
> should describe it in the readme.txt).
>
>
>
> By the way, we (at least I :) ) going to have some different scripts in the
> B&I modules:
>
> - code coverage (issue 564);
>
> - cruise control (issue 995);
>
> - japi script (In progress);
>
> - script to simple download and run tests against HDK.
>
>
>
> Seems, that it will OK to have some wrapper for these scripts and one set of
> properties.
>
> Something like: 'ant cc' - to run cruise control, 'ant coverage' - to
> calculate coverage etc.
>
> If no objections I will try to implement it after 'run japi' script.
Regarding the 'run japi' script what are you planning to do here? The
IBM Build/test builds also run japi (on linux only since we get enough
information using one platform and linux is easier). We might as well
share ant code.
Also note that to get anything like reasonable data you need to be
running the latest japi from CVS.
Regards,
Mark.
> Thanks, Vladimir
>
>
>
> On 10/2/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> >
> > The coverage information was updated on the wiki to current state (issue
> > 564 also was updated):
> > http://wiki.apache.org/harmony/Coverage_information
> >
> > thanks, Vladimir
> >
> >
> >
>
> ------=_Part_60236_8031756.1159884501259--
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
I have one more question about coverage: should it be the part of the B&T
infrastructure or integrated to the current classlib build system?
>From my point of view it should be a part of B&TI while it is rarely used
functionality and no needs to waste regular build by this data (it does not
required to duplicate code while coverage depends on regular build and we
should describe it in the readme.txt).
By the way, we (at least I :) ) going to have some different scripts in the
B&I modules:
- code coverage (issue 564);
- cruise control (issue 995);
- japi script (In progress);
- script to simple download and run tests against HDK.
Seems, that it will OK to have some wrapper for these scripts and one set of
properties.
Something like: 'ant cc' - to run cruise control, 'ant coverage' - to
calculate coverage etc.
If no objections I will try to implement it after 'run japi' script.
Thanks, Vladimir
On 10/2/06, Vladimir Ivanov <iv...@gmail.com> wrote:
>
> The coverage information was updated on the wiki to current state (issue
> 564 also was updated):
> http://wiki.apache.org/harmony/Coverage_information
>
> thanks, Vladimir
>
>
>
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
The coverage information was updated on the wiki to current state (issue
564 also was updated):
http://wiki.apache.org/harmony/Coverage_information
thanks, Vladimir
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
The coverage information was updated on the wiki to current state.
thanks, Vladimir