You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@harmony.apache.org by Mark Hindess <ma...@googlemail.com> on 2006/10/03 16:22:04 UTC
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
On 3 October 2006 at 21:08, "Vladimir Ivanov" <iv...@gmail.com> wrote:
>
> I have one more question about coverage: should it be the part of the B&T
> infrastructure or integrated to the current classlib build system?
>
> From my point of view it should be a part of B&TI while it is rarely used
> functionality and no needs to waste regular build by this data (it does not
> required to duplicate code while coverage depends on regular build and we
> should describe it in the readme.txt).
>
>
>
> By the way, we (at least I :) ) going to have some different scripts in the
> B&I modules:
>
> - code coverage (issue 564);
>
> - cruise control (issue 995);
>
> - japi script (In progress);
>
> - script to simple download and run tests against HDK.
>
>
>
> Seems, that it will OK to have some wrapper for these scripts and one set of
> properties.
>
> Something like: 'ant cc' - to run cruise control, 'ant coverage' - to
> calculate coverage etc.
>
> If no objections I will try to implement it after 'run japi' script.
Regarding the 'run japi' script what are you planning to do here? The
IBM Build/test builds also run japi (on linux only since we get enough
information using one platform and linux is easier). We might as well
share ant code.
Also note that to get anything like reasonable data you need to be
running the latest japi from CVS.
Regards,
Mark.
> Thanks, Vladimir
>
>
>
> On 10/2/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> >
> > The coverage information was updated on the wiki to current state (issue
> > 564 also was updated):
> > http://wiki.apache.org/harmony/Coverage_information
> >
> > thanks, Vladimir
> >
> >
> >
>
> ------=_Part_60236_8031756.1159884501259--
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Gabriel Miretti <ga...@gmail.com>.
First of all, please excuse my late reply, Vladimir.
Right now I'm working in the tests for the implementation of jx.s.t.h.p.Parser, but here we are using a different code coverage tool, which is Clover, sorry :)
When I found your post at harmony-dev, I realized that none of that tests were computed.
At this moment, I'm not using the coverage system but I think that it is important for Harmony to have a good coverage tool and know how much code was covered by the tests.
Keep the good work.
Gabriel
PD: Clover is offered with free licensing for open source projects. http://www.cenqua.com/clover/licensing.html
and has plugins for Eclipse.
2006/10/19, Vladimir Ivanov <iv...@gmail.com>:
On 10/17/06, Gabriel Miretti <ga...@gmail.com> wrote:
>
> Vladimir
>
> Do you know why javax.swing.text.html tests weren't computed by the
> coverage tool if they are present in the SVN tree?
Seems, you are first person who tries to use it :)
The reason is the coverage system emulates common tests run over the
profiled classes. But common run includes only tests from the dir="${
hy.swing.src.test.api}/java/common". Actually, I don't know why :(
But I'll try to run other tests too in the next 'coverage calculation'
cycle.
thanks, Vladimir
Note, you can do it too :) Just download the last attachment for jira 564,
update property and run it.
Gabriel Miretti
>
> 2006/10/10, Vladimir Ivanov <iv...@gmail.com>:
> > On 10/6/06, Geir Magnusson Jr. < geir@pobox.com > wrote:
> > >
> > > >
> > > > - 'cc' - for cruise control script (and move current stuff to this
> dir);
> > > >
> > > > - 'coverage' - for coverage scripts (It will nice if somebody also
> > > placed
> > > > here data from issue 564);
> > > >
> > > > - 'japi' - for script to run 'japi'-tool.
> > >
> > > Agreed on all three.
> >
> >
> >
> > It will fine if somebody do it :). We have updated version of CC (
> > HARMONY-995 < http://issues.apache.org/jira/browse/HARMONY-995>) and
> coverage
> > scripts (HARMONY-564 < http://issues.apache.org/jira/browse/HARMONY-564 >
> ). I
> > hope we will have a japi script soon.
> >
> > Now I'm going to:
> >
> > - improve notification for CC to include txt files (output of cunit and
> > smoke tests for DRLVM);
> >
> > - add imageio/print/applet modules to coverage script.
> >
> > I hope, it will be small updated to 'buildtest' module instead of
> > reattach to jira a whole scripts again.
> >
> >
> >
> > thanks, Vladimir
> >
> > Do we have a japi script?
> > >
> > > geir
> > >
> > > >
> > > >
> > > >
> > > > Seems, that directory 'tests' also should be created in this module
> to
> > > > place non-unit tests when we will have one.
> > > >
> > > >
> > > >
> > > > thanks, Vladimir
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> > >
> > >
> >
> >
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/17/06, Gabriel Miretti <ga...@gmail.com> wrote:
>
> Vladimir
>
> Do you know why javax.swing.text.html tests weren't computed by the
> coverage tool if they are present in the SVN tree?
Seems, you are first person who tries to use it :)
The reason is the coverage system emulates common tests run over the
profiled classes. But common run includes only tests from the dir="${
hy.swing.src.test.api}/java/common". Actually, I don't know why :(
But I'll try to run other tests too in the next 'coverage calculation'
cycle.
thanks, Vladimir
Note, you can do it too :) Just download the last attachment for jira 564,
update property and run it.
Gabriel Miretti
>
> 2006/10/10, Vladimir Ivanov <iv...@gmail.com>:
> > On 10/6/06, Geir Magnusson Jr. <geir@pobox.com > wrote:
> > >
> > > >
> > > > - 'cc' - for cruise control script (and move current stuff to this
> dir);
> > > >
> > > > - 'coverage' - for coverage scripts (It will nice if somebody also
> > > placed
> > > > here data from issue 564);
> > > >
> > > > - 'japi' - for script to run 'japi'-tool.
> > >
> > > Agreed on all three.
> >
> >
> >
> > It will fine if somebody do it :). We have updated version of CC (
> > HARMONY-995 <http://issues.apache.org/jira/browse/HARMONY-995>) and
> coverage
> > scripts (HARMONY-564 < http://issues.apache.org/jira/browse/HARMONY-564>
> ). I
> > hope we will have a japi script soon.
> >
> > Now I'm going to:
> >
> > - improve notification for CC to include txt files (output of cunit and
> > smoke tests for DRLVM);
> >
> > - add imageio/print/applet modules to coverage script.
> >
> > I hope, it will be small updated to 'buildtest' module instead of
> > reattach to jira a whole scripts again.
> >
> >
> >
> > thanks, Vladimir
> >
> > Do we have a japi script?
> > >
> > > geir
> > >
> > > >
> > > >
> > > >
> > > > Seems, that directory 'tests' also should be created in this module
> to
> > > > place non-unit tests when we will have one.
> > > >
> > > >
> > > >
> > > > thanks, Vladimir
> > > >
> > >
> > > ---------------------------------------------------------------------
> > > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> > >
> > >
> >
> >
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Gabriel Miretti <ga...@gmail.com>.
Vladimir
Do you know why javax.swing.text.html tests weren't computed by the
coverage tool if they are present in the SVN tree?
Gabriel Miretti
2006/10/10, Vladimir Ivanov <iv...@gmail.com>:
> On 10/6/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
> >
> > >
> > > - 'cc' - for cruise control script (and move current stuff to this dir);
> > >
> > > - 'coverage' - for coverage scripts (It will nice if somebody also
> > placed
> > > here data from issue 564);
> > >
> > > - 'japi' - for script to run 'japi'-tool.
> >
> > Agreed on all three.
>
>
>
> It will fine if somebody do it :). We have updated version of CC (
> HARMONY-995 <http://issues.apache.org/jira/browse/HARMONY-995>) and coverage
> scripts (HARMONY-564 <http://issues.apache.org/jira/browse/HARMONY-564> ). I
> hope we will have a japi script soon.
>
> Now I'm going to:
>
> - improve notification for CC to include txt files (output of cunit and
> smoke tests for DRLVM);
>
> - add imageio/print/applet modules to coverage script.
>
> I hope, it will be small updated to 'buildtest' module instead of
> reattach to jira a whole scripts again.
>
>
>
> thanks, Vladimir
>
> Do we have a japi script?
> >
> > geir
> >
> > >
> > >
> > >
> > > Seems, that directory 'tests' also should be created in this module to
> > > place non-unit tests when we will have one.
> > >
> > >
> > >
> > > thanks, Vladimir
> > >
> >
> > ---------------------------------------------------------------------
> > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >
> >
>
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/6/06, Geir Magnusson Jr. <ge...@pobox.com> wrote:
>
> >
> > - 'cc' - for cruise control script (and move current stuff to this dir);
> >
> > - 'coverage' - for coverage scripts (It will nice if somebody also
> placed
> > here data from issue 564);
> >
> > - 'japi' - for script to run 'japi'-tool.
>
> Agreed on all three.
It will fine if somebody do it :). We have updated version of CC (
HARMONY-995 <http://issues.apache.org/jira/browse/HARMONY-995>) and coverage
scripts (HARMONY-564 <http://issues.apache.org/jira/browse/HARMONY-564> ). I
hope we will have a japi script soon.
Now I'm going to:
- improve notification for CC to include txt files (output of cunit and
smoke tests for DRLVM);
- add imageio/print/applet modules to coverage script.
I hope, it will be small updated to 'buildtest' module instead of
reattach to jira a whole scripts again.
thanks, Vladimir
Do we have a japi script?
>
> geir
>
> >
> >
> >
> > Seems, that directory 'tests' also should be created in this module to
> > place non-unit tests when we will have one.
> >
> >
> >
> > thanks, Vladimir
> >
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/6/06, Mark Hindess <ma...@googlemail.com> wrote:
>
> >
> > Agreed on all three. Do we have a japi script?
>
> I have one but it's a little specific to the wrapper we use for the
> builds that report to the -commits list. But I can provide it if
> it will help.
If this script requires some updates I am volunteer to implement it :)
thanks, Vladimir
> -Mark.
>
> > > Seems, that directory 'tests' also should be created in this module to
> > > place non-unit tests when we will have one.
> > >
> > >
> > >
> > > thanks, Vladimir
> > >
> >
> > ---------------------------------------------------------------------
> > Terms of use : http://incubator.apache.org/harmony/mailing.html
> > To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> > For additional commands, e-mail: harmony-dev-help@incubator.apache.org
> >
>
>
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution
time is spent in a single test)
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Thanks - maybe someone can massage that to fit with what we're building...
Mark Hindess wrote:
> On 6 October 2006 at 9:41, "Geir Magnusson Jr." <ge...@pobox.com> wrote:
>>
>> Vladimir Ivanov wrote:
>>> While nobody objects :) the right place for coverage scripts is 'buildtest'
>>> module.
>>>
>>> Seems, that this module should be a little bit reorder: new top level
>>> directories should be created:
>>>
>>> - 'cc' - for cruise control script (and move current stuff to this dir);
>>>
>>> - 'coverage' - for coverage scripts (It will nice if somebody also placed
>>> here data from issue 564);
>>>
>>> - 'japi' - for script to run 'japi'-tool.
>> Agreed on all three. Do we have a japi script?
>
> I have one but it's a little specific to the wrapper we use for the
> builds that report to the -commits list. But I can provide it if
> it will help.
>
> -Mark.
>
>>> Seems, that directory 'tests' also should be created in this module to
>>> place non-unit tests when we will have one.
>>>
>>>
>>>
>>> thanks, Vladimir
>>>
>> ---------------------------------------------------------------------
>> Terms of use : http://incubator.apache.org/harmony/mailing.html
>> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
>> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>>
>
>
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Mark Hindess <ma...@googlemail.com>.
On 6 October 2006 at 9:41, "Geir Magnusson Jr." <ge...@pobox.com> wrote:
>
>
> Vladimir Ivanov wrote:
> > While nobody objects :) the right place for coverage scripts is 'buildtest'
> > module.
> >
> > Seems, that this module should be a little bit reorder: new top level
> > directories should be created:
> >
> > - 'cc' - for cruise control script (and move current stuff to this dir);
> >
> > - 'coverage' - for coverage scripts (It will nice if somebody also placed
> > here data from issue 564);
> >
> > - 'japi' - for script to run 'japi'-tool.
>
> Agreed on all three. Do we have a japi script?
I have one but it's a little specific to the wrapper we use for the
builds that report to the -commits list. But I can provide it if
it will help.
-Mark.
> > Seems, that directory 'tests' also should be created in this module to
> > place non-unit tests when we will have one.
> >
> >
> >
> > thanks, Vladimir
> >
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution
time is spent in a single test)
Posted by "Geir Magnusson Jr." <ge...@pobox.com>.
Vladimir Ivanov wrote:
> While nobody objects :) the right place for coverage scripts is 'buildtest'
> module.
>
> Seems, that this module should be a little bit reorder: new top level
> directories should be created:
>
> - 'cc' - for cruise control script (and move current stuff to this dir);
>
> - 'coverage' - for coverage scripts (It will nice if somebody also placed
> here data from issue 564);
>
> - 'japi' - for script to run 'japi'-tool.
Agreed on all three. Do we have a japi script?
geir
>
>
>
> Seems, that directory 'tests' also should be created in this module to
> place non-unit tests when we will have one.
>
>
>
> thanks, Vladimir
>
---------------------------------------------------------------------
Terms of use : http://incubator.apache.org/harmony/mailing.html
To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
For additional commands, e-mail: harmony-dev-help@incubator.apache.org
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
While nobody objects :) the right place for coverage scripts is 'buildtest'
module.
Seems, that this module should be a little bit reorder: new top level
directories should be created:
- 'cc' - for cruise control script (and move current stuff to this dir);
- 'coverage' - for coverage scripts (It will nice if somebody also placed
here data from issue 564);
- 'japi' - for script to run 'japi'-tool.
Seems, that directory 'tests' also should be created in this module to
place non-unit tests when we will have one.
thanks, Vladimir
Re: [classlib] [testing] Coverage (was Re: 37% of total test execution time is spent in a single test)
Posted by Vladimir Ivanov <iv...@gmail.com>.
On 10/3/06, Mark Hindess <ma...@googlemail.com> wrote:
>
>
> Regarding the 'run japi' script what are you planning to do here? The
> IBM Build/test builds also run japi (on linux only since we get enough
> information using one platform and linux is easier). We might as well
> share ant code.
>
> Also note that to get anything like reasonable data you need to be
> running the latest japi from CVS.
Please, share the code (as part of B&TI) :) It will be enough I think
thanks, Vladimir
Regards,
> Mark.
>
> > Thanks, Vladimir
> >
> >
> >
> > On 10/2/06, Vladimir Ivanov <iv...@gmail.com> wrote:
> > >
> > > The coverage information was updated on the wiki to current state
> (issue
> > > 564 also was updated):
> > > http://wiki.apache.org/harmony/Coverage_information
> > >
> > > thanks, Vladimir
> > >
> > >
> > >
> >
> > ------=_Part_60236_8031756.1159884501259--
> >
>
>
>
> ---------------------------------------------------------------------
> Terms of use : http://incubator.apache.org/harmony/mailing.html
> To unsubscribe, e-mail: harmony-dev-unsubscribe@incubator.apache.org
> For additional commands, e-mail: harmony-dev-help@incubator.apache.org
>
>