You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@maven.apache.org by "David C. Hicks" <dh...@i-hicks.org> on 2009/07/20 22:58:00 UTC
Surefire/Cobertura roll-up reports?
In a multi-module project, is it possible to get Surefire and/or
Cobertura to "roll up" their results at the top-most level?
I haven't found anything that leads me to believe they can. Figured it
was time to inquire.
Thanks,
Dave
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org
RE: Surefire/Cobertura roll-up reports?
Posted by Mohan KR <km...@gmail.com>.
That's correct, depending on how you are invoking the cobertura, you will see that. Basically the "cobertura" goal
is going to invoke a parallel lifecycle that will run the test. It is easy to modify the plugin to do what you want,
if you don't then someone has done it for you:
http://top.touk.pl/maven2/release/org/codehaus/mojo/cobertura-maven-plugin/2.2-touk
That's a m2 repo. It has one additional goal "generate-report" that will *not* fork a lifecycle, so you won't have
the hudson double or treble vision. (There is no doc. on the plugin, but basically you clean,instrument, generate-report
in different phases of your regular build).
Thanks,
mohan kr
-----Original Message-----
From: David C. Hicks [mailto:dhicks@i-hicks.org]
Sent: Monday, July 20, 2009 8:51 PM
To: Maven Users List
Subject: Re: Surefire/Cobertura roll-up reports?
Adam Purkiss wrote:
> As for surefire - no idea, but using Hudson as our CI tool I have it setup to "roll up" the Junit results to a top level using its reporting.
>
We use Hudson, as well, but we've noticed that between Surefire and
Cobertura, we end up with two or three "copies" of each test result.
So, it appears like we have 2 to 3 times more unit tests than we really
do. I guess it depends on what Hudson is rolling up. Perhaps I'm using
the plugins in a way that I should not be. I'm trying to satisfy both
the needs of the development team in getting code built and deployed to
a test server (where we then come back and run some automated
integration tests through Maven with Selenium) and the desires of
management who really love to look at the pretty reports. :-) It was
actually this discrepancy in the Hudson rollup that prompted my question
in the first place. Otherwise, that's a great suggestion.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org
RE: Surefire/Cobertura roll-up reports?
Posted by Adam Purkiss <aj...@hotmail.com>.
no worries, just got to be careful where you get the xml result files from - IIRC as you are running the tests again you may find that cobertura or the like also produce result xml files that it stores in its own folder that too loose a config will pick up
> Date: Mon, 20 Jul 2009 22:04:52 -0400
> From: dhicks@i-hicks.org
> To: users@maven.apache.org
> Subject: Re: Surefire/Cobertura roll-up reports?
>
> I'll have a closer look at our Hudson configuration. Someone else set
> the server up originally. I should not assume that everything is optimal.
> Thanks for the feedback!
>
> Adam Purkiss wrote:
> > I see,
> >
> > The setting I have for publish JUnit results is: **/target/surefire-reports/*.xml and I have not had issues using either our old ant emma setup or the new maven with clover setup
> >
> > I have made use of clover for code coverage reports as it will merge them at a top module level for me where as Emma and cobertura do not (also cobertura always seems to report 0% code coverage for some reason, but I never bothered to look into that.
> >
> > Anyway I dont have the duplicate test issue and have Maven run from ant with a freestyle Hudson project just to really be difficult :)
> >
> >
> >
> >
> >> Date: Mon, 20 Jul 2009 21:51:29 -0400
> >> From: dhicks@i-hicks.org
> >> To: users@maven.apache.org
> >> Subject: Re: Surefire/Cobertura roll-up reports?
> >>
> >> Adam Purkiss wrote:
> >>
> >>> As for surefire - no idea, but using Hudson as our CI tool I have it setup to "roll up" the Junit results to a top level using its reporting.
> >>>
> >>>
> >> We use Hudson, as well, but we've noticed that between Surefire and
> >> Cobertura, we end up with two or three "copies" of each test result.
> >> So, it appears like we have 2 to 3 times more unit tests than we really
> >> do. I guess it depends on what Hudson is rolling up. Perhaps I'm using
> >> the plugins in a way that I should not be. I'm trying to satisfy both
> >> the needs of the development team in getting code built and deployed to
> >> a test server (where we then come back and run some automated
> >> integration tests through Maven with Selenium) and the desires of
> >> management who really love to look at the pretty reports. :-) It was
> >> actually this discrepancy in the Hudson rollup that prompted my question
> >> in the first place. Otherwise, that's a great suggestion.
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> >> For additional commands, e-mail: users-help@maven.apache.org
> >>
> >>
> >
> > _________________________________________________________________
> > Send and receive email from all of your webmail accounts.
> > http://go.microsoft.com/?linkid=9671356
> >
_________________________________________________________________
Stay on top of things, check email from other accounts!
http://go.microsoft.com/?linkid=9671355
Re: Surefire/Cobertura roll-up reports?
Posted by "David C. Hicks" <dh...@i-hicks.org>.
I'll have a closer look at our Hudson configuration. Someone else set
the server up originally. I should not assume that everything is optimal.
Thanks for the feedback!
Adam Purkiss wrote:
> I see,
>
> The setting I have for publish JUnit results is: **/target/surefire-reports/*.xml and I have not had issues using either our old ant emma setup or the new maven with clover setup
>
> I have made use of clover for code coverage reports as it will merge them at a top module level for me where as Emma and cobertura do not (also cobertura always seems to report 0% code coverage for some reason, but I never bothered to look into that.
>
> Anyway I dont have the duplicate test issue and have Maven run from ant with a freestyle Hudson project just to really be difficult :)
>
>
>
>
>> Date: Mon, 20 Jul 2009 21:51:29 -0400
>> From: dhicks@i-hicks.org
>> To: users@maven.apache.org
>> Subject: Re: Surefire/Cobertura roll-up reports?
>>
>> Adam Purkiss wrote:
>>
>>> As for surefire - no idea, but using Hudson as our CI tool I have it setup to "roll up" the Junit results to a top level using its reporting.
>>>
>>>
>> We use Hudson, as well, but we've noticed that between Surefire and
>> Cobertura, we end up with two or three "copies" of each test result.
>> So, it appears like we have 2 to 3 times more unit tests than we really
>> do. I guess it depends on what Hudson is rolling up. Perhaps I'm using
>> the plugins in a way that I should not be. I'm trying to satisfy both
>> the needs of the development team in getting code built and deployed to
>> a test server (where we then come back and run some automated
>> integration tests through Maven with Selenium) and the desires of
>> management who really love to look at the pretty reports. :-) It was
>> actually this discrepancy in the Hudson rollup that prompted my question
>> in the first place. Otherwise, that's a great suggestion.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
>> For additional commands, e-mail: users-help@maven.apache.org
>>
>>
>
> _________________________________________________________________
> Send and receive email from all of your webmail accounts.
> http://go.microsoft.com/?linkid=9671356
>
RE: Surefire/Cobertura roll-up reports?
Posted by Adam Purkiss <aj...@hotmail.com>.
I see,
The setting I have for publish JUnit results is: **/target/surefire-reports/*.xml and I have not had issues using either our old ant emma setup or the new maven with clover setup
I have made use of clover for code coverage reports as it will merge them at a top module level for me where as Emma and cobertura do not (also cobertura always seems to report 0% code coverage for some reason, but I never bothered to look into that.
Anyway I dont have the duplicate test issue and have Maven run from ant with a freestyle Hudson project just to really be difficult :)
> Date: Mon, 20 Jul 2009 21:51:29 -0400
> From: dhicks@i-hicks.org
> To: users@maven.apache.org
> Subject: Re: Surefire/Cobertura roll-up reports?
>
> Adam Purkiss wrote:
> > As for surefire - no idea, but using Hudson as our CI tool I have it setup to "roll up" the Junit results to a top level using its reporting.
> >
> We use Hudson, as well, but we've noticed that between Surefire and
> Cobertura, we end up with two or three "copies" of each test result.
> So, it appears like we have 2 to 3 times more unit tests than we really
> do. I guess it depends on what Hudson is rolling up. Perhaps I'm using
> the plugins in a way that I should not be. I'm trying to satisfy both
> the needs of the development team in getting code built and deployed to
> a test server (where we then come back and run some automated
> integration tests through Maven with Selenium) and the desires of
> management who really love to look at the pretty reports. :-) It was
> actually this discrepancy in the Hudson rollup that prompted my question
> in the first place. Otherwise, that's a great suggestion.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> For additional commands, e-mail: users-help@maven.apache.org
>
_________________________________________________________________
Send and receive email from all of your webmail accounts.
http://go.microsoft.com/?linkid=9671356
Re: Surefire/Cobertura roll-up reports?
Posted by "David C. Hicks" <dh...@i-hicks.org>.
Adam Purkiss wrote:
> As for surefire - no idea, but using Hudson as our CI tool I have it setup to "roll up" the Junit results to a top level using its reporting.
>
We use Hudson, as well, but we've noticed that between Surefire and
Cobertura, we end up with two or three "copies" of each test result.
So, it appears like we have 2 to 3 times more unit tests than we really
do. I guess it depends on what Hudson is rolling up. Perhaps I'm using
the plugins in a way that I should not be. I'm trying to satisfy both
the needs of the development team in getting code built and deployed to
a test server (where we then come back and run some automated
integration tests through Maven with Selenium) and the desires of
management who really love to look at the pretty reports. :-) It was
actually this discrepancy in the Hudson rollup that prompted my question
in the first place. Otherwise, that's a great suggestion.
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
For additional commands, e-mail: users-help@maven.apache.org
RE: Surefire/Cobertura roll-up reports?
Posted by Adam Purkiss <aj...@hotmail.com>.
Cobertura cannot only Clover can in that type of tool as far as I can tell (but that costs money)
As for surefire - no idea, but using Hudson as our CI tool I have it setup to "roll up" the Junit results to a top level using its reporting.
> Date: Mon, 20 Jul 2009 18:28:16 -0600
> Subject: Re: Surefire/Cobertura roll-up reports?
> From: dhoffer6@gmail.com
> To: users@maven.apache.org
>
> Unfortunately I don't think so...it least I haven't found a way. Java docs
> yes but not for the two you mentioned.
>
> -Dave
>
> On Mon, Jul 20, 2009 at 2:58 PM, David C. Hicks <dh...@i-hicks.org> wrote:
>
> > In a multi-module project, is it possible to get Surefire and/or
> > Cobertura to "roll up" their results at the top-most level?
> >
> > I haven't found anything that leads me to believe they can. Figured it
> > was time to inquire.
> > Thanks,
> > Dave
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> > For additional commands, e-mail: users-help@maven.apache.org
> >
> >
_________________________________________________________________
Send and receive email from all of your webmail accounts.
http://go.microsoft.com/?linkid=9671356
Re: Surefire/Cobertura roll-up reports?
Posted by David Hoffer <dh...@gmail.com>.
Unfortunately I don't think so...it least I haven't found a way. Java docs
yes but not for the two you mentioned.
-Dave
On Mon, Jul 20, 2009 at 2:58 PM, David C. Hicks <dh...@i-hicks.org> wrote:
> In a multi-module project, is it possible to get Surefire and/or
> Cobertura to "roll up" their results at the top-most level?
>
> I haven't found anything that leads me to believe they can. Figured it
> was time to inquire.
> Thanks,
> Dave
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: users-unsubscribe@maven.apache.org
> For additional commands, e-mail: users-help@maven.apache.org
>
>