You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@maven.apache.org by "Daniel Kulp (JIRA)" <ji...@codehaus.org> on 2006/05/17 17:03:41 UTC
[jira] Created: (MSUREFIRE-114) With forkmode once, XML reports are
cumulative
With forkmode once, XML reports are cumulative
----------------------------------------------
Key: MSUREFIRE-114
URL: http://jira.codehaus.org/browse/MSUREFIRE-114
Project: Maven 2.x Surefire Plugin
Type: Bug
Versions: 2.2
Reporter: Daniel Kulp
With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
pseudo example:
ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (MSUREFIRE-114) With forkmode once, XML reports are
cumulative
Posted by "Eugene Zhuravlev (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=all ]
Eugene Zhuravlev updated MSUREFIRE-114:
---------------------------------------
Attachment: XMLReporter-patch.txt
Attached is the patch for the XMLReporter that fixes the problem
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Issue Type: Bug
> Affects Versions: 2.2
> Reporter: Daniel Kulp
> Fix For: 2.3
>
> Attachments: XMLReporter-patch.txt
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MSUREFIRE-114) With forkmode once, XML reports
are cumulative
Posted by "Gareth Moorst (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=comments#action_65682 ]
Gareth Moorst commented on MSUREFIRE-114:
-----------------------------------------
I get this problem regardless of the forkmode setting.
It only seems to have been doing this since I started using Maven 2.0.4, with maven-surefire-plugin 2.2 instead of maven 2.0.2 with pluginh 2.1.2.
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Type: Bug
> Versions: 2.2
> Reporter: Daniel Kulp
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Closed: (MSUREFIRE-114) With forkmode once, XML reports are
cumulative
Posted by "Jason van Zyl (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=all ]
Jason van Zyl closed MSUREFIRE-114.
-----------------------------------
Resolution: Fixed
Patch applied. Thanks!
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Issue Type: Bug
> Affects Versions: 2.2
> Reporter: Daniel Kulp
> Assigned To: Jason van Zyl
> Fix For: 2.3
>
> Attachments: XMLReporter-patch.txt
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MSUREFIRE-114) With forkmode once, XML reports
are cumulative
Posted by "Eugene Zhuravlev (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=comments#action_71937 ]
Eugene Zhuravlev commented on MSUREFIRE-114:
--------------------------------------------
The fix for this is quite easy: need to override the reset() method for the XMLReporter and clear the list of tests there.
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Issue Type: Bug
> Affects Versions: 2.2
> Reporter: Daniel Kulp
> Fix For: 2.3
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MSUREFIRE-114) With forkmode once, XML reports
are cumulative
Posted by "Patrice Bertrand (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=comments#action_66466 ]
Patrice Bertrand commented on MSUREFIRE-114:
--------------------------------------------
I have the same issue. I use Maven 2.0.4 with the 2.2 plugin. I had to force Maven to use of version 2.1.3 to work around the problem.
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Type: Bug
> Versions: 2.2
> Reporter: Daniel Kulp
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Commented: (SUREFIRE-122) With forkmode once, XML reports
are cumulative
Posted by "Robert Watkins (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/SUREFIRE-122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_85726 ]
Robert Watkins commented on SUREFIRE-122:
-----------------------------------------
For anyone else who stumbles upon this, the workaround above (using the 2.1.3 plugin) has its own set of issues.
The default values of a few of the configuration arguments for the surefire plugin changed between 2.1.3 and 2.2. The two I've come across were:
* forkmode (defaults to 'once' in 2.2, but 'none' in 2.1.3)
* childDelegation (defaults to 'false' in 2.2, but 'true' in 2.1.3)
The changes in these defaults can cause issues (I got OOM errors and problems with the XML classloaders) that are somewhat hard to diagnose, partially because the 2.2 plugin documentation doesn't indicate that the defaults had changed between versions. (For example, the only reason I noticed the forkmode problem is because I was dumping the running Java processes in order to diagnose the OOM).
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: SUREFIRE-122
> URL: http://jira.codehaus.org/browse/SUREFIRE-122
> Project: Maven Surefire
> Issue Type: Bug
> Affects Versions: 2.0 (2.2 plugin)
> Reporter: Daniel Kulp
> Assigned To: Jason van Zyl
> Fix For: 2.3
>
> Attachments: XMLReporter-patch.txt
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MSUREFIRE-114) With forkmode once, XML reports
are cumulative
Posted by "Mark Chaimungkalanont (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=comments#action_70477 ]
Mark Chaimungkalanont commented on MSUREFIRE-114:
-------------------------------------------------
I also see this problem. It has *definitely* only started happening since 2.2. If I add
{code:xml}
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-surefire-plugin</artifactId>
<version>2.1.3</version>
</plugin>
{code}
Things start working again. The linked issue MSUREFIRE-149 has a test project setup that seems to cause this problem consistently.
My experience re: the forkMode setting is that it happens less frequently with forkMode == always, but it does still seem to happen
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Issue Type: Bug
> Affects Versions: 2.2
> Reporter: Daniel Kulp
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Moved: (SUREFIRE-122) With forkmode once, XML reports are
cumulative
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/SUREFIRE-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brett Porter moved MSUREFIRE-114 to SUREFIRE-122:
-------------------------------------------------
Affects Version/s: (was: 2.0 (2.2 plugin))
2.0 (2.2 plugin)
Fix Version/s: (was: 2.3)
2.3
Key: SUREFIRE-122 (was: MSUREFIRE-114)
Project: Maven Surefire (was: Maven 2.x Surefire Plugin)
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: SUREFIRE-122
> URL: http://jira.codehaus.org/browse/SUREFIRE-122
> Project: Maven Surefire
> Issue Type: Bug
> Affects Versions: 2.0 (2.2 plugin)
> Reporter: Daniel Kulp
> Assigned To: Jason van Zyl
> Fix For: 2.3
>
> Attachments: XMLReporter-patch.txt
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MSUREFIRE-114) With forkmode once, XML reports
are cumulative
Posted by "stephane bouchet (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=comments#action_70735 ]
stephane bouchet commented on MSUREFIRE-114:
--------------------------------------------
Hi,
Got the same problem. (maven 2.0.4, surefireplugin 2.3-SNAPSHOT)
this is very annoying to have duplicate entry to my reports.
Tracking a little bit shows that 2.1.3 plugin use surefire-booter 1.5.3 and 2.2 use surefire-booter 2.0 .
I think the problem comes from there.
Stéphane
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Issue Type: Bug
> Affects Versions: 2.2
> Reporter: Daniel Kulp
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (MSUREFIRE-114) With forkmode once, XML reports
are cumulative
Posted by "Bernard Marshall (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=comments#action_68979 ]
Bernard Marshall commented on MSUREFIRE-114:
--------------------------------------------
I also have the problem using Maven 2.0.4 with the 2.2 plugin. If however I set <forkMode>always</forkMode> the results are not cumulative.
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Type: Bug
> Versions: 2.2
> Reporter: Daniel Kulp
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (MSUREFIRE-114) With forkmode once, XML reports are
cumulative
Posted by "Brett Porter (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/MSUREFIRE-114?page=all ]
Brett Porter updated MSUREFIRE-114:
-----------------------------------
Fix Version/s: 2.3
> With forkmode once, XML reports are cumulative
> ----------------------------------------------
>
> Key: MSUREFIRE-114
> URL: http://jira.codehaus.org/browse/MSUREFIRE-114
> Project: Maven 2.x Surefire Plugin
> Issue Type: Bug
> Affects Versions: 2.2
> Reporter: Daniel Kulp
> Fix For: 2.3
>
>
> With forkmode set to once, the resulting XML files seem to include the test results of all the tests in the previous suites as well as it's own.
> pseudo example:
> ATest is run, it has 2 test methods. The ATest.xml report says 2 tests run and passed
> BTest is run, it has 2 test methods. The BTest.xml report says 4 tests run and passed.
> CTest is run, it has 3 test methods. The CTest.xml report says 7 tests run and passed.
> When we use cruisecontrol or other reporting tools, it then say 13 tests run and passed instead of 5. What's worse, if a test in ATest fails, it's listed as a failure in all the tests so you get 3 tests failed, not 1. Plus, it's harder to figure out which test suite reallly had the failure.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira