You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@maven.apache.org by "Joakim Erdfelt (JIRA)" <ji...@codehaus.org> on 2007/11/02 00:49:10 UTC
[jira] Created: (CONTINUUM-1542) Surefire Report in continuum
contains excess/superfluous test methods.
Surefire Report in continuum contains excess/superfluous test methods.
----------------------------------------------------------------------
Key: CONTINUUM-1542
URL: http://jira.codehaus.org/browse/CONTINUUM-1542
Project: Continuum
Issue Type: Bug
Components: Testing
Reporter: Joakim Erdfelt
When looking at the surefire test results within a continuum build that reported a failure, the list of test methods for the tested class contains extra methods from other tested classes.
Continuum on maven.zones.apache.org [surefire report example with problem|http://maven.zones.apache.org/continuum/surefireReport.action;jsessionid=10vfs6g7jbl9f?buildId=32827&projectId=296#org.apache.maven.archiva.web.repository.RepositoryServletProxiedReleasePolicyTest]
If you look at the list of test methods for RepositoryServletProxiedReleasePolicyTest you can see that the report shows the correct # of tests at the top with 15, but when you goto the details for that test, you see well over 15 tests.
In fact, when you look at the section that starts with "Test Cases" you can see that the list of tests for each Test class is actually the list of tests from the previous Test class + the tests for the current Test class.
Example:
+RepositoryServletNoProxyMetadataTest+
(/) testGetVersionMetadataDefaultLayout
(/) testGetProjectMetadataDefaultLayout
(/) testGetSnapshotVersionMetadataDefaultLayout
+ArchivaMimeTypeLoaderTest+
(/) -testGetVersionMetadataDefaultLayout-
(/) -testGetProjectMetadataDefaultLayout-
(/) -testGetSnapshotVersionMetadataDefaultLayout-
(/) testArchivaTypes
+RepositoryServletProxiedPluginSnapshotPolicyTest+
(/) -testGetVersionMetadataDefaultLayout-
(/) -testGetProjectMetadataDefaultLayout-
(/) -testGetSnapshotVersionMetadataDefaultLayout-
(/) -testArchivaTypes-
(/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedNewer
(/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedOlder
(/) testGetProxiedSnapshotsArtifactPolicyAlwaysNoManagedContent
(/) testGetProxiedSnapshotsArtifactPolicyDailyFail
...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CONTINUUM-1542) Surefire Report in continuum
contains excess/superfluous test methods.
Posted by "Olivier Lamy (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/CONTINUUM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_113134 ]
Olivier Lamy commented on CONTINUUM-1542:
-----------------------------------------
In fact files are available on line :
http://maven.zones.apache.org/continuum/workingCopy.action?projectId=296&projectName=Archiva+Web+%3A%3A+Application&userDirectory=target/surefire-reports&file=TEST-org.apache.maven.archiva.web.repository.RepositoryServletProxiedPluginSnapshotPolicyTest.xml
> Surefire Report in continuum contains excess/superfluous test methods.
> ----------------------------------------------------------------------
>
> Key: CONTINUUM-1542
> URL: http://jira.codehaus.org/browse/CONTINUUM-1542
> Project: Continuum
> Issue Type: Bug
> Components: Testing
> Reporter: Joakim Erdfelt
> Assignee: Olivier Lamy
> Fix For: 1.1
>
>
> When looking at the surefire test results within a continuum build that reported a failure, the list of test methods for the tested class contains extra methods from other tested classes.
> Continuum on maven.zones.apache.org [surefire report example with problem|http://maven.zones.apache.org/continuum/surefireReport.action;jsessionid=10vfs6g7jbl9f?buildId=32827&projectId=296#org.apache.maven.archiva.web.repository.RepositoryServletProxiedReleasePolicyTest]
> If you look at the list of test methods for RepositoryServletProxiedReleasePolicyTest you can see that the report shows the correct # of tests at the top with 15, but when you goto the details for that test, you see well over 15 tests.
> In fact, when you look at the section that starts with "Test Cases" you can see that the list of tests for each Test class is actually the list of tests from the previous Test class + the tests for the current Test class.
> Example:
> +RepositoryServletNoProxyMetadataTest+
>
> (/) testGetVersionMetadataDefaultLayout
> (/) testGetProjectMetadataDefaultLayout
> (/) testGetSnapshotVersionMetadataDefaultLayout
> +ArchivaMimeTypeLoaderTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) testArchivaTypes
> +RepositoryServletProxiedPluginSnapshotPolicyTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) -testArchivaTypes-
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedNewer
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedOlder
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysNoManagedContent
> (/) testGetProxiedSnapshotsArtifactPolicyDailyFail
> ...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (CONTINUUM-1542) Surefire Report in continuum
contains excess/superfluous test methods.
Posted by "Olivier Lamy (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/CONTINUUM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Olivier Lamy updated CONTINUUM-1542:
------------------------------------
Assignee: Olivier Lamy
Fix Version/s: 1.1
> Surefire Report in continuum contains excess/superfluous test methods.
> ----------------------------------------------------------------------
>
> Key: CONTINUUM-1542
> URL: http://jira.codehaus.org/browse/CONTINUUM-1542
> Project: Continuum
> Issue Type: Bug
> Components: Testing
> Reporter: Joakim Erdfelt
> Assignee: Olivier Lamy
> Fix For: 1.1
>
>
> When looking at the surefire test results within a continuum build that reported a failure, the list of test methods for the tested class contains extra methods from other tested classes.
> Continuum on maven.zones.apache.org [surefire report example with problem|http://maven.zones.apache.org/continuum/surefireReport.action;jsessionid=10vfs6g7jbl9f?buildId=32827&projectId=296#org.apache.maven.archiva.web.repository.RepositoryServletProxiedReleasePolicyTest]
> If you look at the list of test methods for RepositoryServletProxiedReleasePolicyTest you can see that the report shows the correct # of tests at the top with 15, but when you goto the details for that test, you see well over 15 tests.
> In fact, when you look at the section that starts with "Test Cases" you can see that the list of tests for each Test class is actually the list of tests from the previous Test class + the tests for the current Test class.
> Example:
> +RepositoryServletNoProxyMetadataTest+
>
> (/) testGetVersionMetadataDefaultLayout
> (/) testGetProjectMetadataDefaultLayout
> (/) testGetSnapshotVersionMetadataDefaultLayout
> +ArchivaMimeTypeLoaderTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) testArchivaTypes
> +RepositoryServletProxiedPluginSnapshotPolicyTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) -testArchivaTypes-
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedNewer
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedOlder
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysNoManagedContent
> (/) testGetProxiedSnapshotsArtifactPolicyDailyFail
> ...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (CONTINUUM-1542) Surefire Report in continuum
contains excess/superfluous test methods.
Posted by "Olivier Lamy (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/CONTINUUM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_113133 ]
Olivier Lamy commented on CONTINUUM-1542:
-----------------------------------------
someone with karma on maven.zones can attach the xml tests output files ?
They are in ${buildDirectory}/296/32827/surefire-reports/*.xml
And for this builds too : http://maven.zones.apache.org/continuum/surefireReport.action?buildId=33424&projectId=441.
The trouble looks to happends when there are test in an AbstractTestCase class this looks to generate inappropriate
Just build archiva and vi vi archiva-web/archiva-webapp/target/surefire-reports/TEST-org.apache.maven.archiva.web.repository.RepositoryServletProxiedPluginSnapshotPolicyTest.xml
At the end of the file I see :
{noformat}
<testcase time="2.292" name="testGetVersionMetadataDefaultLayout"/>
<testcase time="0.311" name="testGetProjectMetadataDefaultLayout"/>
<testcase time="0.287" name="testGetSnapshotVersionMetadataDefaultLayout"/>
<testcase time="0.109" name="testArchivaTypes"/>
<testcase time="1.481" name="testGetProxiedSnapshotsArtifactPolicyAlwaysManagedNewer"/>
<testcase time="0.839" name="testGetProxiedSnapshotsArtifactPolicyAlwaysManagedOlder"/>
<testcase time="0.883" name="testGetProxiedSnapshotsArtifactPolicyAlwaysNoManagedContent"/>
<testcase time="0.79" name="testGetProxiedSnapshotsArtifactPolicyDailyFail"/>
<testcase time="0.832" name="testGetProxiedSnapshotsArtifactPolicyDailyNoManagedContent"/>
<testcase time="1.395" name="testGetProxiedSnapshotsArtifactPolicyDailyPass"/>
<testcase time="0.773" name="testGetProxiedSnapshotsArtifactPolicyRejectFail"/>
<testcase time="0.752" name="testGetProxiedSnapshotsArtifactPolicyRejectNoManagedContentFail"/>
<testcase time="0.771" name="testGetProxiedSnapshotsArtifactPolicyRejectPass"/>
<testcase time="0.919" name="testGetProxiedSnapshotsArtifactPolicyHourlyFail"/>
<testcase time="0.757" name="testGetProxiedSnapshotsArtifactPolicyHourlyNoManagedContent"/>
<testcase time="0.776" name="testGetProxiedSnapshotsArtifactPolicyHourlyPass"/>
<testcase time="0.756" name="testGetProxiedSnapshotsArtifactPolicyOnceFail"/>
<testcase time="0.765" name="testGetProxiedSnapshotsArtifactPolicyOnceNoManagedContent"/>
<testcase time="0.77" name="testGetProxiedSnapshotsArtifactPolicyOncePass"/>
{noformat}
That's why all of this are in the report.
> Surefire Report in continuum contains excess/superfluous test methods.
> ----------------------------------------------------------------------
>
> Key: CONTINUUM-1542
> URL: http://jira.codehaus.org/browse/CONTINUUM-1542
> Project: Continuum
> Issue Type: Bug
> Components: Testing
> Reporter: Joakim Erdfelt
> Assignee: Olivier Lamy
> Fix For: 1.1
>
>
> When looking at the surefire test results within a continuum build that reported a failure, the list of test methods for the tested class contains extra methods from other tested classes.
> Continuum on maven.zones.apache.org [surefire report example with problem|http://maven.zones.apache.org/continuum/surefireReport.action;jsessionid=10vfs6g7jbl9f?buildId=32827&projectId=296#org.apache.maven.archiva.web.repository.RepositoryServletProxiedReleasePolicyTest]
> If you look at the list of test methods for RepositoryServletProxiedReleasePolicyTest you can see that the report shows the correct # of tests at the top with 15, but when you goto the details for that test, you see well over 15 tests.
> In fact, when you look at the section that starts with "Test Cases" you can see that the list of tests for each Test class is actually the list of tests from the previous Test class + the tests for the current Test class.
> Example:
> +RepositoryServletNoProxyMetadataTest+
>
> (/) testGetVersionMetadataDefaultLayout
> (/) testGetProjectMetadataDefaultLayout
> (/) testGetSnapshotVersionMetadataDefaultLayout
> +ArchivaMimeTypeLoaderTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) testArchivaTypes
> +RepositoryServletProxiedPluginSnapshotPolicyTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) -testArchivaTypes-
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedNewer
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedOlder
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysNoManagedContent
> (/) testGetProxiedSnapshotsArtifactPolicyDailyFail
> ...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Moved: (SUREFIRE-369) Surefire Report in continuum contains
excess/superfluous test methods.
Posted by "Emmanuel Venisse (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/SUREFIRE-369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Emmanuel Venisse moved CONTINUUM-1542 to SUREFIRE-369:
------------------------------------------------------
Fix Version/s: (was: 1.1)
2.3.1
Component/s: (was: Testing)
plugin
Key: SUREFIRE-369 (was: CONTINUUM-1542)
Project: Maven Surefire (was: Continuum)
> Surefire Report in continuum contains excess/superfluous test methods.
> ----------------------------------------------------------------------
>
> Key: SUREFIRE-369
> URL: http://jira.codehaus.org/browse/SUREFIRE-369
> Project: Maven Surefire
> Issue Type: Bug
> Components: plugin
> Reporter: Joakim Erdfelt
> Assignee: Olivier Lamy
> Fix For: 2.3.1
>
>
> When looking at the surefire test results within a continuum build that reported a failure, the list of test methods for the tested class contains extra methods from other tested classes.
> Continuum on maven.zones.apache.org [surefire report example with problem|http://maven.zones.apache.org/continuum/surefireReport.action;jsessionid=10vfs6g7jbl9f?buildId=32827&projectId=296#org.apache.maven.archiva.web.repository.RepositoryServletProxiedReleasePolicyTest]
> If you look at the list of test methods for RepositoryServletProxiedReleasePolicyTest you can see that the report shows the correct # of tests at the top with 15, but when you goto the details for that test, you see well over 15 tests.
> In fact, when you look at the section that starts with "Test Cases" you can see that the list of tests for each Test class is actually the list of tests from the previous Test class + the tests for the current Test class.
> Example:
> +RepositoryServletNoProxyMetadataTest+
>
> (/) testGetVersionMetadataDefaultLayout
> (/) testGetProjectMetadataDefaultLayout
> (/) testGetSnapshotVersionMetadataDefaultLayout
> +ArchivaMimeTypeLoaderTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) testArchivaTypes
> +RepositoryServletProxiedPluginSnapshotPolicyTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) -testArchivaTypes-
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedNewer
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedOlder
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysNoManagedContent
> (/) testGetProxiedSnapshotsArtifactPolicyDailyFail
> ...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Closed: (SUREFIRE-369) Surefire Report in continuum contains
excess/superfluous test methods.
Posted by "Emmanuel Venisse (JIRA)" <ji...@codehaus.org>.
[ http://jira.codehaus.org/browse/SUREFIRE-369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Emmanuel Venisse closed SUREFIRE-369.
-------------------------------------
Assignee: Emmanuel Venisse
Resolution: Duplicate
Fix Version/s: (was: 2.3.1)
Duplicate SUREFIRE-122
> Surefire Report in continuum contains excess/superfluous test methods.
> ----------------------------------------------------------------------
>
> Key: SUREFIRE-369
> URL: http://jira.codehaus.org/browse/SUREFIRE-369
> Project: Maven Surefire
> Issue Type: Bug
> Components: plugin
> Reporter: Joakim Erdfelt
> Assignee: Emmanuel Venisse
>
> When looking at the surefire test results within a continuum build that reported a failure, the list of test methods for the tested class contains extra methods from other tested classes.
> Continuum on maven.zones.apache.org [surefire report example with problem|http://maven.zones.apache.org/continuum/surefireReport.action;jsessionid=10vfs6g7jbl9f?buildId=32827&projectId=296#org.apache.maven.archiva.web.repository.RepositoryServletProxiedReleasePolicyTest]
> If you look at the list of test methods for RepositoryServletProxiedReleasePolicyTest you can see that the report shows the correct # of tests at the top with 15, but when you goto the details for that test, you see well over 15 tests.
> In fact, when you look at the section that starts with "Test Cases" you can see that the list of tests for each Test class is actually the list of tests from the previous Test class + the tests for the current Test class.
> Example:
> +RepositoryServletNoProxyMetadataTest+
>
> (/) testGetVersionMetadataDefaultLayout
> (/) testGetProjectMetadataDefaultLayout
> (/) testGetSnapshotVersionMetadataDefaultLayout
> +ArchivaMimeTypeLoaderTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) testArchivaTypes
> +RepositoryServletProxiedPluginSnapshotPolicyTest+
>
> (/) -testGetVersionMetadataDefaultLayout-
> (/) -testGetProjectMetadataDefaultLayout-
> (/) -testGetSnapshotVersionMetadataDefaultLayout-
> (/) -testArchivaTypes-
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedNewer
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysManagedOlder
> (/) testGetProxiedSnapshotsArtifactPolicyAlwaysNoManagedContent
> (/) testGetProxiedSnapshotsArtifactPolicyDailyFail
> ...
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira