[jira] (SUREFIRE-841) Incorrect Test Run Count

["Mikhail Mazursky (JIRA)" <ji...@codehaus.org>]

    [ https://jira.codehaus.org/browse/SUREFIRE-841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=307511#comment-307511 ] 

Mikhail Mazursky commented on SUREFIRE-841:
-------------------------------------------

Also encountered this with surefire 2.12.3 and TestNG 6.7. Failure in @BeforeClass increments "Tests run".

{code}
public class RealTest  {
	
	@BeforeClass
	public void beforeClass() {
		assertThat(false).isTrue();
	}
	
	@Test
	public void test(){}
}
{code}

With failure it's output is
{noformat}
Tests run: 2, Failures: 1, Errors: 0, Skipped: 1
{noformat}

Without:
{noformat}
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
{noformat}
                
> Incorrect Test Run Count
> ------------------------
>
>                 Key: SUREFIRE-841
>                 URL: https://jira.codehaus.org/browse/SUREFIRE-841
>             Project: Maven Surefire
>          Issue Type: Bug
>          Components: Maven Surefire Plugin
>            Reporter: karthik kandasamy
>
> When a simple Junit test with errors in the @Before() and @After() method are run directly with java or ant's junit task, it reports correctly that the Tests Run = 1  and  Errors = 2.
> But when the same is run through maven surefire plugin, it reports it as Tests Run = 2  and Errors = 2.
> Its the same test in which 2 errors are encountered, so the Tests Run should be 1.
> I traced the issue to the org.apache.maven.surefire.report.TestSetRunListener Class - testError() method, where the completed count is also incremented along with the error count irrespective of whether its in the same test the error is encountered.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://jira.codehaus.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira