[jira] [Created] (SUREFIRE-1816) XML Report Is generated incorrect only for failed tests in TestFactory or when rerunFailingTestsCount>0

["Iuri Litvinov (Jira)" <ji...@apache.org>]

Iuri Litvinov created SUREFIRE-1816:
---------------------------------------

             Summary: XML Report Is generated incorrect only for failed tests in TestFactory or when rerunFailingTestsCount>0
                 Key: SUREFIRE-1816
                 URL: https://issues.apache.org/jira/browse/SUREFIRE-1816
             Project: Maven Surefire
          Issue Type: Bug
          Components: Maven Failsafe Plugin
    Affects Versions: 3.0.0-M4
            Reporter: Iuri Litvinov


We have TestFactory with DynamicTests like in example. If rerunFailingTestsCount>0 and one of the tests are failed, the plugin generates XML with only one test or only passed tests.

If rerun is 0 or all tests passed, everything is ok.

 

TestFactory:
{code:java}
@Tags(Tag("w"))
@Execution(SAME_THREAD)
@TestFactory
fun `Factory tests`() = iterator<DynamicTest> {

    yield(dynamicTest("Test1") {
        assert(false)
    })

    yield(dynamicTest("Test2") {
        assert(true)
    })
}{code}
 

Pom contains:

 
{code:java}
<artifactId>maven-failsafe-plugin</artifactId>
    <version>3.0.0-M4</version>
    <configuration>
        <consoleOutputReporter implementation="org.apache.maven.plugin.surefire.extensions.junit5.JUnit5ConsoleOutputReporter">
            <disable>false</disable>
            <encoding>UTF-8</encoding>
            <usePhrasedFileName>false</usePhrasedFileName>
        </consoleOutputReporter>
        <statelessTestsetInfoReporter implementation="org.apache.maven.plugin.surefire.extensions.junit5.JUnit5StatelessTestsetInfoReporter">
            <disable>false</disable>
            <usePhrasedClassNameInRunning>true</usePhrasedClassNameInRunning>
            <usePhrasedClassNameInTestCaseSummary>true</usePhrasedClassNameInTestCaseSummary>
            <usePhrasedFileName>false</usePhrasedFileName>
        </statelessTestsetInfoReporter>
        <statelessTestsetReporter implementation="org.apache.maven.plugin.surefire.extensions.junit5.JUnit5Xml30StatelessReporter">
            <disable>false</disable>
            <usePhrasedFileName>false</usePhrasedFileName>
            <usePhrasedTestCaseClassName>true</usePhrasedTestCaseClassName>
            <usePhrasedTestCaseMethodName>true</usePhrasedTestCaseMethodName>
            <usePhrasedTestSuiteClassName>true</usePhrasedTestSuiteClassName>
            <version>3.0</version>
        </statelessTestsetReporter>
        <trimStackTrace>false</trimStackTrace>
        <parallel>classes</parallel>
        <forkCount>${fork.count}</forkCount>
        <threadCount>${fork.count}</threadCount>
        <reuseForks>false</reuseForks>
        <argLine>-Xmx2048m</argLine>
        <rerunFailingTestsCount>1</rerunFailingTestsCount>
        <includes>
            <include>${includeRule}</include>
        </includes>
        <excludes>
            <exclude>${excludeRule}</exclude>
        </excludes>
        <groups>${tags}</groups>
        <reportsDirectory>${project.build.directory}/failsafe-reports/${timestamp}</reportsDirectory>
        <systemProperties>
            <property>
                <name>junit.jupiter.extensions.autodetection.enabled</name>
                <value>true</value>
            </property>
        </systemProperties>
        <systemPropertyVariables>
            <osVersion>${osVersion}</osVersion>
            <device>${device}</device>
        </systemPropertyVariables>
    </configuration>
    <executions>
        <execution>
            <goals>
                <goal>integration-test</goal>
                <goal>verify</goal>
            </goals>
        </execution>
    </executions>
</plugin>
{code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)