You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@maven.apache.org by "Christian Marquez Grabia (Jira)" <ji...@apache.org> on 2022/04/08 17:53:00 UTC

[jira] [Created] (SUREFIRE-2065) JUnit4 Parameterized Tests Grouping Incorrectly

Christian Marquez Grabia created SUREFIRE-2065:
--------------------------------------------------

             Summary: JUnit4 Parameterized Tests Grouping Incorrectly
                 Key: SUREFIRE-2065
                 URL: https://issues.apache.org/jira/browse/SUREFIRE-2065
             Project: Maven Surefire
          Issue Type: Bug
          Components: Junit 4.x support
    Affects Versions: 3.0.0-M6, 3.0.0-M5, 3.0.0-M7
            Reporter: Christian Marquez Grabia


Running parameterized tests with the junit-platform provider causes tests to be counted as single test (unlike using junit4 provider). This makes the tests to be marked as 'Flaky' and marks the build as successful if the retry failed count is greater than zero. Reports also show a single test run even if there were multiple tests with different parameters.

For a sample project with the problem see [surefire-flaky-issue|https://github.com/chalmagr/surefire-flaky-report] 

This is also a possibly related to issue SUREFIRE-2010 and may help in the resolution of it.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)