[jira] [Created] (SUREFIRE-2143) Disabled @ParametrizedTest is not counted as skipped one in M8 (worked in M7)

["Jiri Ondrusek (Jira)" <ji...@apache.org>]

Jiri Ondrusek created SUREFIRE-2143:
---------------------------------------

             Summary: Disabled @ParametrizedTest is not counted as skipped one in M8 (worked in M7)
                 Key: SUREFIRE-2143
                 URL: https://issues.apache.org/jira/browse/SUREFIRE-2143
             Project: Maven Surefire
          Issue Type: Bug
          Components: JUnit 5.x support
    Affects Versions: 3.0.0-M8
            Reporter: Jiri Ondrusek


I'm upgrading surefire plugin from 2.22.2 to 3.0.0-M8, but there are differences in numbers of skipped tests.

 

Follows https://issues.apache.org/jira/browse/SUREFIRE-1812 -> which is working correctly with M8 (not with M7)

 

But there is another issue, when disabled @ParametrizedTest is not counted towards skipped tests. This issue happens in M8, works in M7 

 

I prepared simple reproducer - [https://github.com/JiriOndrusek/surefire-reproducer-2]

 

Result with 3.0.0-M8 is  *wrong* 
{code:java}
 [INFO] Running reproducer.ReproducerTest
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.03 s - in reproducer.ReproducerTest
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1
 {code}
Result with 3.0.0-M7 is correct:
{code:java}
[INFO] Running reproducer.ReproducerTest
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 0.031 s - in reproducer.ReproducerTest
[INFO] 
[INFO] Results:
[INFO] 
[WARNING] Tests run: 2, Failures: 0, Errors: 0, Skipped: 2
{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)