[jira] [Commented] (SUREFIRE-1812) Skipped tests (by annotation @EnabledIfEnvironmentVariable on the test class) are not reported

["Jiri Ondrusek (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SUREFIRE-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17678246#comment-17678246 ] 

Jiri Ondrusek commented on SUREFIRE-1812:
-----------------------------------------

[~tibordigana] 
I verified the current state of the problem with my reproducer.  All versions 3.0.0-M5 - 3.0.0-M7 show the error. 

Version 3.0.0-M8 shows the correct result, therefore I think that the issue may by closed as fixed (TBH I didn't search for the commit fixing that behavior. The results just confirm, that some upgrades between M7 and M8 fixed this issue)

> Skipped tests (by annotation @EnabledIfEnvironmentVariable on the test class) are not reported
> ----------------------------------------------------------------------------------------------
>
>                 Key: SUREFIRE-1812
>                 URL: https://issues.apache.org/jira/browse/SUREFIRE-1812
>             Project: Maven Surefire
>          Issue Type: Bug
>          Components: JUnit 5.x support, Maven Surefire Plugin
>    Affects Versions: 3.0.0-M4, 3.0.0-M5
>            Reporter: Jiri Ondrusek
>            Priority: Major
>              Labels: junit5
>             Fix For: Backlog
>
>
> I'm upgrading surefire plugin from 2.22.2 and there is a different behavior started from 3.0.0-M4.
> When the test class is ignored by using @EnabledIfEnvironmentVariable(...), final report shows bad information: (3.0.0.-M4, M5, master)
> {quote}[INFO] Results:
> [INFO] 
> [INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
> {quote}
> The same test executed with 3.0.0-M3 shows:
> {quote}[INFO] Results:
> [INFO] 
> [WARNING] Tests run: 1, Failures: 0, Errors: 0, Skipped: 1
> {quote}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)