[jira] [Created] (SUREFIRE-2095) Fork crash doesn't fail build with -Dmaven.test.failure.ignore=true when run with failsafe

["Aaron Braunstein (Jira)" <ji...@apache.org>]

Aaron Braunstein created SUREFIRE-2095:
------------------------------------------

             Summary: Fork crash doesn't fail build with -Dmaven.test.failure.ignore=true when run with failsafe
                 Key: SUREFIRE-2095
                 URL: https://issues.apache.org/jira/browse/SUREFIRE-2095
             Project: Maven Surefire
          Issue Type: Bug
          Components: Maven Failsafe Plugin, process forking
            Reporter: Aaron Braunstein


When tests are run with failsafe that crash the JVM, if the maven.test.failure.ignore option is enabled the verify goal does not fail. Additionally, the error and failure counts in the report summary XML are 0. Together this means that the build succeeds despite some test(s) failing and some tests potentially not even being run whatsoever - and a CI like Jenkins won't mark the build as unstable either.

SUREFIRE-1426 fixed this for tests run with the surefire plugin, but due to differences with how test reporting works in the failsafe plugin (tests are first run in the integration-test goal then actually checked for failures in the verify goal), the issue is still present.

Affected tests show within the failsafe summary XML failureMessage: {{SurefireBooterForkException}}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)