[jira] [Created] (SUREFIRE-1903) Tests count results are collated incorrectly when using rerun feature

["Michal Toth (Jira)" <ji...@apache.org>]

Michal Toth created SUREFIRE-1903:
-------------------------------------

             Summary: Tests count results are collated incorrectly when using rerun feature
                 Key: SUREFIRE-1903
                 URL: https://issues.apache.org/jira/browse/SUREFIRE-1903
             Project: Maven Surefire
          Issue Type: Bug
          Components: Maven Surefire Plugin, Maven Surefire Report Plugin
    Affects Versions: 3.0.0-M5
            Reporter: Michal Toth


There is a discrepancy in test output results when we execute some of our tests and some of them are rerun. 
For example: We executed 1 test class, containing 7 tests and here are results:
{code}
mvn -f /home/cloud-user/jenkins/workspace/strimzi/strimzi-pull-request-job/systemtest/pom.xml -P all verify .... -Dfailsafe.rerunFailingTestsCount=2 
...
[ERROR] Tests run: 7, Failures: 0, Errors: 2, Skipped: 1, Time elapsed: 1,062.97 s <<< FAILURE! - in io.strimzi.systemtest.log.LogSettingST
...
[ERROR] Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 708.103 s <<< FAILURE! 
...
Overall result
[INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 434.379 s - in io.strimzi.systemtest.log.LogSettingST
{code}

I also found a similar discussion PR at https://github.com/apache/maven-surefire/pull/313

Thank you



--
This message was sent by Atlassian Jira
(v8.3.4#803005)