You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@maven.apache.org by "Larry Shatzer (JIRA)" <ji...@codehaus.org> on 2012/11/08 22:49:13 UTC

[jira] (SUREFIRE-926) Multiple Providers, last one overwrites status of first...

Larry Shatzer created SUREFIRE-926:
--------------------------------------

             Summary: Multiple Providers, last one overwrites status of first...
                 Key: SUREFIRE-926
                 URL: https://jira.codehaus.org/browse/SUREFIRE-926
             Project: Maven Surefire
          Issue Type: Bug
          Components: Maven Surefire Plugin
    Affects Versions: 2.12.4
            Reporter: Larry Shatzer
            Priority: Critical


See http://markmail.org/message/6i55xg732hyqgln6 

In addition to the Release Plugin having problems, just running "mvn test" will show the build as successful if the first provider has failures.

I'm trying to create integration tests, but having a few issues.

The two tests I tried to create is where they both bring in TestNG and JUnit into the providers (like the email has), and then one have a TestNG failure, while the JUnit passes, and the inverse on the other. This way it would make sure if the order of providers changes, or is not defined, it would catch it. Any pointers or existing tests that can be tweaked/copied would be helpful.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://jira.codehaus.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] (SUREFIRE-926) Multiple Providers, last one overwrites status of first...

Posted by "Kristian Rosenvold (JIRA)" <ji...@codehaus.org>.
     [ https://jira.codehaus.org/browse/SUREFIRE-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kristian Rosenvold closed SUREFIRE-926.
---------------------------------------

       Resolution: Fixed
    Fix Version/s: 2.13
         Assignee: Kristian Rosenvold

Fixed in 53456de3d83447059382c5b8fa92a59094ab769e, IT based on test-case by Larry Shatzer in 137aa1d3250726937c2c5f04200c5a07a015dc76
                
> Multiple Providers, last one overwrites status of first...
> ----------------------------------------------------------
>
>                 Key: SUREFIRE-926
>                 URL: https://jira.codehaus.org/browse/SUREFIRE-926
>             Project: Maven Surefire
>          Issue Type: Bug
>          Components: Maven Surefire Plugin
>    Affects Versions: 2.12.4
>            Reporter: Larry Shatzer
>            Assignee: Kristian Rosenvold
>            Priority: Critical
>             Fix For: 2.13
>
>         Attachments: surefire-265.zip
>
>
> See http://markmail.org/message/6i55xg732hyqgln6 
> In addition to the Release Plugin having problems, just running "mvn test" will show the build as successful if the first provider has failures.
> I'm trying to create integration tests, but having a few issues.
> The two tests I tried to create is where they both bring in TestNG and JUnit into the providers (like the email has), and then one have a TestNG failure, while the JUnit passes, and the inverse on the other. This way it would make sure if the order of providers changes, or is not defined, it would catch it. Any pointers or existing tests that can be tweaked/copied would be helpful.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://jira.codehaus.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] (SUREFIRE-926) Multiple Providers, last one overwrites status of first...

Posted by "Larry Shatzer (JIRA)" <ji...@codehaus.org>.
     [ https://jira.codehaus.org/browse/SUREFIRE-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Larry Shatzer updated SUREFIRE-926:
-----------------------------------

    Attachment: surefire-265.zip

Here is a test where JUnit fails, and TestNG passes. You can easily switch the asserts in each to flip it around so you can get two IT's out of it...
                
> Multiple Providers, last one overwrites status of first...
> ----------------------------------------------------------
>
>                 Key: SUREFIRE-926
>                 URL: https://jira.codehaus.org/browse/SUREFIRE-926
>             Project: Maven Surefire
>          Issue Type: Bug
>          Components: Maven Surefire Plugin
>    Affects Versions: 2.12.4
>            Reporter: Larry Shatzer
>            Priority: Critical
>         Attachments: surefire-265.zip
>
>
> See http://markmail.org/message/6i55xg732hyqgln6 
> In addition to the Release Plugin having problems, just running "mvn test" will show the build as successful if the first provider has failures.
> I'm trying to create integration tests, but having a few issues.
> The two tests I tried to create is where they both bring in TestNG and JUnit into the providers (like the email has), and then one have a TestNG failure, while the JUnit passes, and the inverse on the other. This way it would make sure if the order of providers changes, or is not defined, it would catch it. Any pointers or existing tests that can be tweaked/copied would be helpful.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://jira.codehaus.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] (SUREFIRE-926) Multiple Providers, last one overwrites status of first...

Posted by "Kristian Rosenvold (JIRA)" <ji...@codehaus.org>.
    [ https://jira.codehaus.org/browse/SUREFIRE-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=313234#comment-313234 ] 

Kristian Rosenvold commented on SUREFIRE-926:
---------------------------------------------

I see this issue quite clearly in the code; the failure detection will ignore failures in the first provider fails. If you have made a small test project, please upload it and I will make an IT.
                
> Multiple Providers, last one overwrites status of first...
> ----------------------------------------------------------
>
>                 Key: SUREFIRE-926
>                 URL: https://jira.codehaus.org/browse/SUREFIRE-926
>             Project: Maven Surefire
>          Issue Type: Bug
>          Components: Maven Surefire Plugin
>    Affects Versions: 2.12.4
>            Reporter: Larry Shatzer
>            Priority: Critical
>
> See http://markmail.org/message/6i55xg732hyqgln6 
> In addition to the Release Plugin having problems, just running "mvn test" will show the build as successful if the first provider has failures.
> I'm trying to create integration tests, but having a few issues.
> The two tests I tried to create is where they both bring in TestNG and JUnit into the providers (like the email has), and then one have a TestNG failure, while the JUnit passes, and the inverse on the other. This way it would make sure if the order of providers changes, or is not defined, it would catch it. Any pointers or existing tests that can be tweaked/copied would be helpful.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://jira.codehaus.org/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira