You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@rya.apache.org by "Jeff Dasch (JIRA)" <ji...@apache.org> on 2017/10/05 14:38:01 UTC

[jira] [Updated] (RYA-399) Modify tests to run in random order

     [ https://issues.apache.org/jira/browse/RYA-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeff Dasch updated RYA-399:
---------------------------
    Description: 
By default the maven-surefire-plugin uses {{-Dsurefire.runOrder=filesystem}}.  If tests are not completely isolated, this can result in host-specific test failures depending on how a host sorts the test.

Recommend changing the runOrder to {{random}}, or at a minimum, {{hourly}}.  This will help improve the robustness of tests in the long term and the expense of random test failures in the near term.

Reference: http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html#runOrder

  was:
By default the maven-surefire-plugin uses -Dsurefire.runOrder=filesystem.  If tests are not completely isolated, this can result in host-specific test failures depending on how a host sorts the test.

Recommend changing the runOrder to random, or hourly at a minimum.  This will help improve the robustness of tests in the long term and the expense of random test failures in the near term.

Reference: http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html#runOrder


> Modify tests to run in random order
> -----------------------------------
>
>                 Key: RYA-399
>                 URL: https://issues.apache.org/jira/browse/RYA-399
>             Project: Rya
>          Issue Type: Improvement
>          Components: build
>            Reporter: Jeff Dasch
>
> By default the maven-surefire-plugin uses {{-Dsurefire.runOrder=filesystem}}.  If tests are not completely isolated, this can result in host-specific test failures depending on how a host sorts the test.
> Recommend changing the runOrder to {{random}}, or at a minimum, {{hourly}}.  This will help improve the robustness of tests in the long term and the expense of random test failures in the near term.
> Reference: http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html#runOrder



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)