[jira] [Created] (RYA-399) Modify tests to run in random order

["Jeff Dasch (JIRA)" <ji...@apache.org>]

Jeff Dasch created RYA-399:
------------------------------

             Summary: Modify tests to run in random order
                 Key: RYA-399
                 URL: https://issues.apache.org/jira/browse/RYA-399
             Project: Rya
          Issue Type: Improvement
          Components: build
            Reporter: Jeff Dasch


By default the maven-surefire-plugin uses -Dsurefire.runOrder=filesystem.  If tests are not completely isolated, this can result in host-specific test failures depending on how a host sorts the test.

Recommend changing the runOrder to random, or hourly at a minimum.  This will help improve the robustness of tests in the long term and the expense of random test failures in the near term.

Reference: http://maven.apache.org/surefire/maven-surefire-plugin/test-mojo.html#runOrder



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)