[jira] Commented: (MATH-520) Some unit tests fail in "CMAESOptimizerTest"

["Luc Maisonobe (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MATH-520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12997112#comment-12997112 ] 

Luc Maisonobe commented on MATH-520:
------------------------------------

Unit test should not fail "sometimes".
As long as they are used in automated tests, they should have deterministic behaviour. This means that if they use some random drawings, the seed of the generator *must* be set to a constant value in the unit tests.

Of course, for validation testing, this constraint should be removed to invastigate potential problems.

I think we have already encountered this kind of problems a few times, in the statistics package if I remember well.

> Some unit tests fail in "CMAESOptimizerTest"
> --------------------------------------------
>
>                 Key: MATH-520
>                 URL: https://issues.apache.org/jira/browse/MATH-520
>             Project: Commons Math
>          Issue Type: Task
>            Reporter: Gilles
>              Labels: test
>             Fix For: 3.0
>
>
> Out of 28 test runs, "CMAESOptimizerTest" failed 6 times. Those failures were sometimes in "testMaximize" and sometimes in "testDiagonalRosen".
> Is there some way to reduce the failure ratio?
> Anyways, it would probably be useful to introduce comments for those methods that are expected to fail sometimes.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira