[GitHub] KellenSunderland edited a comment on issue #11713: test_operator.test_deformable_psroipooling has fixed seed that can mask flakiness

[GitBox <gi...@apache.org>]

KellenSunderland edited a comment on issue #11713: test_operator.test_deformable_psroipooling has fixed seed that can mask flakiness
URL: https://github.com/apache/incubator-mxnet/issues/11713#issuecomment-414123907
 
 
   @marcoabreu Can we re-open the issue?  This test seems to have regressed http://jenkins.mxnet-ci-dev.amazon-ml.com/blue/organizations/jenkins/incubator-mxnet/detail/master/1114/pipeline/
   
   Edit, new error output:
   ```
   ======================================================================
   
   FAIL: test_operator_gpu.test_deformable_psroipooling
   
   ----------------------------------------------------------------------
   
   Traceback (most recent call last):
   
     File "C:\Anaconda3\envs\py3\lib\site-packages\nose\case.py", line 197, in runTest
   
       self.test(*self.arg)
   
     File "C:\Anaconda3\envs\py3\lib\site-packages\nose\util.py", line 620, in newfunc
   
       return func(*arg, **kw)
   
     File "C:\jenkins_slave\workspace\ut-python-gpu\tests\python\gpu\../unittest\common.py", line 172, in test_new
   
       orig_test(*args, **kwargs)
   
     File "C:\jenkins_slave\workspace\ut-python-gpu\tests\python\gpu\../unittest\test_operator.py", line 5142, in test_deformable_psroipooling
   
       grad_nodes=grad_nodes, ctx=mx.gpu(0))
   
     File "C:\jenkins_slave\workspace\ut-python-gpu\windows_package\python\mxnet\test_utils.py", line 912, in check_numeric_gradient
   
       ("NUMERICAL_%s"%name, "BACKWARD_%s"%name))
   
     File "C:\jenkins_slave\workspace\ut-python-gpu\windows_package\python\mxnet\test_utils.py", line 491, in assert_almost_equal
   
       raise AssertionError(msg)
   
   AssertionError: 
   
   Items are not equal:
   
   Error 1.492931 exceeds tolerance rtol=0.010000, atol=0.001000.  Location of maximum error:(0, 0, 0, 2), a=0.022352, b=0.020552
   
    NUMERICAL_offset_data: array([[[[ 0.02138317, -0.05628169,  0.02235174],
   
            [ 0.0551343 ,  0.01367927, -0.01856685],
   
            [-0.01631677,  0.02881885, -0.02375245]],...
   
    BACKWARD_offset_data: array([[[[ 0.02137728, -0.05627852,  0.02055198],
   
            [ 0.05513161,  0.01363545, -0.01863495],
   
            [-0.01631445,  0.02880441, -0.02376944]],...
   
   -------------------- >> begin captured logging << --------------------
   
   common: INFO: Setting test np/mx/python random seeds, use MXNET_TEST_SEED=1408192757 to reproduce.
   
   --------------------- >> end captured logging << ---------------------
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services