You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2019/11/16 23:09:26 UTC

[GitHub] [incubator-mxnet] haojin2 commented on issue #11809: Flaky test: test_hybrid_static_memory

haojin2 commented on issue #11809: Flaky test: test_hybrid_static_memory
URL: https://github.com/apache/incubator-mxnet/issues/11809#issuecomment-554683148
 
 
   Happening again: http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-gpu/detail/PR-16829/9/pipeline/
   ```
   ======================================================================
   FAIL: test_gluon_gpu.test_hybrid_static_memory
   ----------------------------------------------------------------------
   Traceback (most recent call last):
     File "/usr/local/lib/python3.5/dist-packages/nose/case.py", line 198, in runTest
       self.test(*self.arg)
     File "/usr/local/lib/python3.5/dist-packages/nose/util.py", line 620, in newfunc
       return func(*arg, **kw)
     File "/work/mxnet/tests/python/gpu/../unittest/common.py", line 177, in test_new
       orig_test(*args, **kwargs)
     File "/work/mxnet/tests/python/gpu/../unittest/test_gluon.py", line 1680, in test_hybrid_static_memory
       check_hybrid_static_memory(static_alloc=True)
     File "/work/mxnet/tests/python/gpu/../unittest/test_gluon.py", line 1675, in check_hybrid_static_memory
       assert_almost_equal(grads1[key].asnumpy(), grads2[key].asnumpy(), rtol=1e-3, atol=1e-5)
     File "/work/mxnet/python/mxnet/test_utils.py", line 627, in assert_almost_equal
       raise AssertionError(msg)
   AssertionError: 
   Items are not equal:
   Error 2.432765 exceeds tolerance rtol=1.000000e-03, atol=1.000000e-05 (mismatch 0.002713%).
   Location of maximum error: (45, 50, 2, 1), a=0.00251389, b=0.00254440
    ACTUAL: array([[[[ -4.9708405 ,   5.0227804 ,   1.2681608 ],
            [ -3.95312   ,  20.59486   ,  17.561035  ],
            [ -2.8548512 ,  12.628487  ,   5.902029  ]],...
    DESIRED: array([[[[ -4.9708395 ,   5.022783  ,   1.2681627 ],
            [ -3.9531207 ,  20.59486   ,  17.561031  ],
            [ -2.8548517 ,  12.628485  ,   5.902028  ]],...
   -------------------- >> begin captured stdout << ---------------------
   
   *** Maximum errors for vector of size 36864:  rtol=0.001, atol=1e-05
   
     1: Error 2.432765  Location of error: (45, 50, 2, 1), a=0.00251389, b=0.00254440
   
   --------------------- >> end captured stdout << ----------------------
   -------------------- >> begin captured logging << --------------------
   common: INFO: Setting test np/mx/python random seeds, use MXNET_TEST_SEED=1509166681 to reproduce.
   --------------------- >> end captured logging << ---------------------
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services