You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2019/01/11 00:08:51 UTC

[GitHub] larroy opened a new issue #13839: Flaky ONNX test TestNode.test_imports

larroy opened a new issue #13839: Flaky ONNX test TestNode.test_imports
URL: https://github.com/apache/incubator-mxnet/issues/13839
 
 
   http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-13834/2/pipeline
   
   ```
   ============================= test session starts ==============================
   
   platform linux -- Python 3.5.2, pytest-3.4.0, py-1.7.0, pluggy-0.6.0
   
   rootdir: /work/mxnet, inifile:
   
   plugins: cov-2.5.1
   
   collected 2 items
   
   
   
   tests/python-pytest/onnx/test_node.py .F                                 [100%]
   
   
   
   =================================== FAILURES ===================================
   
   ____________________________ TestNode.test_imports _____________________________
   
   
   
   self = <test_node.TestNode testMethod=test_imports>
   
   
   
       def test_imports(self):
   
           for test in import_test_cases:
   
               test_name, onnx_name, inputs, np_op, attrs = test
   
               with self.subTest(test_name):
   
                   names, input_tensors, inputsym = get_input_tensors(inputs)
   
                   np_out = [np_op(*inputs, **attrs)]
   
                   output_shape = np.shape(np_out)
   
                   onnx_model = get_onnx_graph(test_name, names, input_tensors, onnx_name, output_shape, attrs)
   
                   bkd_rep = backend.prepare(onnx_model, operation='import')
   
                   mxnet_out = bkd_rep.run(inputs)
   
   >               npt.assert_almost_equal(np_out, mxnet_out)
   
   E               AssertionError: 
   
   E               Arrays are not almost equal to 7 decimals
   
   E               
   
   E               (mismatch 10.0%)
   
   E                x: array([2.1891336, 1.2304349, 1.2308753, 1.6621659, 1.4207152, 2.1186988,
   
   E                      1.6284282, 1.7537684, 1.5224308, 1.8105199, 1.6884999, 0.9593497,
   
   E                      1.4970635, 1.3806013, 2.0596354, 0.8462211, 1.613757 , 2.3153749,...
   
   E                y: array([2.1891336, 1.2304349, 1.2308753, 1.6621659, 1.4207152, 2.1186988,
   
   E                      1.6284282, 1.7537684, 1.5224308, 1.8105198, 1.6884999, 0.9593497,
   
   E                      1.4970635, 1.3806013, 2.0596354, 0.846221 , 1.613757 , 2.3153749,...
   
   
   
   tests/python-pytest/onnx/test_node.py:183: AssertionError
   
   ====================== 1 failed, 1 passed in 1.91 seconds ======================
   
   ```
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services