You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/05/27 12:23:49 UTC

[GitHub] [incubator-mxnet] RuRo commented on pull request #18054: Bump ONNX version to 1.5.0

RuRo commented on pull request #18054:
URL: https://github.com/apache/incubator-mxnet/pull/18054#issuecomment-634623916


   So I came back after my exams to find that the ONNX version was apparently bumped to 1.5.0 in #18025, but the tests weren't actually updated. I am not sure, why are the tests marked as passing even thought there is a ton of errors.
   
   For example, [here](http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/master/1983/pipeline/376) ([raw](http://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/master/runs/1983/nodes/376/log/?start=0)) you can see that there are a lot of ONNX tests failing, but the pipeline is still marked as green.
   
   <details>
   
   ```
   .s.s.sEsEs.s.sssssssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.sEsEs.s.sEsEs.sssss.sss.sssss.sssss.s.sssssssssss.s.s.s.s.s.sEs.s.s.s.s.s.s.s.s.s.s.sssssss.s.s.s.s.s.sss.sssssssssssssssssssssssssssssss.s.sEsEs.s.sss.s.s.s.s.s.s.s.s.sssssss.s.sssssssssssssssssss.s.s.s.s.sssss.s.s.s.sssssssssss.s.s.s.s.s.s.s.s.s.s.s.sssssssss.s.s.sssss.s.sssssssssssssssssssssss.s.s.sEs.s.s.sssssssssssssssssssssssssssssssss.s.s.s.s.s.sssssssss.s.s.sssss.s.sssssssssssssssssssssssssssssssssssssssssssssss.sss.s.sssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssssssssssssssssssssssssssssss.sss.s.sssss.s.sssssss.s.sEsEs.s.sEsssssEsEsEsssssss.sss.s.s.s.s.s.s.s.s.sssssss.s.s.sssssssssssss.s.s.s.s.s.s.s.s.s.sssssssssssssssssssssssssEs.s.s.s.s.s.s.s.sssssssssssssssssssss.s.sssss.sss.s.s.sssssssssssss.sssssssssssssssssssssssssss.s.s.s.s.sssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss.s.s.s.s.s.s.s.s.s.s.s.sssssssssssssss.sssssssssss.s.s.s.sssssssssssssssssssssssssssssssss.sssssssss.s.sssssssssssssssssssssssss
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_acosh_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Acosh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_acosh_example_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Acosh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_asinh_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Asinh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_asinh_example_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Asinh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_atanh_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Atanh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_atanh_example_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Atanh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_cast_FLOAT_to_STRING_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 69, in _convert_operator
   [2020-05-27T04:58:58.762Z]     mxnet_sym = new_op(*inputs, **new_attrs)
   [2020-05-27T04:58:58.762Z]   File "<string>", line 65, in cast
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/_ctypes/symbol.py", line 132, in _symbol_creator
   [2020-05-27T04:58:58.762Z]     ctypes.byref(sym_handle)))
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/base.py", line 246, in check_call
   [2020-05-27T04:58:58.762Z]     raise get_last_ffi_error()
   [2020-05-27T04:58:58.762Z] mxnet.base.MXNetError: MXNetError: Invalid Input: 'object', valid values are: {'bfloat16', 'bool', 'float16', 'float32', 'float64', 'int32', 'int64', 'int8', 'uint8'}, in operator Cast(name="", __profiler_scope__="<unk>:", dtype="object")
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_cosh_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Cosh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_cosh_example_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Cosh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_matmulinteger_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator MatMulInteger not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_sinh_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Sinh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_sinh_example_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 63, in _convert_operator
   [2020-05-27T04:58:58.762Z]     raise NotImplementedError("Operator {} not implemented.".format(op_name))
   [2020-05-27T04:58:58.762Z] NotImplementedError: Operator Sinh not implemented.
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_slice_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 61, in _convert_operator
   [2020-05-27T04:58:58.762Z]     op_name, new_attrs, inputs = convert_map[op_name](attrs, inputs, self)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/_op_translations.py", line 511, in _slice
   [2020-05-27T04:58:58.762Z]     end = list(new_attrs.get('end'))
   [2020-05-27T04:58:58.762Z] TypeError: 'NoneType' object is not iterable
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_slice_end_out_of_bounds_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 61, in _convert_operator
   [2020-05-27T04:58:58.762Z]     op_name, new_attrs, inputs = convert_map[op_name](attrs, inputs, self)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/_op_translations.py", line 511, in _slice
   [2020-05-27T04:58:58.762Z]     end = list(new_attrs.get('end'))
   [2020-05-27T04:58:58.762Z] TypeError: 'NoneType' object is not iterable
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_slice_neg_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 61, in _convert_operator
   [2020-05-27T04:58:58.762Z]     op_name, new_attrs, inputs = convert_map[op_name](attrs, inputs, self)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/_op_translations.py", line 511, in _slice
   [2020-05-27T04:58:58.762Z]     end = list(new_attrs.get('end'))
   [2020-05-27T04:58:58.762Z] TypeError: 'NoneType' object is not iterable
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_slice_neg_steps_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 61, in _convert_operator
   [2020-05-27T04:58:58.762Z]     op_name, new_attrs, inputs = convert_map[op_name](attrs, inputs, self)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/_op_translations.py", line 511, in _slice
   [2020-05-27T04:58:58.762Z]     end = list(new_attrs.get('end'))
   [2020-05-27T04:58:58.762Z] TypeError: 'NoneType' object is not iterable
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ======================================================================
   [2020-05-27T04:58:58.762Z] ERROR: test_top_k_cpu (__main__.OnnxBackendNodeModelTest)
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Traceback (most recent call last):
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
   [2020-05-27T04:58:58.762Z]     return test_func(*args, device=device, **kwargs)
   [2020-05-27T04:58:58.762Z]   File "/usr/local/lib/python3.6/dist-packages/onnx/backend/test/runner/__init__.py", line 278, in run
   [2020-05-27T04:58:58.762Z]     prepared_model = self.backend.prepare(model, device)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/tests/python/unittest/onnx/backend.py", line 99, in prepare
   [2020-05-27T04:58:58.762Z]     sym, arg_params, aux_params = graph.from_onnx(model.graph)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 115, in from_onnx
   [2020-05-27T04:58:58.762Z]     mxnet_sym = self._convert_operator(node_name, op_name, onnx_attr, inputs)
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/contrib/onnx/onnx2mx/import_onnx.py", line 69, in _convert_operator
   [2020-05-27T04:58:58.762Z]     mxnet_sym = new_op(*inputs, **new_attrs)
   [2020-05-27T04:58:58.762Z]   File "<string>", line 106, in topk
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/_ctypes/symbol.py", line 132, in _symbol_creator
   [2020-05-27T04:58:58.762Z]     ctypes.byref(sym_handle)))
   [2020-05-27T04:58:58.762Z]   File "/work/mxnet/python/mxnet/base.py", line 246, in check_call
   [2020-05-27T04:58:58.762Z]     raise get_last_ffi_error()
   [2020-05-27T04:58:58.762Z] mxnet.base.MXNetError: MXNetError: Invalid Parameter format for axis expect int or None but value='<Symbol k>', in operator topk(name="", __profiler_scope__="<unk>:", axis="<Symbol k>", dtype="int64", ret_typ="both")
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] ----------------------------------------------------------------------
   [2020-05-27T04:58:58.762Z] Ran 1116 tests in 603.735s
   [2020-05-27T04:58:58.762Z] 
   [2020-05-27T04:58:58.762Z] FAILED (errors=17, skipped=853)
   ```
   </details>
   
   I am in the process of investigating, if my proposed fixes for the ONNX tests still work with the recent testing pipeline changes.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org