You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@singa.apache.org by "Moaz Reyad (JIRA)" <ji...@apache.org> on 2019/05/21 13:14:00 UTC
[jira] [Created] (SINGA-458) ONNX backend test failed
Moaz Reyad created SINGA-458:
--------------------------------
Summary: ONNX backend test failed
Key: SINGA-458
URL: https://issues.apache.org/jira/browse/SINGA-458
Project: Singa
Issue Type: Bug
Reporter: Moaz Reyad
The test of [SINGA ONNX backend|https://github.com/apache/incubator-singa/blob/master/python/singa/sonnx.py#L224] using [onnx.backend.test.BackendTest|https://github.com/apache/incubator-singa/pull/462/commits/6dec4b24df8e469255c7399600eef27773f92052] failed.
There are 1116 unit tests and all of them fail with the error:
{code:sh}
Traceback (most recent call last):
File "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py", line 248, in device_test_func
return test_func(*args, device=device, **kwargs)
File "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py", line 310, in run
outputs = list(prepared_model.run(inputs))
File "/home/moaz/singa/venv/local/lib/python2.7/site-packages/singa/sonnx.py", line 198, in run
tensors[x.name] = x
AttributeError: 'numpy.ndarray' object has no attribute 'name'
----------------------------------------------------------------------
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
Re: [jira] [Created] (SINGA-458) ONNX backend test failed
Posted by Moaz Reyad <mo...@gmail.com>.
We can pass only a subset of the test cases. This subset corresponds to the
SINGA ONNX operator coverage.
See for example the MXNET ONNX operator coverage:
https://cwiki.apache.org/confluence/display/MXNET/ONNX+Operator+Coverage
Moaz
On Tue, May 21, 2019 at 4:30 PM Wang Wei <wa...@comp.nus.edu.sg> wrote:
> Do we need to pass all 1116 tests?
>
>
>
> On Tue, May 21, 2019 at 9:14 PM Moaz Reyad (JIRA) <ji...@apache.org> wrote:
>
> > Moaz Reyad created SINGA-458:
> > --------------------------------
> >
> > Summary: ONNX backend test failed
> > Key: SINGA-458
> > URL: https://issues.apache.org/jira/browse/SINGA-458
> > Project: Singa
> > Issue Type: Bug
> > Reporter: Moaz Reyad
> >
> >
> > The test of [SINGA ONNX backend|
> >
> https://github.com/apache/incubator-singa/blob/master/python/singa/sonnx.py#L224
> ]
> > using [onnx.backend.test.BackendTest|
> >
> https://github.com/apache/incubator-singa/pull/462/commits/6dec4b24df8e469255c7399600eef27773f92052
> ]
> > failed.
> >
> > There are 1116 unit tests and all of them fail with the error:
> >
> >
> > {code:sh}
> > Traceback (most recent call last):
> > File
> >
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py",
> > line 248, in device_test_func
> > return test_func(*args, device=device, **kwargs)
> > File
> >
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py",
> > line 310, in run
> > outputs = list(prepared_model.run(inputs))
> > File
> > "/home/moaz/singa/venv/local/lib/python2.7/site-packages/singa/sonnx.py",
> > line 198, in run
> > tensors[x.name] = x
> > AttributeError: 'numpy.ndarray' object has no attribute 'name'
> >
> > ----------------------------------------------------------------------
> >
> > {code}
> >
> >
> >
> >
> >
> > --
> > This message was sent by Atlassian JIRA
> > (v7.6.3#76005)
> >
>
Re: [jira] [Created] (SINGA-458) ONNX backend test failed
Posted by Wang Wei <wa...@comp.nus.edu.sg>.
Do we need to pass all 1116 tests?
On Tue, May 21, 2019 at 9:14 PM Moaz Reyad (JIRA) <ji...@apache.org> wrote:
> Moaz Reyad created SINGA-458:
> --------------------------------
>
> Summary: ONNX backend test failed
> Key: SINGA-458
> URL: https://issues.apache.org/jira/browse/SINGA-458
> Project: Singa
> Issue Type: Bug
> Reporter: Moaz Reyad
>
>
> The test of [SINGA ONNX backend|
> https://github.com/apache/incubator-singa/blob/master/python/singa/sonnx.py#L224]
> using [onnx.backend.test.BackendTest|
> https://github.com/apache/incubator-singa/pull/462/commits/6dec4b24df8e469255c7399600eef27773f92052]
> failed.
>
> There are 1116 unit tests and all of them fail with the error:
>
>
> {code:sh}
> Traceback (most recent call last):
> File
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py",
> line 248, in device_test_func
> return test_func(*args, device=device, **kwargs)
> File
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py",
> line 310, in run
> outputs = list(prepared_model.run(inputs))
> File
> "/home/moaz/singa/venv/local/lib/python2.7/site-packages/singa/sonnx.py",
> line 198, in run
> tensors[x.name] = x
> AttributeError: 'numpy.ndarray' object has no attribute 'name'
>
> ----------------------------------------------------------------------
>
> {code}
>
>
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v7.6.3#76005)
>